Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 60801, USA
Department of Computer Engineering, College of Engineering, Koc University, 34450 Istanbul, Turkey
Abstract
Level-crossing analog-to-digital converters (LC ADCs) have been considered in the literature and have been shown to efficiently sample certain classes of signals. One important aspect of their implementation is the placement of reference levels in the converter. The levels need to be appropriately located within the input dynamic range, in order to obtain samples efficiently. In this paper, we study optimization of the performance of such an LC ADC by providing several sequential algorithms that adaptively update the ADC reference levels. The accompanying performance analysis and simulation results show that as the signal length grows, the performance of the sequential algorithms asymptotically approaches that of the best choice that could only have been chosen in hindsight within a family of possible schemes.
1. Introduction
Level-crossing (LC) sampling has been proposed as an alternative to the traditional uniform
sampling method [1–10].
In this approach, signals are compared with a set of reference levels and
samples taken on the time axis, indicating the
times at which the analog signal exceeded each of the associated reference
levels. This threshold-based sampling is particularly suitable for processing bursty signals, which exist in a diverse range of settings from natural images to
biomedical responses to sensor network transmissions. Such signals share the
common characteristic that information is delivered in bursts, or temporally
sparse regions, rather than in a constant stream. Sampling by LC visibly mimics
the behavior of such input signals. When the input is bursty, LC samples also
arrive in bursts. When input is quiescent, fewer LC samples are collected. As
such, LC lets the signal dictate the rate of data collection and quantization:
more samples are taken when the signal is bursty, and fewer when otherwise. One
direct benefit of such sampling is that it allows for economical allocation of
resources. Higher instantaneous bandwidth/precision can be offered when
sampling is performed, and resolution is improved without overall increase in
bit rate or power consumption. It has been shown in [4, 6, 7] that by using LC sampling in communication systems, we
can reduce the data transmission rate. For certain types of input, it has also
been shown that LC performs advantageously in signal reconstructions, as well
as in parameter estimations.
The opportunistic nature of LC sampling is akin to
that of compressed sensing [11, 12], where by recognizing many signals in nature are
sparse—a term that describes signals whose actual support in some
representation or basis is much smaller than their aggregate length in the
basis with which the signal is described, more economical conversion between
the analog and the digital domain can be achieved. Recent work [11–15] has shown sparse signals
can be reconstructed exactly from a small number of random projections and
through a process employing convex optimization. While this framework of
reconstruction by random projection is theoretically intriguing, it behaves
poorly when measurements are noisy. It is shown in [16] that signal-to-noise ratio
(SNR) decreases successively as the number of projections increases, rendering
it a less-attractive solution in practical implementations. LC similarly
exploits the sparse (bursty) nature of signals by sampling, intuitively, where
information is located. Furthermore, it is structurally stable, and various
hardware designs have been offered [8–10]. It does not escape our attention that the advantages
exhibited by LC sampling in both data transmission and signal reconstruction
hinge on the proper placement of reference levels. Ideally, the levels are
located such that information can be optimally extracted. In the literature,
the levels have typically been treated no differently from uniform quantization
levels [4–10], where their optimal
allocation has received scant consideration, with the noted exception
quantization of data that has already been sampled in time. Hence, optimal placement
of reference levels is the focus of this paper.
In order to obtain samples efficiently, the levels
need to be appropriately assigned in the analog-to-digital converter (ADC).
When they are not within the amplitude range of the input, no LCs are
registered, hence information can be lost. On the other hand, when too many
levels are employed, more samples than necessary could be collected, rendering
the system inefficient. Naturally prior information, such as the source's a
priori distribution or signal model, can help to decide where the levels should
be placed. Based on statistics of the input, Lloyd-Max quantization method can
be employed to select a nonuniformly spaced level set to minimize the
quantization error. However, statistical information is often not available
and/or difficult to obtain. Furthermore, when an implementation relies on an
empirically obtained model, a mismatch between that and realistic scenarios has
to be taken into account. The more assumptions are made, the more
justifications are needed later. In this work, we start with just one
assumption: only the input dynamic range is known. Inspired by seminal work on
zero-delay lossy quantization [17, 18], we implement an adaptive scheme that sequentially
assigns levels in the ADC. This scheme yields performance comparable to that of
the best within a family of fixed schemes. In other words, we can do almost as
well as were the best fixed schemes known all along. Before delving into this
implementation, we will touch upon a conceptual design of the level-crossing
analog-to-digital converter (LC ADC).
The organization of the paper is as follows. In
Section 2, we provide an architecture for LC ADC and describe one possible
implementation of LC ADC. We then introduce sequential algorithms in Section 3, where we also provide complete algorithmic descriptions and corresponding guaranteed performance results. The paper then concludes with
a number of simulations of the algorithms described on biological signals collected using an LC ADC.
2. Implementation of Reference Levels
In this section, we present a conceptual architecture
for LC ADC and the setup for the placement of reference levels in the ADC.
Furthermore, we define the reconstruction error that will be minimized with a
sequential algorithm in Section 3.
2.1. A Conceptual Architecture for LC ADC
A range of
publications have investigated the hardware implementation of asynchronous LC
samplers [8–10]. In particular, the LC
asynchronous ADC presented in [10]
has a parallel structure that resembles a flash-type ADC. The current
implementation can sample signals upto
MHz in bandwidth with
bits hardware resolution, and its topology can
be trivially extended to a higher-precision ADC. The proposed architecture is
given in Figure 1, and it is the LC ADC we refer to throughout this paper.
Figure 1: A conceptual design
diagram of a

-bit flash-type LC ADC.
Let us consider a
-bit (
levels) flash-type ADC of this design. It is
equipped with an array of
analog comparators that compare the input with
corresponding reference levels. The reference levels are implemented with a
voltage divider. The comparators are designed to be noise resistant, so at a
reference level, fluctuation due to noise will not cause chattering in the
output. The power
consumption of such analog circuitry is dominated by the comparators. In order
to minimize power, at most
of the
comparators are on at any moment. This
can be accomplished by a digital circuit that regulates the power supply and
periodically updates the set of
comparators. The asynchronous digital
circuitry processes the output of the analog circuitry, recognizes the proper
times for each of the LCs, then outputs a sequence of bits.
The number of on comparators (
) and their respective amplitudes affect the
performance of the LC ADC. Ideally, they are optimized jointly. However, for
analytical tractability, we temporarily suppress the variability of
in our formulation. The distortion measure is
formulated as a function of the levels, and it is minimized within a family of
schemes.
2.2. The Reference Level Set 
Let us consider
an amplitude-bounded signal
that is
-second long. Without loss of generality, we
assume
is bounded between
,
and that the LC ADC has
levels uniformly spaced in the dynamic range
with spacing
.
Let
represents the set of reference levels used by
the comparators. The cardinality of
is
.
During LC sampling, let
comparators be turned on at any given
time. Together these
comparators form a level set, which is a
subset of
.
In our framework, this set is updated every
seconds, that is, at
,
,
a new set of levels is picked and this new set of levels is represented as
,
.
Let
denote the sequence of such level sets used up
to time
,
that is,
, where each
is a set of
levels.
The ADC compares the input
to the set of levels used every
seconds. Note that
.
The ADC records a level crossing with one of
if the following comparison holds for a
:
(1)Although the true crossing
occurs in the interval
,
only its quantized value
is recorded, that is,
.
The LC sample acquired by the ADC is
,
where
is the corresponding level crossed at
.
Since
is enunciated in
,
it is known with perfect precision. This is the key difference between
quantization of LC samples from that of uniform samples: uniform samples are
quantized in amplitude, LC samples are quantized in time. Furthermore, we also
provide an analysis of the bandwidth that can be handled by an LC ADC for
perfect reconstruction in Appendix A.
2.3. Reconstructed Signal and Its Error
Given a
sequence of reference levels
,
sampling input
with
produces a set of samples
.
The corresponding reconstructed signal at time
,
using a piecewise constant (PWC) approximation scheme, is given
by
(2)where
is a unit step function, that is,
when
and
,
otherwise. It is entirely possible that
produces an empty set if no crossings occur
between levels sets and
,
which means no information has been captured. As such, finding an appropriate
sequence of reference levels is essential. The reconstruction error over an
interval of
is given by
(3)From (2) and (3), it is clear
that the MSE
is a function of the chosen sequence of reference
levels
.
As such, it will be minimized with respect to
.
We also note that the quantization levels used in (2)
need not coincide with the decision levels such that we can use
(4)for reconstruction with a
generic
.
For example, we can select
,
depending on the direction of the crossing at time
.
Such a reconstruction scheme is consistent with the input, and it has been
shown to yield very good performance when the sample resolution is high
[13, 14]. Since signal
reconstruction is not the focus of this paper, we only provide the appropriate
references [13, 14] and continue with
(2).
3. Getting the Best Hindsight Performance Sequentially
In this
section, we introduce a sequential algorithm that is implemented to
asymptotically achieve the performance of the best constant scheme known in
hindsight. This sequential algorithm is a randomized algorithm. At fixed
intervals, the algorithm randomly selects a level set and uses it to sample the
input until the selected level set is replaced by the next selection. The level
set is randomly selected from a class of possible level sets according to a
probability mass function (PMF) generated by the cumulative performance of each
level set in this class on the input.
3.1. The Best Constant Scheme Known in Hindsight
Before we
present a sequential algorithm that searches for
,
we discuss the shortcomings of the constant (nonadaptive) scheme. When levels
are not updated, we pick a set
of
levels at
,
and use it for the entire sampling duration
.
The best constant reference level is one that minimizes the MSE among the class
of all possible
-level sets
.
It can be obtained by evaluating the following optimization problem:
(5)Evaluating (5), however,
requires a delay of
seconds. In other words, the best constant
level set
is only known in hindsight; it cannot be known
a priori at the start. Without statistical knowledge of the input, optimizing
performance while using a constant scheme is not feasible and a zero-delay and
sequential algorithm may be more appropriate.
3.2. An Analog Sequential Algorithm Using Exponential Weights
The
continuous-time sequential algorithm (CSA) uses the well-known exponential
weighting method [18]
to create a PMF, over the class of possible level sets at every update, from
which a new set is generated. Figure 2 illustrates this algorithm pictorially,
and the algorithm is given in Algorithm 1. In the algorithmic
description, each level set is represented by
.
Figure 2: A diagram to illustrate the sequentially updated algorithm. At each

,
accumulated errors

are used to generate weights

.
We note that in the implementation of Algorithm 1, the cumulative errors in (A1)
are computed recursively. Furthermore, the weights defined in (A2), in Algorithm 1, can be recursively computed
as well:
(6)As such, implementation of the
CSA only requires storage of
weights.
3.3. Asymptotic Convergence of the Sequential Algorithm
In this
section, we give an assessment of the performance of the CSA. For clarity, we
reiterate the setup here. Let
be a sequence of levels chosen by CSA up to
time
.
Let
be the reconstructed signal obtained by
sampling
with
,
and let the expected MSE be given by
.
We note that the expectation in here is with respect to the PMF generated by
the algorithm.
Theorem 1. For any bounded input
of length
,
, and fixed parameters
and
,
reconstruction of input using the continuous-time sequential algorithm has MSE
that satisfies
(7)where
is a parameter of the LC ADC,
.
Selecting
to minimize the regret terms,
one has
(8)As such, the normalized
performance of the universal algorithm is asymptotically as good as the
normalized performance of the best hindsight constant level set
.We see that the “regret” paid for not knowing
the best level set in hindsight vanishes as signal length
increases. The parameter
can be considered as the learning rate of the
algorithm, and at the optimal learning rate,
,
the regret is minimized. The regret is also a function of the amplitude range
and update period
.
Intuitively, the smaller the update period, the more often the updates, and the
smaller the regret. See Appendix B for the proof.
3.4. A Digital Approximation
In practical
implementations where selection of reference levels is performed by a digital
circuit, such as suggested by Figure 1, it is necessary to compute the
cumulative errors (A1) in Algorithm 1 in the digital domain. As such, the continuous-time
reconstruction error
formulated in the previous section needs to be
approximated digitally, that is, the continuous-time integration in (A1) in Algorithm 1 needs
to be replaced by discrete-time summation. One approach is to approximate the
reconstruction error
with regular sampling and piecewise constant
(or piecewise linear) interpolation. Furthermore, computation of the cumulative
errors requires knowing the actual
,
however, the original signal
is unknown (otherwise, we would not need a
converter). As such, the feasibility of this type of sequential algorithm
hinges on our ability to procure
in some fashion.
Assume that we periodically obtain quantized input to
compute approximate versions of the cumulative errors. This can be accomplished
in two ways.
(i)
Once every
seconds, all of the
comparators are turned on. The value of
is selected so that
,
is the sampling period of the comparators and
is the interval between updates. Once a level
is crossed by the input signal, the comparator associated with that level
changes its output, then its corresponding digital trigger identifies the
change and sends the information to the digital
circuitry that controls the comparator's power supply. This method is shown in
Figure 3(a), and it can periodically (every
seconds) provide a quantized input
,
. In our LC ADC,
comparators are on at any moment. By
requesting all comparators be turned on every
seconds, we in effect power up
extra comparators every
seconds. Since the extra comparators are only
turned on for a small fraction of time, they likewise only consume a small
fraction of the overall power.
(ii)
A separate low-rate
-bit ADC keeps track of the input every
seconds,
.
This method is shown in Figure 3(b), and the low-rate (and low-power) ADC has a
sampling frequency much lower than that of the comparators, with the goal of
providing the digital circuitry, that performs the DSA, an approximated input
every
seconds,
.
Here the
-bit ADC should have
to efficiently represent the underlying
signal. The advantage of this method is that quantized input can have arbitrary
resolution, as long as it is affordable. The disadvantage is that a separate
circuit element is designated to procure input approximations, and it needs to
be synchronized with rest of the circuitry.
Figure 3: Two methods of tracking input to
implement DSA. (a) All comparators are turned on once every

seconds, and the approximated input

is send to the digital circuit to evaluate
DSA. (b) A low-rate ADC keeps track of input

every

seconds.
By employing either method, the approximated
cumulative error
can be evaluated as follows:
(9)
Other schemes such as nonuniform sampling in
conjunction with splines or cubic polynomial interpolation can be used as well,
depending on the underlying statistics and bandwidth of the signal
.
The
th order Riemann sum approximation in (9),
though conservative, serves well in the absence of such information. We
introduce the discrete-time sequential algorithm in Algorithm 2.
The approximation error redistributes the PMF
,
and as a result, a different sequence of levels could be selected for sampling.
Here, we quantify the deviation and show that the effect of approximation
becomes negligible as signal length increases. In other words, the regret terms
in Theorem 1 remain unchanged even when the cumulative errors are approximated.
Let
be a sequence of levels chosen by the discrete-time
algorithm. Let
be the reconstructed signal obtained by
sampling
with
,
and let the expected MSE be given by
.
Furthermore, let
represent the difference between the
continuous-time and discrete-time cumulative errors,
,
then
.
Theorem 2. For
any bounded input
of length
,
,
and fixed parameters
and
,
reconstruction of input using the discrete-time sequential algorithm (DSA)
incurs MSE that is bounded by
(10)where
is a parameter of the LC ADC,
.
Selecting
to minimize the regret terms,
one has
(11)See Appendix C for the proof. The parameter
measures the distortion due to approximation.
A meaningful bound on this distortion requires knowing the characteristics of
,
for example, some measure of its bandwidth or its rate of innovation, as well
as how the MSE is approximated. For example, let us consider a length-
piecewise constant signal with
degrees of freedom:
(12)Such signal has a rate of
innovation
[19]. When the error metric is approximated using
(B1) in Algorithm 2, a
bound can be obtained,
.
For temporally sparse (bursty) signals, where
is comparatively small compared to the signal
length
,
the effect of approximation diminishes as
gets large.
3.5. Comparison between CSA and DSA
Both CSA and
DSA provide the same sequential method by which the levels in an LC ADC can be
updated, with one noted difference: the CSA uses analog input in its
computation of update weights, and the DSA uses signal already converted into
digital form. Although hardware implementation of the analog algorithm requires
extra complexity, the algorithm itself provides the analytical benchmark in
assessing the performance of the digital algorithm that is more practical.
Thereby, both are presented in this paper. Next, the deviation between CSA and
DSA is quantified. The difference between their respective normalized MSEs can
be expressed by
(13)Corollary 1. For
any bounded input
,
and fixed parameter
,
the deviation of the digital algorithm DSA from the analog algorithm CSA is
bounded,
(14)where
.We can see that as the
difference between the true cumulative error and its approximation diminishes,
the deviation between the two algorithms goes to zero as expected. Similar to
the discussion about
in Theorem 2, a meaningful bound on
requires knowing some characteristics of
.
For proof, see Appendix D.
4. Simulation Results
In this
section, we test the sequential algorithms introduced in Section 3 on a set of
surface electromyography (sEMG) signals. For these simulations, two
observations are made: first, the sequential algorithm works as well as the the
best constant algorithm known in hindsight; second, LC uses far less samples
than uniform sampling for the same level of performance measured by MSE. We
point out that the simulation results presented here are algorithmic simulations performed on MATLAB, rather than a simulation of hardware
performance. Since sEMG signals used in the simulations have bandwidth of no
more than
Hz, the necessary sampling bandwidth to obtain
good-quality samples is relatively low as well.
4.1. The Input sEMG Signals
The set of sEMG
signals used in this simulation is collected through encapsulated conductive
gel pads over an individual's vocal cord, to allow an individual to communicate
through the conductive properties of the skin. This is particularly useful to
severely disabled people, such as quadriplegics, who cannot communicate
verbally nor physically, by allowing them to express their thoughts through a
medium that is neither invasive nor requiring physical movements. Signals that
are collected from the vocal cord are then transmitted through a wireless device
to a data-processing unit to be converted either into synthesized speech or a
menu selection to control objects such as a wheelchair. For more information
see [20].
We observed a set of electromyography (EMG) signals,
where each is an utterance of a word, for example, “one,” “two,”
“three.” A sample signal is given in Figure 4, which is about 12 seconds
long and utters three words. The given signal has already been processed by an
ADC, that is, it is uniformly sampled (at above Nyquist rate) and converted
into digital format. Such signals have low bandwidth, ranging from 20–200 Hz. A sampling rate of
samples per second is used,
Hz, and samples are quantized with a
-bit quantizer. Since the sEMG measures the
voltage difference between recording electrodes, the signal amplitude has unit
of volts (V). The range of the test signals is known to be confined to
V. As such, each sequence of data is bounded
between
numerically.
Figure 4: A

-second sample input signal, where each burst is an
utterance of a word, that is, “one,” “two,” “three,” and so
forth.
4.2. DSA Versus the Best Constant Bilevel Set
We emulate a
-bit flash-type LC ADC, like the one shown in
Figure 1. Test signals are LC sampled using two levels at a time (
), chosen from a larger set
of
levels:
(15)In other words, only
comparators are turned on at any moment. The
levels are updated every
samples according to DSA, or approximately every
milliseconds. A piecewise-constant reconstruction scheme
is employed, and the normalized MSE (measured in
) for the entire signal duration is computed.
The signal duration is also taken from
to
samples, at increments of
samples. The result of DSA is compared to the
MSE using the best hindsight bilevel. We see in Figure 5 that as the length of
input gets larger, the sequential algorithm learns about the input along the
way, and its performance closely follows that of the best constant scheme, as
predicted by (10).
Figure 5: The performance of the discrete-time sequential algorithm
described in Section
2. The performance is measured by normalized
MSE and compared to the performance using the best constant level
set known in hindsight.
Furthermore, we see in the Figure 6 that the number of
LC samples varies with input. Starting around the
th sample, and ending at around
th sample, LC ADC does not pick up many
samples. This can be explained when we look at the sample signal in Figure 4.
The utterance occurs before the
th sample, after that the speaker paused till
about the
th sample, with only ambient noise in between.
The LC's adaptive nature prevents it from registering many more samples during
quiescent interval where there is no information, and
enhances its efficiency. On the other hand,
conventional sampling obtains samples at regular intervals, regardless of
occurrences in the input. This result reiterates our intuition: by sampling
strategically, LC is more efficient than uniform sampling for bursty signals.
Figure 6: The number of LC samples obtained using DSA.
4.3. LC Versus Nyquist-Rate Sampling
In Figures 7, 8, we illustrate a case when LC is advantageous. We emphasize again that LC is
proposed as an alternative to the conventional (Nyquist rate) method, in order
to more efficiently sample bursty (temporally sparse) signals that are
encountered in a variety of settings. Such signals share the common
characteristic that information is delivered in bursts rather in a constant
stream, that is, the sEMG signals used in this simulation.
Figure 7: The performance of LC sampling compared to that of uniform
sampling. The red straight line indicates MSE of using a

-bit LC ADC; the green dashed line
represents the MSE of using a

-bit (Nyquist-rate) ADC; the blue dot-dash line is that
of using a

-bit
(Nyquist-rate) ADC.
Figure 8: The number of LC samples used to obtain the
performance in Figure
7.
A
-bit flash-type LC ADC with a comparator
bandwidth of
kHz is compared to a 4-bit and a 3-bit
conventional ADC with the same sampling frequency of
kHz. In order to keep the comparison fair, all
comparators in the LC ADC are turned on (no adaptive algorithms are used). The
result in Figure 7 indicates that the
-bit LC ADC has performance slightly worse
than that of the
-bit ADC, but a lot better than that of the
-bit ADC. However, we see in Figure 8 that LC
sampling uses far less number of samples to obtain reconstruction with
comparable performance. In fact, it consistently uses only 1/10 of samples! When we sample to find the best
reconstruction of the original, conventional uniform sampling is ideal.
However, when the goal is to find a good reconstruction as efficiently as
possible, that is, using as little samples as possible, LC is often
advantageous.
5. Summary
In this paper, we addressed the essential issue of level placement in an LC ADC, and showed
the feasibility of a sequential and adaptive implementation. Instead of relying
on a set of fixed reference levels, we sequentially update the level set in a
variety of ways. Our methods share the common goal of letting the input dictate
where and when to sample. Through performance analysis, we have shown that as
signal grows in length, the sequential algorithms asymptotically approach that
of the best choice within a family of possibilities.
Algorithm 1: Continuous-time sequential algorithm (CSA).
Algorithm 2: Discrete-time sequential algorithm (DSA).
Appendicies
A. Useful Bandwidth for the LC ADC
In the LC ADC, the two design parameters
and
represent the resolution in amplitude and in
time, respectively. Without loss of generality, we assume that input is a class
of smooth signals with finite slew rate. In order to account for all the LCs of
with
,
the ADC's resolution needs to be fine enough that only one LC
occurs per interval of
.
In order to ensure that, this condition is met, the
two parameters
and
have to be chosen carefully. A sufficient (but
not necessary) relationship between the slew rate (slope) of the input and the
resolution of the ADC is given by
.
By Bernstein's theorem, any signal that is both band-limited to
and amplitude-bounded to
also has bounded slope
.
If a
-bit uniform level set is used to quantize the
amplitude, and
,
then we can guarantee one LC sample per interval of
if
(A.1)When this condition is met, the
sequence of LC samples of
denotes amplitude changes in the sequence of
uniform samples of
,
hence it can be mapped to an equivalent sequence of uniform samples
accordingly. Perfect reconstruction ensues.
B. Proof for Theorem 1
Proof.
Step 1.
Given a
level set
,
we define a function of the reconstruction error at time
as
(B.1)where
.
The function
measures the performance of a particular
on the signal
up to time
.
We next define a weighted sum of
,
:
(B.2)Since
.
It follows that
(B.3)for any
.
Hence, it remains to show that the exponentiated reconstruction error of the CS
algorithm is smaller than
.
Step 2.
Since CS randomly chooses a level set at
integer multiples of
,
we will investigate its performance with respect to
,
where
and
, then extend this result to
.
By definition,
,
hence its natural log is expressed by
(B.4)For each term in (B.4), we
observe that
(B.5)where
, the last line is the
expectation with respect to the probabilities used in randomization in (A3) in Algorithm 1.
Furthermore, Hoeffding's inequality [21] states that
for bounded random variables
such that
and
.
Using this identity in the last line of (B.5) produces
(B.6)where
is the maximum reconstruction error for any
level set in any segment of length
,
and it is bounded by
(B.7)for
,
and
.
Plugging this into (B.6) yields
(B.8)Applying (B.8) in (B.4)
yields
(B.9)By combining (B.9) with (B.3) at
,
we have
(B.10)
Step 3.
In the tail interval
,
the difference between input and reconstruction can only be less than
,
hence
(B.11)Selecting
to minimize the regret terms
yields
(B.12)
C. Proof of Theorem 2
Proof.
The proof of Theorem 2 follows that
of Theorem 1. The
can be similarly defined as the exponentiated
function of
,
and the same derivation can be applied henceforth. We observe that while
proving Theorem 1, the definition of
is only used in (B.7) for the calculation of
,
hence the regret term
does not change. Furthermore, the quantity of
shares the same upper bound as
in (B.7), hence the second and the third regret
terms
remain the same as well. Putting it all
together,
(C.1)and (10) follows.
D. Proof of Corollary 1
Proof.
The difference between the
respective MSEs of CSA and DSA can be expressed by
(D.1)We proceed to bound this
difference,
(D.2)An expression for the difference
between
and
can be found by using the mean value theorem,
(D.3)After the derivative is
evaluated and with the fact that
,
we have the following result:
(D.4)
Corollary
1 (14) follows.
References
- H. J. Landau, “Necessary density conditions for sampling and interpolation of certain entire functions,” Acta Mathematica, vol. 117, no. 1, pp. 37–52, 1967.
- I. F. Blake and W. C. Lindsey, “Level-crossing problems for random processes,” IEEE Transactions on Information Theory, vol. 19, no. 3, pp. 295–315, 1973.
- A. Zakhor and A. V. Oppenheim, “Reconstruction of two-dimensional signals from level crossings,” Proceedings of the IEEE, vol. 78, no. 1, pp. 31–55, 1990.
- J. Mark and T. Todd, “A nonuniform sampling approach to data compression,” IEEE Transactions on Communications Systems, vol. 29, no. 1, pp. 24–32, 1981.
- M. Miskowicz, “Efficiency of level-crossing sampling for bandlimited Gaussian random processes,” in Proceedings of the IEEE International Workshop on Factory Communication Systems (WFCS '06), pp. 137–142, Torino, Italy, June 2006.
- K. Guan and A. C. Singer, “A level-crossing sampling scheme for non-bandlimited signals,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '06), vol. 3, pp. 381–383, Toulouse, France, May 2006.
- K. M. Guan and A. C. Singer, “Opportunistic sampling by level-crossing—an information-theoretic approach,” in Proceedings of the 41st Conference on Information, Science, and Systems (CISS '07), Baltimore, Md, USA, March 2007.
- Y. Tsividis, “Digital signal processing in continuous time: a possibility for avoiding aliasing and reducing quantization error,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '04), vol. 2, pp. 589–592, Montreal, Canada, May 2004.
- F. Aeschlimann, E. Allier, L. Fesquet, and M. Renaudin, “Asynchronous FIR filters: towards a new digital processing chain,” in Proceedings of the 10th IEEE International Symposium on Asynchronous Circuits and Systems (ASYNC '04), pp. 198–206, Crete, Greece, April 2004.
- F. Akopyan, R. Manohar, and A. B. Apsel, “A level-crossing flash asynchronous analog-to-digital converter,” in Proceedings of the 12th IEEE International Symposium on Asynchronous Circuits and Systems (ASYNC '06), pp. 12–22, Grenoble, France, March 2006.
- E. J. Candes, “Compressive sampling,” in Proceedings of the IEEE International Congress of Mathematicians, Madrid, Spain, August 2006.
- D. L. Donoho, “Compressed sensing,” IEEE Transactions on Information Theory, vol. 52, no. 4, pp. 1289–1306, 2006.
- Y. C. Eldar, “Sampling with arbitrary sampling and reconstruction spaces and oblique dual frame vectors,” Journal of Fourier Analysis and Applications, vol. 9, no. 1, pp. 77–96, 2003.
- K. Guan, Opportunistic sampling by level-crossing, Ph.D. thesis, University of Illinois at Urbana-Champaign, Urban, Ill, USA, 2008.
- Y. Lu and M. N. Do, “A geometrical approach to sampling signals with finite rate of innovation,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '04), vol. 2, pp. 565–568, Montreal, Canada, May 2004.
- Y. Weiss, “Learning compressed sensing,” in Proceedings of the 45th Annual Allerton Conference on Communication, Control, and Computing, Allerton, Ill, USA, September 2007.
- T. Linder and G. Lugosi, “A zero-delay sequential quantizer for individual sequences,” in Proceedings of the IEEE International Symposium on Information Theory (ISIT '00), p. 125, Sorrento, Italy, June 2000.
- A. György, T. Linder, and G. Lugosi, “Efficient adaptive algorithms and minimax bounds for zero-delay lossy source coding,” IEEE Transactions on Signal Processing, vol. 52, no. 8, pp. 2337–2347, 2004.
- M. Vetterli, P. Marziliano, and T. Blu, “Sampling signals with finite rate of innovation,” IEEE Transactions on Signal Processing, vol. 50, no. 6, pp. 1417–1428, 2002.
- http://www.theaudeo.com/.
- W. Hoeffding, “Probability inequalities for sums of bounded random variables,” Journal of the American Statistical Association, vol. 58, no. 301, pp. 13–30, 1963.