Department of Electrical and Computer Engineering, University of California, San Diego, La Jolla, CA 92093-0407, USA
Abstract
Transformed codebooks are obtained by a transformation of a given codebook to best match the
statistical environment at hand. The procedure, though suboptimal, has recently been suggested for
feedback of channel state information (CSI) in multiple antenna systems with correlated channels because
of their simplicity and effectiveness. In this paper, we first consider the general distortion analysis of
vector quantizers with transformed codebooks. Bounds on the average system distortion of this class of
quantizers are provided. It exposes the effects of two kinds of suboptimality introduced by the transformed
codebook, namely, the loss caused by suboptimal point density and the loss caused by mismatched
Voronoi shape. We then focus our attention on the application of the proposed general framework to
providing capacity analysis of a feedback-based MISO system over spatially correlated fading channels.
In particular, with capacity loss as an objective function, upper and lower bounds on the average distortion
of MISO systems with transformed codebooks are provided and compared to that of the optimal channel
quantizers. The expressions are examined to provide interesting insights in the high and low SNR regime.
Numerical and simulation results are presented which confirm the tightness of the distortion bounds.
1. Introduction
This paper considers multiple antenna systems when
partial channel state information (CSI) is available at the
transmitter from the receiver through a finite-rate feedback link. Recently,
several interesting papers have appeared, proposing design algorithms, as well
as analytically quantifying the performance of finite-rate feedback multiple
antenna systems [1–18]. We briefly discuss some of them below to provide
context to this work.
Mukkavilli et al. approximated in [1] the channel quantization
region corresponding to each code point based on the channel geometric property
and derived a universal lower bound on the outage probability of quantized MISO
beamforming systems with an arbitrary number of transmit antennas
over i.i.d. Rayleigh fading channels. Love and
Heath [2, 3] related the
problem to that of Grassmannian line packing [4]. Results on the density of
Grassmannian line packings were derived and used to develop bounds on the
codebook size given a capacity or SNR loss. Xia et al. [5, 6], Zhou et al. [7], and Roh and Rao [8] approximated the
statistical distribution of the key random variable that characterizes the
system performance. The distribution was used to analyze the performance of
MISO systems with limited-rate feedback in the case of i.i.d. Rayleigh fading
channels, and closed-form expressions of the capacity loss (or SNR loss) in
terms of the feedback rate
,
and the number of antennas
were obtained. Moreover, Roh and Rao extended
in [10, 11] the results from MISO
channels to the case of MIMO systems with quantized feedback. Narula et al. [12] related the
quantization problem to rate distortion theory, and obtained an approximation
to the expected loss of the received SNR due to finite-rate quantization of the
beamforming vectors in an MISO system with a large number of antennas
.
Furthermore, design and analysis of finite-rate feedback based multiple antenna
systems have also been extended to multiuser areas in [17, 18], where efficient multiuser
CSI feedback schemes were proposed and interesting observations of feedback
requirement for MIMO broadcast channels were reported.
Despite all these recent results, the analysis of
finite-rate feedback systems has proven to be difficult. All the aforementioned
approaches are case specific, limited to i.i.d. channels, mainly MISO channels,
and are hard to extend to more complicated schemes. Recently, in our work
[19], a general
framework for the analysis of quantized feedback multiple antenna systems was
developed using a source coding perspective by leveraging the considerable work
that exists in this area, particularly high resolution quantization theory.
Specifically, the channel quantization was formulated as a general finite-rate
vector quantization problem with attributes tailored to meet the general issues
that arise in feedback based communication systems, including encoder side
information, source vectors with constrained parameterizations, and general
non-mean-squared distortion functions. By utilizing the proposed general
framework, performance analysis of a finite-rate feedback MISO beamforming
system transmitting over spatially correlated Rayleigh flat fading channels was
provided in [20].
The general framework developed in [19] is versatile and has the
potential for being adapted to deal with a variety of problems. This
methodology, with suitable modifications, is used in this paper to enable the
distortion analysis of a wide class of vector quantizers with transformed
codebooks. Transformed codebooks are often used for simplicity and are
obtained by a transformation of a given codebook to best match the statistical
environment at hand. The procedure, though suboptimal, has recently been
suggested for CSI feedback-based multiple antenna systems because of their
simplicity and effectiveness. Love and Heath [13] and Xia and Giannakis [6] proposed a beamforming
codebook design algorithm for correlated MIMO fading channels using a
rotation-based transformation on the codebooks of the beamforming vectors
originally designed for i.i.d. fading channels. The rotation is derived from
the channel correlation matrix. However, to the authors' knowledge, limited
analytical results are available characterizing the performance of transformed
channel quantizers for multiple antenna systems with finite-rate feedback.
In this paper, we focus our attention on investigating
the effects of codebook transformation on the performance of multiple antenna
systems with finite-rate CSI feedback. The contributions of this paper are
twofold. We first provide insight into the general problem of analyzing a
vector quantizer with transformed codebook. Bounds on the average system
distortion of this class of quantizers are provided. It exposes the effects of
two kinds of suboptimality introduced by the transformed codebook on system
performance. They are the loss caused by the suboptimal point density and the
loss due to the mismatched Voronoi shape. We then focus our attention on the
application of the proposed general framework to providing capacity analysis of
a feedback-based MISO system with spatially correlated fading channels using
channel quantizers with transformed codebooks. In particular, using system
capacity as the objective function, upper and lower bounds on the average
distortion of MISO systems with transformed codebooks are provided and compared
to that of the optimal channel quantizers. It is shown that the average
distortion of CSI quantizers with transformed codebooks can be upper and lower
bounded by a scaling of the distortion of optimal quantizers. Furthermore,
based on numerical and simulation results, the scaling factors are shown to be
close to one for fading channels whose channel covariance matrix has small to
moderate condition numbers. Preliminary version of these results have appeared
in [21]. This paper
provides more detailed (and complete) derivations along with discussions that
could not be included in [21] due to space limitation.
2. Background Information on the Generalized Vector Quantizer
Multiple antenna systems with finite-rate CSI feedback
were formulated as a generalized fixed-rate vector quantization problem in
[19] and analyzed by
adapting tools from high resolution quantization theory. In order to facilitate
the understanding, we briefly summarize in this section some important results
of the distortion analysis of the generalized vector quantizer (for readers
that are familiar with the general distortion analysis provided in [19], the current section can be
skipped without loss of continuity of the article). Extension of the distortion
analysis to quantizers with a transformed codebook and its application to
CSI-quantized MISO systems are provided in Section 3 and Section 5,
respectively.
2.1. General Vector Quantization Framework
It is assumed that the source variable
is a two-vector tuple denoted as
,
where vector
represents the actual variable to be quantized
(quantization objective) of dimension
,
and
is the additional side information of
dimension
.
The side information
is available at the encoder (receiver) but not
at the decoder (transmitter). Quantization objective
and side information
have joint probability density function given
by
,
and a fixed-rate (
bits per channel update) quantizer with
quantization levels is considered. Based on a
particular source realization
,
the encoder (or the quantizer) represents vector
by one of the
vectors
,
which form the codebook. The encoding or the quantization process is denoted as
.
The distortion of a finite-rate quantizer is defined as
,
where
is a general distortion function between
and
that is parameterized by
,
not necessarily the mean square error. It is further assumed that the
distortion function
has a continuous second-order derivative (or
Hessian matrix with respect to
)
with the
th and
th elements given by
(1)
2.2. Asymptotic Distortion Integral of the General Vector Quantizer
Under high-resolution assumptions (large
), the distortion of a finite-rate feedback
system has been shown to have the following form:
(2)where
denotes the asymptotic (as
approaches infinity) projected Voronoi cell
that contains
with side information
and captures the shape attribute of the
quantization cell. In (2),
is the point density function representing the
relative density of the codepoints such that
is approximately the fraction of quantization
points in a small neighborhood of
.
The function
is the normalized inertial profile that
represents the asymptotic normalized distortion, or the relative distortion, of
the quantizer
at position
conditioned on side information
with Voronoi shape
It is given by
(3)The point density function
and the normalized inertial profile
are the key characteristics that can be used
to describe the behavior of a specific quantizer. Alternately, given a vector
quantizer, one has to find these two functions, as indicated in [19], and the average system
distortion can then be obtained using (2).
2.3. Minimization of the Distortion Integral
The distortion integral given by (2) allows
the minimization of the overall distortion by optimizing the choice of the
Voronoi shape
and the point density function
.
First, the normalized inertial profile of an optimal quantizer can be defined
as the minimum inertia of all admissible Voronoi regions (or shapes)
,
that is,
(4)where
represents the set of all admissible
tessellating polytopes that can tile the space
.
It is known that finding the optimal Voronoi region, as well as characterizing
the exact optimal inertial profile, is hard. However, the inertial profile of
any Voronoi shape, including the optimal inertial profile, can be tightly lower
bounded by that of an “M-shaped” hyperellipsoid with the closed form
expression given by
(5)
Second, by substituting the inertial profile lower
bound (5) into the system distortion integral, as well as utilizing Holder's
inequality to select the optimal point density, the asymptotic distortion of
the generalized finite-rate quantization system can be lower bounded by
,
given by
(6)where
is the average optimal inertial profile
defined as
(7)The optimal point density that
minimizes the asymptotic system distortion is given by
(8)
2.4. Distortion Analysis of Constrained Source
The analysis discussed above is for the case where the
input source
is a free random vector of dimension
.
In some situations, it is required to quantize the
-dimensional source vector
subject to a multidimensional constraint
function
of size
,
for example, the scalar function
represents the unit norm constraint. In this
case, the distortion analysis discussed above has been shown to still be valid
with the following modification. First, the degrees of freedom in
are reduced from
to
.
Second, the sensitivity matrix is replaced by its constrained version
,
given by
(9)where
is an orthonormal matrix with its columns
constituting an orthonormal basis for the null space
.
Lastly, the multidimensional integrations used in evaluating the average
distortions are over the constrained space
.
3. Asymptotic Distortion Analysis of quantizers with Transformed Codebook
In certain situations, the underlying source
distribution
or the distortion function
of the source variable varies during the
quantization process. It is practically infeasible to design separate codebooks
optimized for every different source distribution and distortion function, or
the encoder and the decoder may not have the ability to store a large number of
codebooks. In these situations, it is convenient to use a quantizer whose
codebook is constructed by a transformation of a fixed codebook based on the
current statistical distribution of the source variable. These types of quantizers
are generally called transformed quantizers [22, 23], and have been used in the conventional source coding
area with a linear orthogonal transformation followed by a product quantizer.
We provide in this subsection an analysis of the generalized vector quantizer,
which is described in Section 2, when a transformed codebook is used. Detailed
applications to finite-rate feedback MISO systems with a transformed codebook
over spatially correlated fading channels are provided in Section 5.
3.1. Problem Formulation
It is first assumed that all the codebooks are
generated from one fixed codebook
,
which is designed to match the source distribution
,
and distortion function
with sensitivity matrix
.
Codebook
has a point density given by
,
and a normalized inertial profile
that is optimized to match the distortion
function
,
with
representing the asymptotic Voronoi cell that
contains
with side information
.
Let the source distribution change from
to
,
and let the distortion function become
instead of
with sensitivity matrix
instead of
.
The encoder and decoder are assumed to adapt a transformed codebook
obtained from
by using a general one-to-one mapping
with both its domain and codomain in space
,
that is,
(10)
3.2. Suboptimal Point Density and suboptimal Voronoi Shape
Assuming the codebook transformation function
has a continuous first order derivative, two
types of suboptimality arise when the transformed quantizer is used. One comes
from the suboptimal point density
,
which can be derived from
as
(11)If the source variable is
subject to
constraints given by vector equation
,
the transformed point density is given by
(12)where
is an orthonormal matrix whose columns
constitute an orthonormal basis for the null space
.
Compared to the optimal point density
given by (8), which corresponds to the
optimally designed codebook,
given by (11) is always suboptimal and hence
leads to performance degradation. The other suboptimality arises from the
constraints on the code points in the transformed codebook
in the sense that the Voronoi shape of the
transformed code is not matched to the distortion function
,
and hence is not optimized to minimize the inertial profile. Note that these
two suboptimalities, named as point density loss and cell shape loss, were also
discussed in [22] in
the setting of the conventional product quantizers and further applied to study
the distortion performance of conventional quantizers with transformed
codebooks.
3.3. Characterizing the Inertial Profile of the Transformed Codebook
Unfortunately, the Voronoi region
of the transformed codebook, which is defined
to be
(13)is hard to characterize and
depends on both the transformation
as well as the distortion function
.
In order to characterize the effects of the transformed Voronoi shape on the
system distortion, lower and upper bounds of the normalized inertial profile of
the transformed code are provided. First, let us consider a suboptimal
quantizer
with transformed codebook
that uses a suboptimal encoding process given
by
(14)where
is the optimal encoder that is matched to the
distortion function
.
This suboptimal encoder can be viewed as an extension of the “companding”
model introduced by Bennett [24] to the general vector quantization problem. It was
originally used in conventional scalar quantizers, where the encoder is a
combination of a monotonically increasing nonlinear mapping
,
the compressor, followed by a uniform quantizer; and the corresponding decoder
is composed of a uniform decoder followed by an inverse mapping
,
the expander. In the case of the generalized vector quantizer discussed here,
the Voronoi shape of the suboptimal transformed encoder
can be analytically characterized
as
(15)where
is the optimal Voronoi shape of the original
codebook
corresponding to distortion function
.
Due to the suboptimality of encoder
,
the normalized inertial profile of the transformed Voronoi shape
is upper bounded by the inertial profile of
given by (15), but lower bounded by the
inertial profile of the optimal Voronoi shape
corresponding to the distortion function
.
Proposition 1.
Under high resolution assumptions, the approximated
inertial profile
of a quantizer with transformed codebook can
be upper and lower bounded by the following form:
(16)
Furthermore, if the source
variable is subject to
constraints given by the vector equation
,
the constrained inertial profile
can be similarly bounded by
(17)
where
is an orthonormal matrix with its columns
constituting an orthonormal basis for the null space
.
Proof.
Due to the constraints on the code
points in the transformed codebook
,
which cannot be optimized to minimize the normalized inertial profile, it is
evident that the transformed inertial profile
is lower bounded by the optimal inertial
profile
given by (5). Hence, inequality
in (16) can be obtained after some
manipulations. The same reasonings are valid for inequality
in (17) for the constrained source.
As for inequality
in (16), since function
is first order continuous, any points in the
vicinity of the transformed code point
has a first-order Taylor series expansion
given by
(18)Moreover, due to the fact that
is a one-to-one mapping, for any point
in the vicinity of
,
there exists a unique point
in the neighborhood of
such that
.
Therefore, under high resolutions, the distortion function
can be expanded around point
as follows:
(19)which has quadratic form but
with transformed sensitivity matrix. By substituting (19), as well as the
Voronoi shape of the suboptimal encoder given by (15), into the definition of
the inertial profile given by (3), we can obtain the following normalized
inertial profile of the transformed code with suboptimal
encoder:
(20)which corresponds to inequality
in (16).
If the source variable (vector)
is further subject to
constraints given by the vector equation
,
the distortion function
can be similarly expanded around point
as
(21)where
is the projected error vector with respect to
point
given by
(22)By substituting (21) and the
suboptimal Voronoi shape (15) into the inertial profile definition (3), we can
obtain the suboptimal inertial profile of the transformed code with constrained
source
(23)which corresponds to inequality
in (17).
3.4. Distortion Integral of the Transformed Codebook
By substituting the transformed point density (11) and
the bounds of the transformed inertial profile given by (16) into the
distortion integration (2), we can upper and lower bound the asymptotic system
distortion of a transformed quantizer by the following form:
(24)Similarly, by substituting (12)
and (17) into (2), the asymptotic distortion of a constrained quantizer with
transformed codebook is bounded by
(25)
Similar to conventional product transformed quantizers
[22], there exist
trade-offs between the two suboptimalities: point density loss and Voronoi
shape loss. To be specific, it is always possible to find a transformation
such that the transformed point density
matches exactly the optimal point density
.
However, by doing so, the transformation might cause shape loss of the
transformed Voronoi cells in some cases, which will lead to significant
increase in the normalized inertial profile. Therefore, a transformation that
optimally balances two types of losses should be employed. This tradeoff is
directly reflected in the distortion bound
where both
and
in (24) depend on the transformation
.
So is the distortion bound
given by (25).
4. MISO Systems Using Finite-Rate Csiquantizers with Transformed Codebook
4.1. System Model of MISO Fading Channels
We consider a
MISO system, with
transmit antennas and one receive antenna,
signaling through a frequency flat fading channel. The channel model can be
represented as
(26)where
is the received signal (scalar),
is the additive complex Gaussian noise with
zero mean and unit variance, and
is the correlated MISO channel response with
distribution given by
.
For the sake of fair
comparisons, we normalize the channel covariance matrix such that the mean of
the eigen values equals one (equal to the i.i.d. channel case
). Moreover, the statistical information
(i.e., channel covariance matrix
) of the MISO channel response is assumed to
be perfectly known at both the transmitter and the receiver. The transmitted
signal vector
is normalized to have a power constraint given
by
,
with
representing the average signal-to-noise ratio
at each receive antenna.
4.2. Beamforming with Finite-Rate CSI Feedback
In this paper, the channel state information
is assumed to be perfectly known at the
receiver but only partially available at the transmitter through a finite-rate
feedback link of
bits per channel update between the
transmitter and receiver. To be specific, a quantization codebook
,
which is composed of unit-norm transmit beamforming vectors, is assumed known
to both the receiver and the transmitter. Based on the channel realization
,
the receiver selects the best code point
from the codebook and sends the corresponding
index back to the transmitter. At the transmitter, the unit-norm vector
is employed as the beamforming vector, and the
resulting received signal can be represented as
(27)where
is the channel direction vector given by
.
4.3. Problem of Channel Quantizers with Transformed Codebook
According to [8], it is clear that the statistical information of the
fading channel is very important for the design of MISO transmit precoders. The
resulting optimal beamforming codebook obtained by utilizing a vector
quantization (VQ) approach depends on the channel covariance matrix. In
practical situations, the spatial correlation conditions of the fading channel
responses may change during the transmission process. However, for a real
system, it is impossible to design different codebooks optimized for every
instantiation of the channel covariance matrix and it might also be infeasible
for the transmitter and receiver to store a large number of codebooks and use
them adaptively. In these cases, it is convenient to use a channel quantizer
whose codebook is generated from a fixed pre-designed codebook through a
transformation parameterized by the channel covariance matrix. (Imperfect
knowledge of the channel covariance matrix will also impact the system
performance. Interested readers are referred to [20, Sections IV-C and V-B], where a detailed
analysis of MISO beamforming systems employing channel quantizers designed with
mismatched channel covariance matrix is provided.)
To be specific, suppose
is the optimal codebook designed for the
i.i.d. MISO fading channels. When the elements of the fading channel response
are correlated, that is,
,
it is evident that codebook
is no longer optimal. In order to compensate
for the mismatch between
and the current channel statistics, a
transformed codebook
can be generated by the following
manner:
(28)where
is a general nonlinear transformation that
depends on the channel statistics. Optimization of the transformation
turns out to be difficult, and hence a simple
suboptimal transformation,
(29)was proposed in [6, 13] where
is a fixed matrix which depends on the channel
covariance matrix
.
Distortion analysis of CSI-quantizers with transformed codebooks is provided in
next section.
In order to facilitate understanding, a top level
diagram of a MISO beamforming system with finite rate CSI feedback is shown in
Figure 1. The exchange of the CSI information between the transmitter and
receiver is demonstrated. Major modules of the channel quantization process are
also depicted.
Figure 1:
System diagram of a MISO beamforming system with limited CSI feedback.
4.4. Capacity Loss as System Performance Metric
According to the received signal model given by (27),
the corresponding ergodic capacity, or the maximum system mutual information
rate, of the quantized MISO beamforming system is given by
(30)On the other hand, with perfect
channel state information available at the transmitter, which corresponds to the
case of infinite rate feedback
,
it is optimal to choose
as the transmit beamforming vector, and the
corresponding system ergodic capacity is given by
(31)Therefore, the performance of a
CSI-feedback-based MISO system can be characterized by the capacity loss
due to the finite-rate quantization of the
transmit beamforming vectors, which is defined as the expectation of the
instantaneous mutual information rate loss
,
that is,
(32)This performance metric was also
used in [11, 19]. From an
information theoretical point of view, a CSI feedback scheme should be designed
to minimize this performance metric.
5. Capacity Analysis of MISO CSI Quantizers with Transformed Codebook
By utilizing the distortion analysis of the
transformed codebooks provided in Sections 2 and 3, this section provides an
investigation of the capacity loss of a finite-rate CSI-quantized MISO
beamforming system over spatially correlated fading channels, that uses
transformed CSI quantizers.
5.1. Reformulation of the CSI-Quantized MISO Beamforming System
By employing the general framework described in
Section 2, the finite-rate quantized MISO beamforming system can be formulated
as a general fixed-rate vector quantization problem by adopting a direct
mapping between CSI and source variables, given by
.
Specifically, the source variable to be quantized is denoted as
of
real dimensions with
and
representing the real and imaginary parts of
the complex channel directional vector
.
The encoder side information is denoted as
of dimension
representing the power of the vector channel.
For vectors in the vicinity of
(with
and
representing its real and imaginary parts),
source variable
is restricted under the constraint function
given by
(33)where the first element
represents the norm constraint
,
and the second element represents the phase constraint
.
The function
has size
,
which leads to the actual degrees of freedom of the quantization variable
to be
.
The instantaneous capacity loss due to effects of finite-rate CSI quantization
is taken to be the system distortion function
,
which has the following form according to
(32)
(34)where
is the instantaneous channel power given by
.
5.2. Distortion Anslysis of Optimal CSI Quantizers
In order to understand CSI quantizers with transformed
codebooks, it is worth investigating the optimal CSI quantization scheme first.
For correlated MISO fading channels, by substituting the distortion function
(34) into (5), the optimal normalized inertial profile of a MISO system is
tightly lower bounded by the following form:
(35)Moreover, by substituting the inertial
profile lower bound
into the distortion integral (6), the average
distortion (or capacity loss) of a CSI-quantized MISO system can be lower
bounded by
(36)
Note
that
is a constant coefficient that only depends on
the number of antennas
,
channel correlation matrix
,
and system SNR
,
and is given by
(37)with
representing the generalized hypergeometric function. The optimal
point density
that achieves the minimal distortion is given
by
(38)
As a special case, when the fading channel responses
are spatially uncorrelated, that is,
,
the average system distortion has the following form:
(39)with the optimal point density
being a uniform distribution given
by
(40)
Due to space limitations and to avoid overlap with our
previous work, the derivations in this subsection have been condensed by
skipping some manipulations used in obtaining the final expressions. Please
refer to [19, 25] for more details.
5.3. Distortion Analysis of Quantizers with Transformed Codebook
First, according to the codebook transformation given
by (29) as well as the optimal point density function of i.i.d. channels given
by (40), the transformed point density function
from (12) has the following
form:
(41)which is equivalent to the PDF
of a unit-norm complex vector
with
having complex Gaussian distribution
.
It is evident that the transformed point density given by (41) does not match
the optimal point density function
given by (38) in the general case. However,
for MISO systems with a large number of antennas and in high-SNR and low-SNR
regimes, it can be shown that the optimal point density
reduces to be the source distribution
given by the following form:
(42)In this case, by choosing matrix
as
with matrices
and
obtained from the eigen-value decomposition of
the channel covariance matrix, that is,
,
one can generate a transformed codebook
whose point density
is equal to the optimal point density function
.
By utilizing this codebook transformation, there is no distortion loss caused
by the point density mismatch (when
is large). However, the system still suffers
from the suboptimal Voronoi shape due to the transformation.
By substituting the transformation given by (29) into
(17), the inertial profile of the transformed codebook with suboptimal encoder
(or encoding process) is given
by
(43)where
is the optimal inertia profile given by (35).
It is evident from (43) that except for unitary rotations of the i.i.d.
codebook, any nontrivial transformation of codebook
will lead to mismatched Voronoi shapes and
hence causes inertial profile loss. Therefore, a codebook transformation that
makes the best compromise between the point density loss and the inertial
profile loss is favored.
Finding the optimal codebook transformation
that minimizes the system distortion turns out
to be a difficult problem. In this paper, instead of optimizing the overall
distortion with respect to matrix
,
we provide a distortion analysis of MISO systems with transformed
CSI-quantizers using codebooks generated by the heuristic choice
(or
). (Note that the codebook transformation is
not unique. Any right unitary rotation
on matrix
,
with
,
can generate another codebook transformation (or codebook) with the same
performance.) To be specific, by substituting the transformed point density
(41) and the transformed inertia profile (43) into the distortion integral
given by (25), the corresponding upper and lower bounds of the average system
distortion of a MISO CSI-quantizer with transformed codebook has the following
forms:
(44)
(45)
5.4. Performance Comparison of CSI-Quantizers with Optimal and Transformed Codebooks
In order to assess the suboptimality caused by
codebook transformation, one would like to compare the system performance in
terms of the average distortion of quantizers using transformed codebooks with
that of the optimally designed codebooks. Interestingly, in high-SNR and
low-SNR regimes with a large number transmit antennas
,
the average system distortion of CSI quantizers with transformed codebook can
be upper and lower bounded by some multiplicative factors of the distortion of
optimal quantizers.
Proposition 2.
For
systems with a large number of transmit
antennas, that is,
,
the following inequalities are satisfied:
(46)
(47)
where the superscript “
” represents the high-dimensional
distortion (
large), and “
” (or “
”) represents the distortion in
(or
) regimes. In (46), the constant coefficients
and
are given by the following
form:
(48)
(49)
Proof.
See Appendix A.
Note from Proposition 2 that constants
and
can be viewed as the upper bounds of the
penalty paid for using a transformed codebook instead of the optimal design.
Numerical examples of the loss factors
and
as well as corresponding discussions are
provided in Section 6.
5.5. Discussion on Quantization Resolutions
The proposed system distortion bounds, as well as the
corresponding observations made in previous sections, are all derived based on
the high-resolution assumption. However, the feedback rate of the channel state
information is always constrained to be low (a few bits per channel update) due
to various practical considerations, for example, reduced transmission
overhead, latency, and uplink spectral efficiency loss. Fortunately, as a
well-known result in the conventional source coding, the high-rate distortion
bounds agree well with the real simulation results when the resolution is
larger than
bits per dimensions (
) [26]. In this paper, due to “log-like” nature of the
distortion function (system capacity loss), the distortion bounds converge even
faster (about
bits per dimension), which is verified by
simulation results in the following section. Therefore, the proposed distortion
lower bounds are tight, and hence are able to characterize the system
performance well even for CSI quantizers with small to moderate quantization
rates.
6. Numerical and Simulation Results
Some numerical experiments were conducted to get a
better feel for the utility of the bounds. Figure 2 shows the system capacity
loss due to the finite-rate quantization of the CSI versus feedback rate
for a
MISO system over correlated Rayleigh fading
channels under different system SNRs,
and
dB, respectively. The spatially correlated
channel is simulated by the correlation model in [27]: a linear antenna array
with antenna spacing of half wavelength, that is,
,
uniform angular spread in
and angle of arrival
.
Simulation results of both the optimal designed codebook using the minimal
mean-squared weighted inner product (MSwIP) criterion proposed in [10], as well as the suboptimal
transformed codebook, are plotted. For comparison purposes, the distortion
lower bound
given by (44) and the distortion upper bound
given by (45) are also included in the plot.
Note that the capacity losses (
-axis) are demonstrated using unit of bits per
channel update. To get a relative sense, the channel capacity assuming perfect
CSIT for the same
MISO system is
bits per channel update for an SNR of
dB, and
bits per channel update for an SNR of
dB. It can be observed from Figure 2 that the
distortion lower bound
is tight and the performance of the CSI
quantizer with transformed codebook is close to that of the optimal codebooks.
Figure 2: Capacity loss of a

correlated MISO system with normalized antenna
spacing

versus CSI feedback rate

using different channel quantization codebooks
(optimal codebook versus transformed codebook).
In order to see the effects of channel correlation on
CSI quantizations, we plot in Figure 3 the normalized capacity losses (or
capacity loss ratios) versus the adjacent antenna spacing
of a
MISO system using both optimal CSI quantizers
and quantizers with transformed codebooks. In the plot, the normalized capacity
loss is defined to be the distortion ratio of correlated fading channels over
i.i.d. fading channels. The reasons of choosing the capacity loss ratio as a
major performance metric are twofold. First, intuitively uncorrelated Gaussian
distribution has the maximum amount of “uncertainty” among all possible
channel distributions. It imposes greater challenges in terms of quantizing the
CSI than spatially correlated fading channels. Therefore, normalizing the
system capacity loss w.r.t that of i.i.d. fading channels would make this ratio
a positive number between 0 and 1, which characterizes the relative quality of
the channel quantizer. Second, according to (36), (39), (44), and (45), the
system distortion (in terms of capacity loss) of both optimal and transformed
codebooks can be expressed as a weighted exponential function given by
,
where
is a constant coefficient that is independent
of the quantization resolution
.
Therefore, the proposed capacity loss ratio does not depend on the feedback
rate, and only reflects the impact of the channel statistical distributions as
well as the type of channel quantizers used.
Figure 3: Normalized capacity
loss (with respect to the capacity loss of uncorrelated fading channels) comparison
of a

MISO transmit beamforming with optimal and
transformed codebooks versus antenna spacing

,
in low-SNR regimes (

).
In Figure 3, the capacity loss ratio is demonstrated
with respect to the adjacent antenna spacing
,
which is directly related to the spatial correlation of the MISO channel
response. When
is sufficiently large, the channels can be
viewed as i.i.d. Gaussian distributed, while
means the channel is completely correlated
(line of sight cases). In the plot, the average system signal to noise ratio is
chosen in the low SNR regimes where
dB, and the quantization resolution is
bits per channel update. Simulation results in
high SNR regimes, which are not shown here due to space limitations, show very
similar results. Moreover, for comparison purpose, the ratio of the distortion
bounds, that is,
and
,
is also included in the plot. One can first learn
from Figure 3 that the system capacity loss increases as the adjacent antenna
spacing increases (channel correlation decreases). It means higher feedback rate
or finer resolution of the channel quantizer has to be used to maintain the
same level of capacity losses, which is consistent with our earlier intuition.
Moreover, it can be observed from the plot that the transformed codebook
performs very close to the optimally designed codebook across all channel
correlations. Finally, the plot also indicates that the analytical bounds agree
well with the obtained simulation results. Therefore, we can analytically
characterize the performance of beamforming systems using transformed channel
quantizers without cumbersome numerical simulations.
In order to demonstrate the penalties of using
transformed codebooks in high-SNR and low-SNR regimes, Figure 4 plots the
constant coefficients
and
versus the number of transmit antennas
for correlated MISO channels with adjacent
antenna spacing
.
From the plot, it can be observed that (the upper bound of) the performance
degradation caused by the transformed codebook is less than
in low-SNR regimes and
in high-SNR regimes for MISO systems with more
than
transmit antennas. This means that the intuitive
choice of
given in [6, 13] is a fairly good solution especially for cases when
the channel covariance matrix has a relatively small condition number.
Figure 4: Demonstration
of the distortion penalties of a MISO system using transformed codebooks over
correlated fading channels with different number of transmit antennas of
antenna spacing

.
7. Conclusion
This paper extends the high-resolution quantization
theory approach to study the effects of a finite-rate MISO CSI-quantizer
employing a transformed codebook while transmitting
over correlated fading channels. The contributions of this paper are twofold.
First, analysis is provided for a generalized vector quantizer with a
transformed codebook. Bounds on the average system distortion of this class of
quantizers are provided. It exposes the effects of two kinds suboptimality,
which include the suboptimal point density loss and the mismatched Voronoi
shape. Second, we focused our attention on the application of the proposed
general framework to provide the capacity analysis of a feedback-based MISO
system over correlated fading channels using channel quantizers with
transformed codebooks. In particular, upper and lower bounds on the channel
capacity loss of MISO systems with transformed codebooks are provided and
compared to that of the optimal quantizers. It was further proven that the average
distortion of CSI quantizers with transformed codebooks can be upper and lower
bounded by some multiplicative factors of the distortion of optimal quantizers.
These factors were shown to be close to one for fading channels whose channel
covariance matrix has small to moderate condition numbers. Numerical and
simulation results were presented, which confirms the tightness of the
theoretical distortion bounds.
Appendix
A. Proof of Proposition 2
Proof.
First, in high-SNR regimes,
distortion bounds
and
can be represented as
(A.1)
(A.2)where coefficients
and
can be expressed as the expected powers of the
ratios of Gaussian quadratic variables, which are given by
(A.3)The moments of ratios of random
variables, including central quadratic forms in normal variables, were investigated
in [28], and the
results can be described by the following integrals:
(A.4)where
is the joint moment generating function
(m.g.f.) of random variables
and
,
and
stands for
evaluated at
.
Therefore, by setting
and
,
the joint m.g.f. of variables
and
can be represented as
(A.5)By substituting the joint m.g.f.
given by (A.5) into the integral in (A.4) with
,
the coefficient
after some manipulations, has the following
closed-form expression:
(A.6)Finally, by substituting (A.6)
into (A.1), equality
of (46) is proven. With similar reasoning, by
substituting the joint m.g.f. (A.5) into (A.4) with
,
coefficient
is obtained. Correspondingly, a closed-form
expression of the coefficient
,
given by (48), can also be obtained, and inequality
of (46) is proven.
Similarly, in low-SNR regimes, distortion bounds
and
have the following
forms:
(A.7)where the coefficients
and
are given by
(A.8)From (A.8), it is evident that
,
and hence the equality
of (47), can be proven. Moreover, by extending
the results of the moments of the quadratic forms provided in [28], the following expectation
can be obtained after some manipulations:
(A.9)Therefore, by setting
and
,
and substituting the joint m.g.f. given by (A.5) into the integral in (A.9), the
coefficient
can be obtained. It is equivalent to
coefficient
given by (49), and hence the inequality
of
(47) can be proven.
Acknowledgments
The authors would like to thank Chandra R. Murthy and Ethan Duni for many stimulating discussions and the critical feedback, which greatly helped with
the development of this work. This research was supported in part by CoRe
Grant no. 02-10109 sponsored by Ericsson, and in part by the US Army
Research Office under the Multi-University Research Initiative (MURI)
Grant no. W911NF-04-1-0224.
References
- K. K. Mukkavilli, A. Sabharwal, E. Erkip, and B. Aazhang, “On beamforming with finite rate feedback in multiple-antenna systems,” IEEE Transactions on Information Theory, vol. 49, no. 10, pp. 2562–2579, 2003.
- D. J. Love, R. W. Heath, Jr., and T. Strohmer, “Grassmannian beamforming for multiple-input multiple-output wireless systems,” IEEE Transactions on Information Theory, vol. 49, no. 10, pp. 2735–2747, 2003.
- D. J. Love and R. W. Heath, Jr., “Limited feedback unitary precoding for orthogonal space-time block codes,” IEEE Transactions on Signal Processing, vol. 53, no. 1, pp. 64–73, 2005.
- J. H. Conway, R. H. Hardin, and N. J. A. Sloane, “Packing lines, planes, etc.: packings in Grassmannian spaces,” Experimental Mathematics, vol. 5, pp. 139–159, 1996.
- P. Xia, S. Zhou, and G. B. Giannakis, “Multiantenna adaptive modulation with beamforming based on bandwidth-constrained feedback,” IEEE Transactions on Communications, vol. 53, no. 3, pp. 526–536, 2005.
- P. Xia and G. B. Giannakis, “Design and analysis of transmit-beamforming based on limited-rate feedback,” IEEE Transactions on Signal Processing, vol. 54, no. 5, pp. 1853–1863, 2006.
- S. Zhou, Z. Wang, and G. B. Giannakis, “Quantifying the power loss when transmit beamforming relies on finite-rate feedback,” IEEE Transactions on Wireless Communications, vol. 4, no. 4, pp. 1948–1957, 2005.
- J. C. Roh and B. D. Rao, “Transmit beamforming in multiple-antenna systems with finite rate feedback: a VQ-based approach,” IEEE Transactions on Information Theory, vol. 52, no. 3, pp. 1101–1112, 2006.
- A. Gersho and R. M. Gray, Vector Quantization and Signal Compression, Kluwer Academic Publishers, Boston, Mass, USA, 1992.
- J. C. Roh and B. D. Rao, “Design and analysis of MIMO spatial multiplexing systems with quantized feedback,” IEEE Transactions on Signal Processing, vol. 54, no. 8, pp. 2874–2886, 2006.
- J. C. Roh, Multiple-antenna communication with finite rate feedback, Ph.D. thesis, University of California, San Diego, Calif, USA, 2005.
- A. Narula, M. J. Lopez, M. D. Trott, and G. W. Wornell, “Efficient use of side information in multiple-antenna data transmission over fading channels,” IEEE Journal on Selected Areas in Communications, vol. 16, no. 8, pp. 1423–1436, 1998.
- D. J. Love and R. W. Heath, Jr., “Grassmannian beamforming on correlated MIMO channels,” in Proceedings of the IEEE Global Telecommunications Conference (GLOBECOM '04), vol. 1, pp. 106–110, Dallas, Tex, USA, November 2004.
- V. Lau, Y. Liu, and T.-A. Chen, “On the design of MIMO block-fading channels with feedback-link capacity constraint,” IEEE Transactions on Communications, vol. 52, no. 1, pp. 62–70, 2004.
- M. Skoglund and G. Jongren, “On the capacity of a multiple-antenna communication link with channel side information,” IEEE Journal on Selected Areas in Communications, vol. 21, no. 3, pp. 395–405, 2003.
- E. N. Onggosanusi, A. Gatherer, A. G. Dabak, and S. Hosur, “Performance analysis of closed-loop transmit diversity in the presence of feedback delay,” IEEE Transactions on Communications, vol. 49, no. 9, pp. 1618–1630, 2001.
- N. Jindal, “MIMO broadcast channels with finite rate feedback,” IEEE Transactions on Information Theory, vol. 52, no. 11, pp. 5045–5059, 2006.
- V. Hassel, D. Gesbert, M.-S. Alouini, and G. E. Oien, “A threshold-based channel state feedback algorithm for modern cellular systems,” IEEE Transactions on Wireless Communications, vol. 6, no. 7, pp. 2422–2426, 2007.
- J. Zheng, E. R. Duni, and B. D. Rao, “Analysis of multiple-antenna systems with finite-rate feedback using high-resolution quantization theory,” IEEE Transactions on Signal Processing, vol. 55, no. 4, pp. 1461–1476, 2007.
- J. Zheng and B. D. Rao, “Multiple antenna systems with finite rate feedback: design and analysis of MISO systems with
channel correlation,” IEEE Transactions on Signal Processing, vol. 55, no. 9, pp. 4612–4626, 2007.
- J. Zheng and B. D. Rao, “Analysis of vector quantizers using transformed codebook with application to
feedback-based multiple antenna systems,” in Proceedings of the European Signal Processing Conference (EUSIPCO '06), Florence, Italy, September 2006.
- S. Na and D. L. Neuhoff, “Bennett's integral for vector quantizers,” IEEE Transactions on Information Theory, vol. 41, no. 4, pp. 886–900, 1995.
- J. Huang and P. Schultheiss, “Block quantization of correlated Gaussian random variables,” IEEE Transactions on Communications, vol. 11, no. 3, pp. 289–296, 1963.
- W. R. Bennett, “Spectra of quantized signals,” Bell System Technical Journal, vol. 27, pp. 446–472, 1948.
- J. Zheng, Design and analysis of multiple antenna communication systems with finite rate feedback, Ph.D. thesis, University of California, San Diego, Calif, USA, 2006.
- R. M. Gray, Source Coding Theory, Kluwer Academic Publishers, Norwell, Mass, USA, 1990.
- J. Salz and J. H. Winters, “Effect of fading correlation on adaptive arrays in digital mobile radio,” IEEE Transactions on Vehicular Technology, vol. 43, no. 4, pp. 1049–1057, 1994.
- M. C. Jones, “On moments of ratios of quadratic forms in normal variables,” Statistics & Probability Letters, vol. 6, pp. 129–136, 1987.