Department of Electrical and Computer Engineering, University of Patras, Rio, Patras 26500, Greece
Abstract
Multicarrier modulation is a powerful transmission technique that provides improved performance in
various communication fields. A fundamental topic of multicarrier communication systems is the bit and
power loading, which is addressed in this article as a constrained multivariable nonlinear optimization
problem. In particular, we present the main classes of loading problems, namely, rate maximization and
margin maximization, and we discuss their optimal solutions for the single-user case. Initially, the classical
water-filling solution subject to a total power constraint is presented using the Lagrange multipliers
optimization approach. Next, the peak-power constraint is included and the concept of cup-limited waterfilling
is introduced. The loading problem is also addressed subject to the integer-bit restriction and
the optimal discrete solution is examined using combinatorial optimization methods. Furthermore, we
investigate the duality conditions of the rate maximization and margin maximization problems and we
highlight various ideas for low-complexity loading algorithms. This article surveys and reviews existing
results on resource allocation in constrained multicarrier systems and presents new trends in this area.
1. Introduction
Multicarrier modulation (MCM) [1, 2] We considered “Theodore
Antonakopoulos” as the corresponding author. Please check. is well recognized as
an efficient and powerful transmission technique that has been adopted by
various standard committees for both wireless [3–6] and wireline
[7–9] systems. MCM provides
important benefits including, among others, efficient bandwidth optimization,
enhanced spectrum utilization, low equalization complexity, and multi-user
potentiality. Moreover, MCM is widely used in new application fields, such as
powerline communications (PLC) [10, 11], and wireless local area networks (WLANs) [12–14] due to its recognized value
to confront various channel impairments, including frequency selectivity,
intersymbol interference (ISI), and impulse noise.
The principle of MCM is the spectrum decomposition
into a set of orthogonal narrowband subchannels by utilizing complex
exponentials as information-bearing carriers. Two important MCM techniques have
widespread use: orthogonal frequency-division multiplexing (OFDM)
[14] mainly employed in wireless
applications and discrete multitone (DMT) [15] used in wireline systems. Both OFDM and DMT employ
the fast Fourier transform (FFT) for spectrum decomposition, hence data
transmission is performed in blocks. In order to avoid ISI and to preserve
orthogonality, a cyclic prefix is introduced at the expense of a data rate loss
[16]. Using the cyclic
prefix, the system carriers can be viewed as separate independent channels, on
which different information rates can be transferred by utilizing
constellations of different sizes.
The allocation of bits and power to the subchannels is
a fundamental aspect in the design of multicarrier systems. The allocation
problem is known as bit and power loading and is based on
loading algorithms, which aim to distribute the total number of
bits and the available power over the subchannels in an optimal way that maximizes
performance and preserves a target quality of service. In fact, the bit and
power loading is a constraint optimization problem and generally two cases are
of practical interest [17]:
rate maximization (RM) and margin
maximization (MM), where the objective is the maximization of the achievable
data rate or the achievable system margin, respectively. In fact, margin
maximization is equivalent to power minimization given a target data rate. The
loading problem defines a set ofconstraints imposed either by recommendation
rules and specifications [18], or by practical limitations and implementation
issues [9]. Such
constraints include total available power budget, power spectral density (PSD)
mask, integer number of bits per subcarrier, and so forth.
Adaptive loading is possible only when channel state information (CSI) is known
both at the transmitter and the receiver. In wireless applications,
the channel is time-varying and therefore OFDM systems usually employ the same
constellation in all carriers. On the other hand, the
wireline channel is treated either as almost constant or as slow time-varying,
and therefore CSI can be sent to the transmitter by a feedback link. Thus, in
DMT applications, the utilization of different signal constellations per
subchannel by adaptive bit and power loading is of great importance, and as the
number of subchannels required in commercial applications [9, 17] increases, the development of
efficient loading algorithms is a challenging task.
The literature contains several loading algorithms proposed for DMT-based systems.
These algorithms consider either the RM or the MM problem, and two general classes can be distinguished.
The first class of loading algorithms treats the allocation problem using numerical
methods that employ Lagrange optimization, which in general results in real numbers
for optimum bit allocation [19–22]. However, for practical applications,
the number of bits per subchannel is restricted to integer values, and thus, the above
algorithms include a final suboptimum bit-rounding step. The integer-bit
constraint imposes a combinatorial structure in the loading optimization
problem. The second class of loading algorithms employs discrete greedy-type
methods in order to obtain the optimum integer-bit allocation results
[23–27].
This article aims at providing a tutorial survey on
the bit and power loading in constrained multicarrier systems and at reviewing
the most popular results on the loading algorithms for the RM and MM problems.
We examine the single-user communications scenario, that is, a point-to-point
link between a DMT-based transmitter and a receiver. We start out with a short introductory
overview of the multicarrier basics. Then, the loading problem is considered
only subject to a total power constraint and the classical water-filling
solution is discussed using the Lagrange multipliers optimization approach.
Next, the peak-power constraint is included and the concept of cup-limited
water-filling is introduced. The loading problem is also addressed subject to
the integer-bit restriction and the optimal discrete solution is examined using
combinatorial optimization methods. Moreover, we investigate the duality
conditions of the RM and MM loading problems and we highlight some ideas for
low-complexity loading algorithms. This article aims to provide the basic
knowledge for more complex and challenging problems of bit and power allocation
in constrained multicarrier systems under the multi-user context.
2. Multicarrier Loading
MCM decomposes the channel spectrum into a set of
orthogonal narrowband subchannels of equal
bandwidths [1]. For
each subchannel
,
where
,
a rate function
is defined, which gives the number of bits
that can be transmitted using power
.
The rate function depends on the maximum probability of error that can be
tolerated and the applied modulation and coding schemes, which we assume to be
shared among all the subchannels. In addition, we assume the existence of the
inverse function
,
namely, power function, which gives the power
required for the transmission of
bits. We consider practical QAM-coded MCM,
where the rate function is given by the following logarithmic expression in
bits per two-dimensional symbol:
(1)where
is the gain-to-noise ratio of subchannel
,
is the channel frequency response,
is the noise power, and
is the SNR gap expressing the loss, in terms
of SNR, between the actual rate
conveyed by the used transmission scheme and
the theoretical capacity achieved for
(0 dB).
The SNR gap is calculated according to the “gap-approximation”
analysis [15, 28], based on the target error probability
, the applied coding gain
,
and the system performance margin
. Some useful comments on the validity limits of the
“gap-approximation”
can be found also in [21].
When QAM transmission is employed, we can
write
(2)where
is the inverse of the well-known
-function defined as
(3)
Note that the margin
in (2) expresses the SNR
degradation immunity, which the system designer tries to achieve, so that the
MCM performance is maintained for the desired probability of error.
The higher the system margin is, the more power is required for a given probability
of error. On the other hand, as the coding gain
increases, the transmission rate approaches
the system capacity.
Since OFDM and DMT systems usually require the same
error rate for all subchannels [15], in the rest of this article we will consider that
is embedded in the
s, that is,
for
. From (1), it is clear that
the power function is defined by the exponential
expression
(4)while the total power and the
total data rate of the multicarrier system are, respectively,
(5)
The loading problem aims at determining the optimal
distribution of the available power in all subchannels. Using the rate and
power functions, (1) and
(4), respectively, the optimal distribution
of the available power is transformed into an optimal distribution of the achievable
data rate over the subchannels, and vice versa. The loading problem is
formulated as a multivariable constraint optimization problem. The optimization
objective is the maximization of the rate function (RM case), or the
minimization of the power function (MM case), subject to a set of constraint
functions that reflect system limitations and restrictions. In the following
sections, we formulate the loading problem, initially only subject to the total
power budget constraint, and afterwards when the peak-power restriction per
subchannel is also included.
3. Total Power-Constrained Loading
Let
denote the total power budget and
denote the desired data rate. The RM and MM
loading problems are formulated as follows.
RM Loading Problem:
(6)
MM Loading Problem:
(7)
We observe that the logarithmic expression in (6)
is a strictly increasing and concave function of
,
while the exponential expression in (7) is a strictly increasing and convex
function of
[29]. As a result, we recognize that both RM and MM belong
to the class of convex optimization problems with convex constraint sets, and
therefore a unique global solution exists. Moreover, we observe that both
problems are nonlinear. The optimal solution is calculated by forming the
corresponding Lagrangian function and applying the Kuhn-Tucker conditions
[30].
From the MM problem formulation in (7),
it is clear that margin maximization is equivalent to power minimization. In fact, given a
target data rate, the MM objective is to determine (from all possible bit
allocations that correspond to a data rate equal to the target one) the optimum
bit allocation, which requires the least total power. The additional power,
that is, the difference between the available power budget and the total power
of the optimum bit allocation, is used in order to increase the system margin
in (2). Note that for the
MM problem, we assume that the available power budget is sufficient to support the desired
target rate, otherwise the problem in (7) has
no solution. Based on this assumption, a total power budget constraint is not
included in (7).
3.1. Rate Maximization Water-Filling
The optimal solution to the RM problem is given by the
following relation, which is known as the water-filling
formula:
(8)where
is a constant value depending on the total
power budget.
The solution in (8) can be best
described using Figure 1. The spectrum can be
considered as a vessel and the shape of the
bottom of this vessel is determined by the inverse of
values. We can say that the available power is poured over the spectrum vessel, so that the subchannels covered by the water-level
are assigned power, while the remaining
subchannels are not used at all (water-filling is also referred to as
water-pouring).
Assuming that the subchannels are sorted,1 the water-level
is
(9)where
is the total number of the used subchannels
determined according to the following criteria:
(10)
Figure 1: Water-filling
rate maximization. The shaded area represents the total available power.
An iterative algorithm that determines the water-filling
RM solution by using an initial sorting of the subchannels' gain-to-noise ratio
values is described in [20]. When the subchannels
are sorted, the objective of the loading algorithm is to determine the
cut-off subchannel
and the constant
. Sorting is not a trivial task when the number of subchannels is large. In
general, this task dominates the computational complexity of all practical
algorithms for water-filling, so the complexity is
.
The optimum bit allocation is derived by
(1) and
(8), which results in the following
compact formula:
(11)while the total data rate
is
(12)
Remark 1.
By combining (8) and
(9), we derive that the optimal
solution uses all the available power budget, that is, the total power
constraint in (6) is met with equality.
Moreover, we observe that as more power budget is available, the water-level in
(9) becomes higher and as a consequence,
more subchannels may be turned on, as long as (10)
implies a higher value for
. Therefore, a higher power budget corresponds to a higher water-level,
which generally results in the utilization of more subchannels and thus in a
higherdata rate.
Remark 2.
From (8) and (9),
we can write the optimum power allocation using the following expression:
(13)
The first term is a constant power portion, while the
second term is the distance between the mean of the inverse gain-to-noise
ratios of all used subchannels and the
of each subchannel. Figure 2 illustrates this remark, where the subchannels are sorted. Observe that for
subchannel
the distance of
to the mean value is positive, while for
subchannel
,
the distance is negative.
Figure 2: Graphical
representation of (
13).
Remark 3.
Figure 2 also illustrates a characteristic
feature of the water-filling allocation strategy: water-filling allocates more
power to the strongest subchannels.
3.2. Margin Maximization Water-Filling
Using the Lagrange multipliers method and applying the
Kuhn-Tucker conditions, we can derive the optimal solution to the MM problem in
(7) as follows:
(14)where
is constant and depends on the target data
rate.
Assuming that the subchannels are sorted in a
descending order,
is given by
(15)where
is the total number of used subchannels
determined according to the following criteria:
(16)
The analogy between (9) and
(10) of the RM problem
with (15) and (16)
will be evident, as soon as we calculate the power of each
subchannel allocated with
bits according to (14). Using
(4), we
get
(17)
In (17), we observe that the optimum bit
solution to the MM problem results in a power distribution that follows a water-filling
power allocation as in the RM problem. Therefore, a power distribution, similar
to the one shown in Figure 1, holds also for the
MM problem. In this case, the constant water-level is equal to
(18)while the total power is given
by
(19)
Remark 4.
We observe in (18), that the higher the
target rate, the higher the water-level and consequently more subchannels may be
used, as long as (16) implies a higher value for
. As a result, a higher target rate requires a
higher total power consumption.
3.3. Duality Conditions between RM and MM Problems
The RM and MM problems admit a unique water-filling
solution. The following proposition holds.
Proposition 1.
Let
,
for
,
be a water-filling bit and power allocation, where
and
. Then,
(20)
Proof.
We have shown in Section 3.1,
that a water-filling power allocation provides the unique solution that
maximizes the data rate subject to a total power constraint. In fact, the whole
power budget is consumed (see Remark 1).
Therefore, any other allocation
with
results in a total rate of
.
Therefore, the first part of (20) is true.
Moreover, we have shown in Section 3.2, that a
water-filling bit allocation provides the unique solution that minimizes the
total power subject to a target rate constraint. Therefore, any other
allocation
with
results in a total power of
.
Consequently, the second part of (20) is
also true.
From the analytical expressions derived for the RM and
MM problems, there exists a duality between the RM and MM problems under
specific conditions. We are now in the position to define these conditions in
the form of the following theorem.
Theorem 1.
Let
,
for
,
be the solution to the RM problem, where
.
Then,
is also the solution to the MM problem with
.
Equivalently, let
,
for
,
be the solution to the MM problem, where
.
Then,
is also the solution to the RM problem with
.
Proof.
Using Proposition 1, for the RM
solution
, we can write
(21)which implies that
is also the solution to the MM problem, when
.
Similarly, for the MM solution
,
we can write
(22)which implies that
is also the solution to the RM problem, when
.
4. Total Power and Peak-Power Constrained Loading
When introducing the peak-power constraint, the
optimization problem becomes more complicated. Let
,
for
,
denote the maximum allowable power per subchannel. In multicarrier systems, a
power spectral density (PSD) mask constraint is usually imposed by regulatory
rules in order to control the level of interference into other communication
systems operating in the neighborhood, for example, [18]. The RM and MM problems are
formulated as follows.
RM Loading Problem:
(23)
MM Loading Problem:
(24)
In the RM
problem, we observe that the peak-power constraint upper bounds the possible
power allocation in each subchannel. In the MM problem, the peak-power
constraint is transformed into a maximum bit allocation constraint, denoted as
for
,
which upper bounds the possible bit allocation in each subchannel and is
defined by
(25)
The RM and MM problems in (23) and (24)
also belong to the class of convex optimization problems with convex constraint sets, and
therefore a unique global solution exists.
4.1. Rate Maximization Water-Filling
By using the Lagrange multipliers approach and
applying the Kuhn-Tucker conditions, we can derive the optimal solution to the
RM problem in (23) as follows2:
(26)where
is a constant and is determined by the
solution to the following nonlinear equation:
(27)
The RM solution in (26) is again water-filling,
however in this case, the spectrum vessel has a limited depth of
and is covered by a cap. When
for all subchannels, then the shape of the cap
is identical to the vessel's bottom, that is, the inverse of the
s. The concept of the “cap-limited”
water-filling is illustrated in Figure 3 subject to a common PSD mask
for all subchannels.
Figure 3: The concept of “cap-limited” water-filling.
In order to obtain the solution in (26),
we need to determine the constant
.
In Section 3.1, an iterative algorithm for
the calculation of the water-level of the total power constrained RM was presented. When the
peak-power constraint is introduced, the RM problem in (23)
can be treated using an iterative water-filling process
[21], which is described using the pseudocode of
Algorithm 1.
Algorithm 1: Cap-limited water-filling.
Algorithm 1 is optimal, however its direct
implementation is not efficient and presents
complexity. In order to overcome such a high
computational load, an iterative algorithm of reduced complexity can be
constructed by exploiting the fact that in every new iteration of
Algorithmalgo:IWF, the participating subchannels are allocated more power with
respect to the previous iteration.
First, consider the optimal water-filling solution in
Section 3.1, which is described in
Figure 4, where the subchannels
are sorted. Denoting as
the optimum
-point water-filling power vector,
satisfies the following set of
equations:
(28)where
is the water-level and subchannels from
to
are turned off, that is, they are loaded with
zero power, and the following proposition holds.
Figure 4: The optimal water-filling.
Proposition 2.
Given the sorted water-filling power allocation vector
, if one removes subchannels
and reduces
by
, then the new optimal water-filling solution is the
-point power vector
.
Proof.
We prove for
.
Let
be the optimum vector. Then,
should satisfy (28):
(29)where
,
,
and subchannels from
to
are turned off.
For
,
the constant
becomes
(30)
From (28) and (30),
we derive that the power vector
satisfies (29) and therefore
is the optimal vector. The proof for
is similar.
As suggested by Algorithm 1,
if the power allocated to subchannel
(staring from the one with the highest
) exceeds
, then we set
, reduce
by
, exclude subchannel
from the optimization problem, and perform
water-filling to the remaining subchannels. Since
is reduced by an amount of power less than the
optimal power assigned by the previous water-filling, then according to
Proposition 2 and Remark 1, the new solution has higher
and additional subchannels may be turned on.
As a result, all subchannels participating in the next water-filling will be
assigned additional power. Based on this remark, the new optimal algorithm is
described by the pseudocode in Algorithm 2.
Algorithm 2: Low-complexity cap-limited water-filling.
Algorithm 2 is explained using Figure
5
subject to common PSD mask for all subchannels. Given the initial water-filling
solution with cut-off subchannel index
and water-level
,
the algorithm determines the first subchannel, denoted as
,
where the power assignment does not violate
.
Then, it upper bounds all subchannels from 1 to
with
and reduces the power budget by the total
power assigned so far. At the next step, the algorithm proceeds to successive
water-filling over the subchannels ranging from
to
.
The new water-filling solution determines a new higher water-level,
,
corresponding to new subchannel indexes
and
.
This procedure is repeated until the water-filling allocation does not violate
in any of the subchannels involved in the new
iteration.
Figure 5: Graphical representation of iterative water-filling.
The complexity improvement of the iterative
water-filling scheme described by Algorithm 2
compared with Algorithm 1 depends on the total
number of iterations that water-filling has executed.
If
is the number of iterations, then the
computational complexity of Algorithmalgo:NewIWF is
.
The lower is
compared to
, the higher is the computational complexity improvement. In
[21], a suboptimum algorithm for the RM problem in
(23) is described that uses an iterative
search-secant method to determine the root of
(27), by noting that (27)
admits a root when
. The search-secant process is subject to a tolerance variable that affects the
speed of convergence, as well as the accuracy of the final result. Generally,
there is a tradeoff between the speed of convergence and accuracy. The method
presents a computational complexity that grows linearly with
,
where
is the number of the search-secant
iterations.
Remark 5.
Similar to Remark 1, we observe from (26)
and (27) that the optimal “cap-limited” water-filling solution consumes the total
available power budget.
4.2. Margin Maximization Water-Filling
In order to obtain the optimal solution to the
peak-power constrained MM problem, we will use the duality between the RM and
MM problems developed in Section 3.3. We have shown in
Section 3.2 that the optimal bit solution
for the MM problem under a total power constraint results in a power allocation,
which follows a water-filling distribution. Given a peak-power constraint, this power allocation
should also follow the “cap-limited” water-filling concept of
Figure 3. The optimal bit solution to (24)
is therefore given by
(31)where
is the solution to the following nonlinear
equation:
(32)
It can be easily verified that Theorem 1
applies also for the total and peak-power constrained RM and MM problems.
5. Integer-Bit Constrained Loading
The Lagrangian methods described in the previous sections
provide the optimal loading solutions, where generally the bit assignment in
each subchannel takes real values. However, due to implementation constraints,
only integer bit values are of practical interest, that is, design of realistic
constellation encoders and decoders. As a consequence, the proposed Lagrangian
algorithms in the literature include a final suboptimal bit-rounding step with
appropriate power scaling to preserve the power budget and target error rate
constraints.
The integer-bit constrained loading problem, also
referred to as discrete loading, belongs to the class of combinatorial
optimization problems. The RM and MM formulations of the previous sections
apply here, along with the additional integer-bit constraint:
for
.
Remark 6.
The monotonicity and concave nature of the rate
function in (1), along with the monotonicity and convex nature of the power
function in (4), as well as of the
corresponding discrete incremental (33) and
decremental (34) power cost functions defined below, guarantee the existence of
a unique optimum solution for each of the RM and MM discrete loading problems
based on appropriate greedy algorithms. The optimality is addressed in
[26, 31, 32], using the matroid theory.
5.1. Optimum Greedy Algorithms
The solution to the integer-bit loading problem is
provided using a greedy algorithm, which defines an appropriate bit allocation
cost function and iteratively assigns one bit at a time to the least
cost-expensive subchannel. In general, a greedy algorithm is characterized by
the following two properties [33].
First, at each step, the algorithm always moves its operating point along the
direction that guarantees the largest increment (decrement) to the assigned
objective function to be maximized (minimized). Second, a greedy algorithm
proceeds only in a forward way, that is, it never tracks back. Two greedy
loading methods are used: the bit-filling [23, 31] and the bit-removal [25, 32].
Considering that subchannel
carries
bits, the power needed to transmit one more
bit in this subchannel is given by
(33)while the power saved by
removing one bit from this subchannel is given by
(34)and the maximum3 number of bits that can be assigned to each subchannel
is
(35)
The incremental power in (33) constitutes the cost
function of the bit-filling process, while the decremental power in (34)
constitutes the cost function of the bit-removal process. In particular, the
bit-filling algorithm starts from an initial all-zero bit allocation,
for
,
and then adds one bit at a time to the subchannel that requires the minimum
additional power until the total power budget is consumed (RM case) or the
target rate is achieved (MM case). On the other hand, the bit-removal algorithm
starts from an initial maximum bit allocation,
for
,
and then removes one bit at a time from the subchannel that saves the maximum
power until the target rate is achieved (MM case). Note that if
,
the maximum bit allocation
used initially by the bit-removal algorithm,
is the direct solution to the RM case. In Appendix A, the following theorem
is proved.
Theorem 2.
Given a target rate
, the bit-filling and bit-removal algorithms result in the same optimum bit and
power allocation.
The following remarks are also in order.
Remark 7.
For the nondiscrete RM problems formulated in the
previous sections, we have noted that the optimal solution results in the
consumption of the total available power budget. In the discrete RM problem,
however, the optimum integer-bit solution results in total power that is
generally less or equal to the power budget.
Remark 8.
Although bit-filling and bit-removal provide the same
solution, the computational load associated with each method mainly depends on
the target data rate. The complexity of the bit-filling is
, while the complexity of the bit-removal is
,
where
is the data rate corresponding to the
bit-profile. If
is close to
,
then bit-removal converges faster.
Remark 9.
If bit-filling is left free to proceed above
,
by adding one bit at a time to the least power cost-expensive subchannel, then
it will terminate at the
allocation.
Also for the discrete loading RM and MM problems,
there exist exact conditions for their equivalence, as in the water-filling
case. Theorem 1 developed in
Section 3.3 holds also for the case of
discrete loading, where the only difference is that due to the integer-bit allocation,
the MM solution under the duality conditions is also the RM solution with
(see Theorem 1 for details).
The proof is given in Appendix B. Another
approach is provided in [34].
5.2. Efficient Integer-Bit Allocation Profiles
The high computational load of the greedy bit-filling
and bit-removal algorithms is an important disadvantage for practical systems
with large number of subchannels and high data rate demands. In [27], an efficient discrete bit
allocation profile was developed by recognizing that the order of the
subchannels, which participate in the single-bit incremental process of
bit-filling, is specific and includes a characteristic circular repetition.
The characteristic bit allocation profile is
calculated as follows:
(36)where
,
,
and
for
.
The allocation
depends only on the system
values and presents an optimum bit allocation
profile of a continuous greedy bit-filling process, where any total power or
peak-power constraints are at the moment ignored. In other words, if
bit-filling is continuously applied, then it will reach the allocation
after
steps, where
is the data rate that corresponds to the
profile. From (36), we
observe that
for
.
Depending on the value of
,
may be zero for other subchannels as well.
Assuming that the subchannels are sorted, that is,
and
, the following remarks are in order.
Remark 10.
Given allocation (36)
and assuming that bit-filling is
applied, then one bit has to be added to all the subchannels
, before we can further increase the bits in subchannel
by one. The order, in which the subchannels
are assigned by one more bit, depends on the power cost function
(33) of each
subchannel and generally it does not coincide with the descending order of the
values.
Remark 11.
If bit-removal is applied in (36),
then one bit is first removed from subchannel
and then, one bit has to be removed from all
the subchannels
,
before we can further decrease the bits in subchannel
by one, where
corresponds to the first nonzero bit-loaded
subchannel.
The importance of allocation (36) in
providing low complexity bit loading follows from Remarks 10 and 11 along with the next
theorem.
Theorem 3.
The integer bit allocation
,
for
and
,
is efficient [35]:
(37)
Proof.
This theorem is proved by
substituting
in (33) and showing that (37)
is true,
.
Theorem 3 states that every up- or
downshift of (36) corresponds to an
optimum discrete bit allocation under the power
minimization goal, taking also into account the low (all-zeros) and the upper
bounds of the valid bit vectors. In [27], the following theorem was
proven.
Theorem 4.
,
.
According to Theorem 4, if
(36) is shifted by
,
then
,
,
where the sign of
determines the up- or downshift. This is
illustrated in Figure 6 for the two possible cases, where the
subchannels are sorted. In Figure 6(b), the
profile violates the maximum allowable
allocation
in some of the subchannels. This is due to the
fact that profile (36) does not include any
power or PSD restrictions.
Figure 6: Examples of the

bit-profile with respect to the

upper bound.
Using Theorem 4, along with
Remarks 10 and 11, we
can use the bit-profile
as an initial optimum allocation and then
perform a multiple-bit addition or removal process, that converges to the
optimum bit solution with no more than a single bit difference per subchannel.
In the following section efficient loading algorithms for the discrete RM and
MM problems are presented.
6. Low-Complexity Integer-Bit Loading
In the previous section, it was made clear that in
each allocation step, the greedy algorithm updates the bit-profile according to
a power cost function until the system constraints are met, that is, the total
power budget is consumed for the RM case or the target data rate is achieved
for the MM case. At the end of the greedy process, the respective objective is
satisfied, that is, rate maximization or margin maximization. The system
constraints define a pair of low and maximum bit allocation limits. The greedy
loading process can be described as a continuous bit-by-bit allocation
procedure, since at each step it updates the bit-profile by moving on efficient bit allocations,
see (37), within the set of all possible bit-profiles. For the
RM problem, the upper bit allocation limit is determined by the total power
budget constraint, while for the MM problem the upper bound is directly
calculated by (35). In fact, the upper bound forthe RM problem coincides with
the rate maximization solution. In the rest of this section, we present
efficient discrete loading algorithms by exploiting the characteristic
bit-profile
defined in (36).
These algorithms are based on a multiple-bit loading process that moves the
profile towards the optimum solution.
6.1. Discrete Rate Maximization
First, we address the total power constrained problem.
In contrast to the case of a PSD mask, where the maximum allowable bit
allocation is directly determined by (35),
the bit upper limit in the total power constrained problem is not straightforward.
However, we know from Theorem 3 that every shift of the
bit-profile corresponds to an efficient
allocation. Thus, if the available power budget is not exceeded, the new bit
allocation is valid within the system constraints.
Since there is no explicit bit upper limit defined, we
will use notation
with
,
that is,
.
The data rate and total power of bit allocation
,
where
,
are, respectively,
(38)
Let
.
In order to obtain the maximum possible data rate, we want to upshift profile
by
,
so that
(39)
From (38), we can write
(40)
Using (40), we derive the integer
solution of (39)
as
(41)
The difference between the total power budget and the
power corresponding to the
profile upshifted by (41) may
allow the allocation of a limited number of additional bits, less than
. We can use the greedy bit-filling process to allocate these bits.
If
,
then we want to downshift profile
by
,
so that (39) also holds. Note that
, when
.
It turns out that
is given by (41).
Since the value of
may be greater than the smallest nonzero value
of
for
,
the total power of the downshifted bit-profile
may be higher than expected and therefore
additional downshifting may be necessary. In this case, the new value of
is calculated using (41),
where the upper limit of the summations is replaced by
, which denotes the total number of nonzero bit-loaded subchannels, and
is replaced by the total power
, which corresponds to the downshifted bit profile of the previous step.
At the end of the downshift process, we use greedy bit-filling to add any additional
bits less than
if there is available power. The pseudocode in
Algorithm 3 describes the low-complexity
discrete loading for the total power constrained RM problem.
Algorithm 3: Discrete
total power constrained rate maximization.
In the case of a peak-power constraint, the optimum RM
solution can be calculated by directly allocating
bits and then, if necessary, we perform
bit-removal in order to discard the most power-expensive bits until the total
power constraint is met.
6.2. Discrete Margin Maximization
In the MM problem, we assume that the total power
budget is sufficient in order to support the desired target rate. As in the
previous section, we first address the total power-constrained loading. Given
the initial bit-profile
with a total data rate of
, see (38), we can perform
multiple-bits loading by directly calculating the
allocation
, where
(42)
In (42),
is the total number of nonzero bit-loaded
subchannels, as defined in Remark 11, and
the sign of
depends on whether data rate increase (if
) or decrease (if
) is required. The new bit allocation
is efficient according to Theorem 3 and
optimum under the power minimization goal. However, when downshift is
performed, the resulting data rate might be greater than expected due to the
low (zero) bit-limit. Therefore successive, but limited, number of
multiple-bits loading steps may be necessary until
becomes zero. Then, according to Remarks 10
and 11, the bit-profile allocated so far
differs from the target rate solution at most in a single bit per subchannel.
The remaining bits can be allocated to the appropriate subchannels based on the
respective cost function (33) or (34).
The pseudocode in Algorithm 4
describes the low-complexity MM loading.
Algorithm 4: Discrete
total power-constrained margin maximization.
The above results also hold for the peak-power
constrained loading. However, in this case, two important points should be
noted. First, an explicit bit upper limit exists and the data-rate expression
in (38) becomes
(43)
Second, in (42), the value of
is calculated by the difference between the
desired rate and the rate of the bounded
profile. Since the difference between
and
may be large, a result of
may not indicate the maximum of one bit
difference convergence. In order to overcome such a situation, if
violates the upper limit
, we apply Theorem 4 and move the
bit-profile within the bit-limits.
6.3. Numerical Example
Figure 7 shows an example of bit and power
allocation using the CSA(6) standard ADSL loop in Table 47 of ANSI T1.413-1995
[36]. The system
parameters are:
subchannels, subcarrier spacing 4.3125 kHz,
dBm/Hz additive white Gaussian noise (AWGN)
plus near-end crosstalk (NEXT) generated by 20 high-rate DSL (HDSL) neighboring
lines, and a 40-kHz lower band edge. The loading constraint values are:
dBm/Hz PSD mask, 100 mWatt total power budget,
and
.
We also consider 6 dB margin and 3 dB coding gain.
Assuming a maximum bit-error
rate of
,
the corresponding SNR gap equals 12.8 dB.
Figure 7: Example of bit and power allocation using the CSA(6) standard ADSL loop.
Figure 7 shows the maximum bit
allocation,
, the initial bit allocation,
,
and the target bit allocation that corresponds to
of the maximum possible data rate, that is,
. Figure 7 also shows the transmit
PSD that corresponds to the maximum and
the target rate allocation. The sawtooth shape of the PSD is common to all
discrete bit-loading algorithms and is the result of the stepwise power
distribution due to the integer bit constraint. Since there is a 40-kHz lower
band edge, subchannels 1–9 are not used. Also, note that for the requested
target rate, the loading algorithm does not utilize subchannels 28–52. The
remaining power, that is, the difference between the total power of the target
rate allocation and the power budget, can be used in order to increase the
system margin in all subchannels.
In [27], numerical results show that
exploiting the efficient bit allocation profile described in
Section 5.2, a computational
complexity improvement of up to 6 times compared with the greedy bit-filling
and the bit-removal methods is achieved. Although the results correspond to the
case of total and peak-power constraints, the complexity improvement for the
total power constraint is only the same or higher. Indeed, in the latter case,
the algorithm experiences less differences between the actual and the expected
power or rate (step (6) of
Algorithms 3 and 4),
thus the optimum bit-allocation is reached with less shifting operations of the
profile. It has to be noted that according to
Remarks 10 and
11, the shifting of the
profile converges to the target rate with only
one bit difference per subchannel. Therefore, the final greedy bit-filling or
bit-removal steps in Algorithms 3 and
4 require only the calculation of the
cost function (33) or
(34) and the determination of the least or most
power-expensive subchannels, respectively. As a result of Remarks
10 and 11,
after each subchannel selection, there is no need to update the corresponding
cost function, thus the total complexity of the final greedy process is
reduced.
6.4. When Perfect CSI Is Not Known
The bit and power loading algorithms described in the
previous sections presume that an estimation of the instantaneous CSI, that is,
the subchannel gain-to-noise ratio values, is available. When the channel is
constant or slow time varying, this is not a complex task. For “always on”
links, such as DSL, CSI is obtained during the modems' training. For burst
transmission, such as in wireless LANs, CSI can be estimated using a suitable
preamble structure or inbound training information. However, in order to
account for the limitations imposed by the time-varying behavior of the
wireless channels, such as noisy or outdated CSI, alternative adaptive MCM
schemes have gained research attention, for example, statistical adaptive MCM
and adaptive MCM with partial CSI. References
[37–39] can motivate the interested reader on
this topic.
7. Conclusions
In this work, we surveyed the area of bit and power
loading in constrained multicarrier communication systems in the single-user
context. We discussed the optimal solutions to the main classes of loading
problems, namely, rate maximization and margin maximization, under a set of
specification and implementation constraints. We presented the water-filling power
allocation policy under a total power constraint and the cap-limited
water-filling concept was introduced when the peak-power constraint is
included. Moreover, the loading problem was addressed subject to the
integer-bit restriction and the optimal discrete solution was examined using
combinatorial optimization methods. We reviewed existing loading algorithms and
highlighted some ideas for low-complexity solutions.
1The subchannels are said to be sorted
(in descending order) when
for
.
2The following notation is used, where
,
,
and
are real numbers with
: 
3In practice, a
maximum size in the embedded constellation is also imposed [7]. Let
denote the maximum number of bits that can be
allocated in a subchannel. Then, (35) is written as
.
Appendices
A. Proof of Theorem 2 Equivalence of Bit-Filling and Bit-Removal
We denote as
the
-point bit vector calculated in each
allocation step by the bit-filling method. Then for all components of
,
the following relation holds:
(A.1)and the bit-distribution vector
is said to be BF-efficient . The above
definition was first used by Campello [35]. On the other hand, if
is the
-point bit vector calculated in each
allocation step by the bit-removal method, then the following relation
holds:
(A.2)
Similarly, we define that bit vector
is BR-efficient if equation (A.2)
holds.
In order to show that the bit-filling and bit-removal
methods are equivalent, we have to prove that for a given target rate
,
there exists only one BF-efficient solution and only one BR-efficient solution and that an
-point BF-efficient vector is also BR-efficient .
We assume that there exist two different BF-efficient vectors
and
,
so that
.
Consequently, there exist at least two points, named
and
,
where
and
,
otherwise the above bit-distributions are equal.
Since
is BF-efficient , then
(A.3)
From the inequality
, we have
(A.4)
Combining (A.3) and (A.4),
we get
(A.5)
From the inequality
,
we have
(A.6)
Combining (A.5) and (A.6)
we get
(A.7)which means that vector
is not BF-efficient and this is in
contradiction to our initial assumption. Therefore, there is only one
bit-profile that is BF-efficient for a given target rate. A similar
proof can be derived for the uniqueness of the BR-efficient bit
solution.
Next, we consider a bit distribution vector
,
which is BF-efficient, that is,
:
(A.8)therefore
is also BR-efficient.
B. Proof of Theorem 1 Duality Conditions for the Discrete RM and MM Problems
Let
,
for
,
be efficient greedy bit and power allocation profiles that satisfy
(37) and let
and
.
From the definition of the greedy bit allocation process in
Section 5.1, we have
(B.1)
(B.2)
For a given subchannel
,
the data rate function
is strictly increasing with respect to
,
while the integer function
is increasing with respect to
.
Therefore,
(B.3)
Let
,
for
,
be the optimum greedy solution of the integer RM problem, where
and
.
Then according to (B.2), we can write
(B.4)which means that
is also the solution to the integer MM problem
subject to a target rate of
.
Similarly, let
,
for
,
be the optimum greedy solution of the integer MM problem, where
and
.
Then according to (B.3), we can write
(B.5)which means that
is also the solution to the integer RM problem
subject to a total power of
.
References
- J. A. C. Bingham, “Multicarrier modulation for data transmission: an idea whose time has come,” IEEE Communications Magazine, vol. 28, no. 5, pp. 5–14, 1990.
- Z. Wang and G. B. Giannakis, “Wireless multicarrier communications,” IEEE Signal Processing Magazine, vol. 17, no. 3, pp. 29–48, 2000.
- K. Taura, M. Tsujishita, M. Takeda, H. Kato, M. Ishida, and Y. Ishida, “A digital audio broadcasting (DAB) receiver,” IEEE Transactions on Consumer Electronics, vol. 42, no. 3, pp. 322–327, 1996.
- H. Sari, G. Karam, and I. Jeanclaude, “Transmission techniques for digital terrestrial TV broadcasting,” IEEE Communications Magazine, vol. 33, no. 2, pp. 100–109, 1995.
- M. Russel and G. L. Stüber, “Terrestrial digital video broadcasting for mobile reception using OFDM,” Wireless Personal Communications, vol. 2, no. 1-2, pp. 45–66, 1995.
- L. Thibault and M. T. Le, “Performance evaluation of COFDM for digital audio broadcasting—part I: parametric study,” IEEE Transactions on Broadcasting, vol. 43, no. 1, pp. 64–75, 1997.
- “Asymmetrical Digital Subscriber Line (ADSL) Transceivers,” July 1999, ITU-T Recommendation G.992.1.
- “Very-High-Bit-Rate Digital Subscriber Line (VDSL) Metallic Interface—part 1: functional requirements and common
specification—part 3: technical specification of a multi-carrier modulation transceiver,” ANSI Contribution T1E1.4/2000-013R1, 2000-009R3.
- J. A. C. Bingham, ADSL, VDSL, and Multicarrier Modulation, John Wiley & Sons, New York, NY, USA, 2000.
- E. Biglieri, “Coding and modulation for a horrible channel,” IEEE Communications Magazine, vol. 41, no. 5, pp. 92–98, 2003.
- S. Baig and N. D. Gohar, “A discrete multitone transceiver at the heart of the PHY layer of an in-home power line communication local area network,” IEEE Communications Magazine, vol. 41, no. 4, pp. 48–53, 2003.
- R. van Nee and R. Prasad, OFDM for Wireless Multimedia Communications, Artech House, Boston, Mass, USA, 2000.
- R. van Nee, G. Awater, M. Morikura, H. Takanashi, M. Webster, and K. W. Halford, “New high-rate wireless LAN standards,” IEEE Communications Magazine, vol. 37, no. 12, pp. 82–88, 1999.
- J. Heiskala and J. Terry, OFDM Wireless LANs: A Theoretical and Practical Guide, Sams, Indianapolis, Indiana, 2002.
- J. M. Cioffi, “A multicarrier primer,” November 1991, ANSI Contribution T1E1.4/91-157, Clearfield, Fla, USA.
- A. Peled and A. Ruiz, “Frequency domain data transmission using reduced computational complexity algorithms,” in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '80), vol. 5, pp. 964–967, Denver, Colo, USA, April 1980.
- T. Starr, J. M. Cioffi, and P. J. Silverman, Understanding Digital Subscriber Line Technology, Prentice-Hall, Upper Saddle River, NJ, USA, 1999.
- “Spectrum Management for Loop Transmission Systems,” ANSI Standard T1.417-2001.
- P. S. Chow, J. M. Cioffi, and J. A. C. Bingham, “Practical discrete multitone transceiver loading algorithm for data transmission over spectrally shaped channels,” IEEE Transactions on Communications, vol. 43, no. 2–4, pp. 773–775, 1995.
- A. Leke and J. M. Cioffi, “A Maximum rate loading algorithm for discrete multitone modulation systems,” in Proceedings of the IEEE Global Telecommunications Conference (GLOBECOM '97), vol. 3, pp. 1514–1518, Phoenix, Ariz, USA, November 1997.
- E. Baccarelli, A. Fasano, and M. Biagi, “Novel efficient bit-loading algorithms for peak-energy-limited ADSL-type multicarrier systems,” IEEE Transactions on Signal Processing, vol. 50, no. 5, pp. 1237–1247, 2002.
- B. S. Krongold, K. Ramchandran, and D. L. Jones, “Computationally efficient optimal power allocation algorithms for multicarrier communication systems,” IEEE Transactions on Communications, vol. 48, no. 1, pp. 23–27, 2000.
- D. Hughes-Hartogs, “Ensemble modem structure for imperfect transmission media,” 4 679 227 (July 1987), 4 731 816 (March 1988) and 4 833 796 (May 1989).
- J. Campello, “Practical bit loading for DMT,” in Proceedings of IEEE International Conference on Communications (ICC '99), vol. 2, pp. 801–805, Vancouver, BC, Canada, June 1999.
- R. V. Sonalkar and R. R. Shively, “Efficient bit-loading algorithm for DMT applications,” IEEE Communications Letters, vol. 4, no. 3, pp. 80–82, 2000.
- A. Fasano, G. Di Blasio, E. Baccarelli, and M. Biagi, “Optimal discrete bit loading for DMT based constrained multicarrier systems,” in Proceedings of IEEE International Symposium on Information Theory (ISIT '02), p. 243, Lausanne, Switzerland, June-July 2002.
- N. Papandreou and T. Antonakopoulos, “A new computationally efficient discrete bit-loading algorithm for DMT applications,” IEEE Transactions on Communications, vol. 53, no. 5, pp. 785–789, 2005.
- J. M. Cioffi, G. P. Dudevoir, M. V. Eyuboglu, and G. D. Forney, “MMSE decision-feedback equalizers and coding. II. Coding results,” IEEE Transactions on Communications, vol. 43, no. 10, pp. 2595–2604, 1995.
- T. M. Cover and J. A. Thomas, Elements of Information Theory, John Wiley & Sons, New York, NY, USA, 1991.
- R. K. Sundaram, A First Course in Optimization Theory, Cambridge University Press, Cambridge, UK, 1996.
- E. Baccarelli and M. Biagi, “Optimal integer bit-loading for multicarrier ADSL systems subject to spectral-compatibility limits,” Signal Processing, vol. 84, no. 4, pp. 729–741, 2004.
- A. Fasano, “On the optimal discrete bit loading for multicarrier systems with constraints,” in Proccedings of the 57th IEEE Semiannual Vehicular Technology Conference (VTC '03), vol. 2, pp. 915–919, Jeju, Korea, April 2003.
- G. L. Nemhauser and L. A. Wolsey, Integer and Combinatorial Optimization, John Wiley & Sons, New York, NY, USA, 1988.
- A. Fasano and G. Di Blasio, “The duality between margin maximization and rate maximization discrete loading problems,” in Proceedings of the 5th IEEE Workshop on Signal Processing Advances in Wireless Communications (SPAWC '04), pp. 621–625, Lisbon, Portugal, July 2004.
- J. Campello, “Optimal discrete bit loading for multicarrier modulation systems,” in Proceedings of IEEE International Symposium on Information Theory (ISIT '98), p. 193, Cambridge, Mass, USA, August 1998.
- “Asymmetric Digital Subscriber Line (ADSL) Metallic Interface,” ANSI Standard T1.413-1995.
- Z. Song, K. Zhang, and Y. L. Guan, “Statistical adaptive modulation for QAM-OFDM systems,” in Proceedings of IEEE Global Telecommunications Conference (GLOBECOM '02), vol. 1, pp. 706–710, Taipei, Taiwan, November 2002.
- Y. Yao and G. B. Giannakis, “Rate-maximizing power allocation in OFDM based on partial channel knowledge,” IEEE Transactions on Wireless Communications, vol. 4, no. 3, pp. 1073–1083, 2005.
- S. Ye, R. S. Blum, and L. J. Cimini, Jr., “Adaptive OFDM systems with imperfect channel state information,” IEEE Transactions on Wireless Communications, vol. 5, no. 11, pp. 3255–3265, 2006.