Abstract

This paper presents the design and the analysis of an indirect adaptive control strategy for a lactic acid production, which is carried out in continuous stirred tank bioreactors. Firstly, an indirect adaptive control structure based on the nonlinear process model is derived by combining a linearizing control law with a new parameter estimator. This estimator is used for on-line estimation of the bioprocess unknown kinetics, avoiding the introduction of a state observer. Secondly, a tuning procedure of estimator design parameters is achieved by stability analysis of the control scheme. The effectiveness and performance of estimation and control algorithms are illustrated by numerical simulations applied in the case of a lactic fermentation bioprocess for which kinetic dynamics are strongly nonlinear, time varying, and completely unknown, and not all the state variables are measurable.

1. Introduction

The control of biotechnological processes has been and remains an important problem attracting wide attention, the main engineering motivation being the improvement of the operational stability and production efficiency of such living processes.

It is well known that traditional control design involves a complicated mathematical analysis and has many difficulties especially in controlling highly nonlinear and time varying plants. A powerful tool for nonlinear controller design is the feedback linearization technique [13], but the use of it requires the complete knowledge of the process. In practice, there are many processes characterized by highly nonlinear dynamics; as a consequence, an accurate model for these processes is difficult to develop. Therefore, in recent years, it has been noticed a great progress in adaptive and robust adaptive control of nonlinear systems, due to their ability to compensate for parametric uncertainties. An important assumption in previous works on nonlinear adaptive control was the linear dependence on the unknown parameters [2, 4, 5].

In the modern industry, the development of advanced control strategies for bioprocesses is hampered by two major difficulties [69]. The first one is related to kinetics of these processes, which are strongly nonlinear and furthermore the kinetic and process parameters are often partially or completely unknown. Another difficulty lies in the absence, for many processes, of cheap and reliable instrumentation suited for real-time monitoring of the process variables. In order to overcome these difficulties, several strategies were developed, such as exactly linearizing control [6, 7, 10], adaptive approach proposed by Bastin and Dochain and applied in several works [6, 7, 1012], optimal control, especially for fed-batch bioprocesses [6, 13], neural control [14], sliding mode control [15], robust and robust adaptive control [12, 16], and model predictive control [17]. Some problems which occur in implementation of numerical control of bioreactors are presented and analyzed in [18].

The difficulties encountered in the measurement of state variables impose the use of so-called “software sensors”—combinations between hardware sensors and software estimators [6, 7]. Note that these software sensors are used not only for the estimation of concentrations of some components but also for the estimation of kinetic parameters or even kinetic reactions. The interest for the development of software sensors for bioreactors is proved by the big number of publications and applications in this area [68, 19].

This paper, which is an extended version of Petre et al. [20], presents the design and the analysis of a nonlinear adaptive control strategy, capable to deal with the model uncertainties in an adaptive way, for a lactic fermentation bioprocess that is carried out in two continuous stirred tank bioreactors sequentially connected. In order to avoid the derivation of additional state observers, a new indirect adaptive control algorithm is presented. More exactly, the consumption rates of two limiting substrates are considered completely unknown and summarized in two unknown and time varying parameters, which are estimated by means of an appropriately observer-based estimator. This algorithm could be considered as an extension of the theory proposed by Bastin and Dochain [6] and improved by Ignatova et al. [11], since the substrate consumption rates are considered as completely unknown functions describing the whole kinetics.

The present work is focused in two directions. First, an adaptive control structure based on the nonlinear model of the process is designed as a combination of a linearizing control law and of a parameter estimator, used for the on-line estimation of bioprocess unknown kinetics. Second, by using the stability and convergence analysis of the proposed control scheme, a tuning procedure of the kinetic estimator design parameters is achieved.

The effectiveness and performance of both estimation and control algorithms are illustrated by simulations applied in the case of a lactic fermentation bioprocess for which kinetic dynamics are strongly nonlinear, time varying and completely unknown, and not all the state variables are measurable.

We note that the bioprocess model and the control goal are the same as in the Ben Youssef et al. [21], where an adaptive-multivariable predictive control law was proposed and analyzed. However, in the present work, an indirect multivariable adaptive linearizing controller is developed and analyzed. The control structure is derived by combining a linearizing control law with a new parameter estimator used for on-line estimation of the bioprocess unknown kinetics.

In the work by Ignatova et al. [11], by using the observer-based estimator proposed by Petre [22], an indirect adaptive scheme was derived and analyzed for a gluconic acid production bioprocess. In the present work, the multivariable control strategy presented in Petre [22], and further developed by Ignatova et al. [11], is improved and full stability and convergence proof are provided. Finally, a tuning procedure of kinetic estimator design parameters for a lactic acid production bioprocess was obtained.

The paper is organized as follows. Section 2 is devoted to a brief description and mathematical modeling of a lactic acid fermentation bioprocess. Some nonlinear and adaptive control strategies are proposed in Section 3. From the stability analysis of the adaptive control scheme, a tuning procedure of kinetic estimator design parameters is achieved. Simulations results presented in Section 4 illustrate the performance of the proposed control algorithms and, finally, Section 5 concludes the paper.

2. Process Modeling and Control Problem

Lactic acid has traditionally been used in the food industry as an acidulating and/or preserving agent, and in the biochemical industry for cosmetic and textile applications [21, 23, 24]. Recently, lactic acid fermentation has received much more attention because of the increasing demand for new biomaterials such as biodegradable and biocompatible polylactic products. Two major factors limit its biosynthesis, affecting growth, and productivity: the nutrient limiting conditions and the inhibitory effect caused by lactic acid accumulation in the culture broth [21]. It was shown that, in addition to the inhibition effect of lactic acid, the richness of the fermentation medium may have a strong influence on growth dynamics and that the nutritional limitations during culture may interfere with inhibition by acid lactic [21]. A reliable model that explicitly integrates nutritional factor effects on both growth and lactic acid production in a batch fermentation process implementing Lb. casei was developed by Ben Youssef et al. [21] and it is described by the following basic differential equations: where , , and are, respectively, the concentrations of cells, substrate (glucose) and lactic acid. , , and correspond, respectively, to specific growth rate of the cells, specific rate of lactic acid production, and to specific rate of glucose consumption. is the rate of cell death.

Since in lactic acid fermentation process the main cost of raw material comes from the substrate and nutrient requirements, in [21] some possible continuous-flow control strategies that satisfy the economic aspects of lactic acid production were investigated. The advantage of implementing continuous-flow process is that the main product, which is also an inhibitor, is continuously withdrawn from the system. Much more, according to microbial engineering theory, for a product-inhibited reaction like lactic acid or alcoholic fermentation [21, 25], a multistage system composed of many interconnected continuous stirred tank reactors, where in the different reactors some physiological states of microbial culture (substrate, metabolites) can be kept constant to some optimal values, may be a good idea.

Therefore, the model (2.1) can be extended to a continuous-flow process that is carried out in two continuous stirred tank reactors sequentially connected, as in the schematic view presented in Figure 1.

For this two-stage continuous flow bioreactor, the mathematical model is given by the following set of differential equations, each stage being of same constant volume V.

First Stage:
where .

Second Stage:
where , and , are, respectively, the concentrations of biomass (cells), substrate, lactic acid, and enrichment factor in each bioreactor. , and correspond, respectively, to specific growth rate of the cells, specific rate of lactic acid production, and specific rate of glucose consumption in each bioreactor. is the first-stage dilution rate of a feeding solution at an influent glucose concentration . is the first-stage dilution rate of a feeding solution at an influent enrichment factor . is the influent dilution rate added at the second stage and is the corresponding feeding glucose concentration. It can be seen that in the second stage no growth factor feeding tank is included since this was already feeding in the first reactor.

In the model (2.2)–(2.9), the mechanism of cell growth, the specific lactic acid production rate and the specific consumption rate in each bioreactor are given by [21]: with the maximum specific growth rate, the lactic acid inhibition constant, the affinity constant of the growing cells for glucose, the critical lactic acid concentrations, is the affinity constant of the resting cells for glucose, and is the constant substrate-to-product conversion yield. The superscript gc denotes the parameters related to growing cells and rc to that of the resting cells, and and are positive constants.

The kinetic parameters of this model may be readjusted depending on the medium enrichment factor as follows [21]: where is the minimal nutritional factor necessary for growth, , and are saturation constants. , and correspond to the limit value of each kinetic parameter. Note that the hyperbolic-type expressions in (2.11) quantify the nutritional limitations and are based on the growth model proposed by Bibal [26].

For this two-stage reactor configuration, the operating point of the continuous lactic acid fermentation process could be adjusted by acting on at least two control inputs, that is, the glucose feeding flow rates both in the first and in the second reactor. These considerations show the multivariable nature of the control problem.

3. Control Strategies

3.1. Control Objective

As it was formulated in the previous section, the control objective consists in adjusting the plant’s load in order to convert the glucose into lactic acid via fermentation, which is directly correlated to the economic aspects of lactic acid production. More exactly, considering that the process model (2.2)–(2.9) is incompletely known, its parameters are time varying and not all the states are available for measurements, the control goal is to maintain the process at some operating points, which correspond to a maximal lactic production rate and a minimal residual glucose concentration. After a detailed process steady-state analysis, in [21] it has been demonstrated that these desiderata can be satisfied if the operating point of lactic acid fermentation is kept around the points g/L and g/L. This choice is the best option in order to simultaneously satisfy the both objectives: maximal lactic production rate and minimal residual glucose concentration [21]. As control variables we select the glucose feeding flow rates both in the first and in the second reactor denoted by and , respectively, where and . In this way we obtain a multivariable control problem with two inputs: and and two outputs: and .

In the following, in Section 3.2 we will present the design of an exactly linearizing feedback controller. This controller will be used as a benchmark in order to compare its behavior with the behavior of the indirect multivariable adaptive controller developed in Section 3.3. Also, in this subsection, the parameter estimator used in the indirect multivariable adaptive controller will be designed. In Section 3.4 the tuning procedure of estimator design parameters via stability and convergence analysis of the control scheme will be derived.

3.2. Exactly Linearizing Feedback Controller

Firstly, we consider the ideal case where maximum prior knowledge concerning the process (kinetics, yield coefficients, and state variables) is available, and the relative degree of differential equations in process model is equal to 1. Assume that for the two interconnected reactors we wish to have the following first order linear stable closed loop (process + controller) behavior: where and are the desired values of and .

Since (2.4) and (2.8) in the process model have the relative degree equal to 1, these can be considered as an input-output model and can be rewritten in the following form: Then from (3.1) and (3.2) one obtains the following exactly multivariable decoupling linearizing feedback control law:

The control law (3.3) applied to the process (3.2) will result in: and leads to the following linear error models: where and represent the tracking errors. It is clear that for , the error models (3.5) have an exponential stable point at and .

3.3. An Indirect Multivariable Adaptive Controller

In the previous subsection, it was assumed that the functional forms of the nonlinearities as well as the process parameters are known. Since such prior knowledge is not realistic, in this subsection we consider that the kinetics functions are completely unknown. So, the substrate consumption rates and in (3.2) can be expressed as follows: where and are two unknown time-varying parameters. In this case, the control law (3.3) becomes: where the unknown parameters and will be substituted by their on-line estimates and calculated by using an observer-based parameter estimator (OBE) [22] applied only for the dynamics of and from (2.4) and (2.8) rewritten as follows:

Under these notations, the algorithm for on-line computation of and is particularized as follows: where are the gains of the updating laws (3.11) and (3.12), and are design parameters to control the stability and the tracking properties of the estimator.

Remark 3.1. The parameter error convergence for the estimator (3.9)–(3.12) is assured if some signals in system satisfy the well-known persistency of excitation condition [4, 5]: A piecewise continuous signal vector is referred to as persistent excitation with a level of excitation if there exist constants such that, for all . Although the matrix is singular for each , this condition requires that varies in such a way with time that the integral of the matrix is uniformly positive definite over any time interval [, ]. In our particular case it is necessary that, for example, , or some kinetic parameters to be persistently exciting (which is generically fulfilled).

Finally, an indirect multivariable adaptive linearizing controller is obtained by combination of (3.9)–(3.12) and (3.7) rewritten as follows:

A block diagram of the designed indirect multivariable adaptive control system is shown in Figure 2.

Remark 3.2. Since the on-line measurement of the lactic acid concentrations is not possible, in order to provide on-line evaluation of the current lactic acid production, an asymptotic state observer is derived as follows.
Let us define the auxiliary variables and as: which use only the measurements of the outputs and that are available on-line. The dynamics of , deduced from model (2.2)–(2.9), are expressed by the following linear stable equations: that are independent of the process kinetics. Then, from (3.14) and (3.15), the on-line estimation of and are given by the following relations:

3.4. Tuning Procedure of Estimator Design Parameters via Stability and Convergence Analysis

Let us denote by the vector containing the concentrations of controlled feeding substrates and by the vector of the input control variables, that is, the vector of the mass feeds of substrates and , respectively. Then (3.8) can be written as where is the unknown time-varying parameter vector and is the dilution rate matrix, whose structure is as follows:

The OBE (3.9)–(3.12) can be represented in a matrix form as follows: where is the estimation of unknown parameter , and are positive definite diagonal matrices whose entries and , respectively, represent the estimator design parameters.

Under the previous notations, the exactly multivariable decoupling linearizing feedback control law (3.3), respectively, (3.7) can be written as: where , and the indirect adaptive linearizing control law (3.13) can be written as: where .

Case 1. By defining the errors and , in the case when the unknown parameter is constant, the following error system can be derived from (3.17) and (3.19):
It can be seen that the error system in (3.22) is a linear time-invariant system that can be rewritten as: where is the identity matrix of order two. The stability of the equilibrium (, ) of (3.22) can be proved by using the well-known Hurwitz criterion. So, by using the coefficients of the characteristic polynomial associated to (3.23), given by after straightforward calculation we obtain that all Hurwitz determinants are positive for any and . Indeed, by using the coefficients of the above characteristic polynomial we can construct the following Hurwitz determinant: Now we construct and calculate all Hurwitz determinants as follows:
According to Hurwitz criterion [27, 28], the system (3.23) is stable since all Hurwitz determinants are positive if and . Then, the matrix associated to (3.23) is a Hurwitz matrix and the equilibrium (, ) of (3.22) is uniformly asymptotically stable.

Case 2. In the case when the unknown parameter is time-varying, the stability analysis of the proposed indirect multivariable adaptive linearizing controller is carried out under the following realistic assumptions.(A1) The substrate concentrations and , the components of the dilution rate matrix , and the substrate feed rates are on-line measured. (A2) The substrate consumption rates and are fully unknown.(A3) The reference signal vector and its time derivative are piecewise continuous bounded functions of time, and the measured substrate feed rates are continuous bounded functions of time. (A4) The measurements of substrate vector, denoted , are corrupted by an additive noise vector : , for all .(A5) The components of time varying parameter vector are bounded as: , , , for all .(A6) The time derivatives of the components of are bounded as: , , , for all .(A7) The measurement noise vector is bounded as: , , , for all .(A8) The components of dilution rates matrix are known and bounded: , , , for all .
Under these assumptions, the parameter estimator (3.19) and the adaptive control law (3.21) are rewritten as follows:
From (3.17), (3.27), and (3.28) under the condition (A4), the following error system can be derived as follows: which can be rewritten in the following form:

Defining the state vector as with and , then (3.31) can be rewritten as: where , and:

The two eigenvalues of denoted by and are related to and as follows: , , . It can be seen that . The next assumption is considered for the estimator design parameters.(A9) The design parameters and are chosen such that has real distinct eigenvalues [6, 11], for example, , where , that implies .

The system (3.32) describes the dynamics of the estimation errors of the observer-based estimator including the observations of the measured substrates and the estimations of their unknown consumption rates .

We can consider that the estimator (3.27)-(3.28) is a set of quasi-independent second order linear systems because one controlled substrate concentration is associated to one unknown parameter of the vector only. Since the dynamics of estimation errors (3.32) is described also by a linear differential equation with a block diagonal matrix with two stable blocks, then, we can have the following stability result, which is an extension of the result presented in [6, 11]:

Theorem 3.3. Under assumptions (A1)–(A9), the estimation errors and are asymptotically bounded for all as follows:(i)(ii)and then the tracking error is bounded as follows:(iii)where , , , , and , are constant bounds which will be defined.

Proof. From assumptions (A6)–(A8), it follows that the input vector of the system (3.32) is bounded. Therefore, (3.32) behaves as a linear time-invariant differential system with a bounded input, whose time response is: where is the state transition matrix associated to defined as: with , , , . Since is a stable matrix, then the state is bounded (see [5, Lemma 3.3.5] and [6, Theorem A2.6]). A bound of each component of in (3.37) is given by: Then, taking the limit of the above expressions for and using Technical Lemma A2.2 from [6], we obtain the following inequalities: where and are the bounds of and , that is, and , , with and defined in Theorem 3.3. Thus, the boundedness of and given in (i) and (ii), respectively, is proven.
To prove (iii) we proceed as follows. We can see that the adaptive control law (3.29) with parameter estimator (3.27) and (3.28) applied to system (3.17) leads to the following dynamics of the closed-loop system: Since is a diagonal stable matrix, then from (3.41) it can be seen that the tracking error is the output of a linear stable filter driven by the observer error . From the first equation in (3.30) we can write: . Now, by using (3.35), and assumptions (A7) and (A8), the following inequalities can be written: From (3.41) and (3.42) one finds that:
From (3.43), after some straightforward calculation it can be obtained that and the proof is complete.

4. Simulation Results and Comments

The performance of the designed multivariable adaptive controller (3.9)–(3.13), by comparison to the exactly linearizing controller (3.3) (which yields the best response and can be used as benchmark), has been tested by performing extensive simulation experiments.

For a proper comparison, the simulations were carried out by using the process model (2.2)–(2.11) under identical and realistic conditions. The simulations were designed so that several set point changes on the controlled variables and occurred, nearby the operational point g/L, g/L.

The kinetic parameter values used in simulations are presented in Table 1 [21], and the initial values of variables considered in simulations in Table 2.

The system’s behavior was analyzed assuming that the dilution rates of the two feeding substrates and the influent enrichment factor act as perturbations of the form:

Also, one of the kinetic parameters—the maximum specific growth rate—is considered time varying:

The values of the estimator design parameters, chosen so that to satisfy the tuning conditions of assumption (A9), are: , , , , .

The behavior of the indirect adaptive controlled system by comparison to the behavior of closed loop system with exactly linearizing controller is shown in Figure 3, the time evolution of the two controlled variables and , respectively, and in Figure 4, the control inputs and , respectively.

In order to test the behavior of the indirect adaptive controlled system in more realistic circumstances, we considered that the measurements of both controlled variables ( and ) are corrupted with an additive white noise with zero average (5% from their nominal values). The simulation results in this case, conducted in the same conditions as in previous simulation, are presented in Figures 5 and 6, respectively. The simulation shows that the behavior of controlled variables and of control inputs is comparable with the results obtained in the free noise simulation.

The time evolution of the estimates of the unknown functions (3.6) provided by the observer-based estimator is presented in Figures 7 and 8, in both simulation cases.

From Figures 7 and 8, it can be noticed that the time evolution of estimates for noisy measurements of and is similar with the time profiles in free noise case.

The production of lactic acid can be evaluated by using the data provided by the asymptotic observer (3.15) and (3.16). The time evolution of the lactic acid concentration estimates in the two reactors is depicted in Figure 9.

From graphics in Figures 36 it can be seen that the behavior of overall system with indirect adaptive controller, even if this controller uses much less a priori information, is good, being very close to the behavior of closed loop system in the ideal case when the process model is completely known. Note also the regulation properties and ability of the controller to maintain the controlled outputs and very close to their desired values, despite the very high variations for , , , and , time variation of process parameters and the influence of noisy measurements.

In order to compare our proposed strategy with some classical control technique, several simulations were performed. As exemplification, Figures 10 and 11 present the outputs and control inputs for the case when a classical PI (proportional-integrative) control is used, with the best tuning of control parameters. As can be noticed, the behavior of the classical control is strongly influenced by the noisy measurements and by the variation of kinetic and process parameters.

5. Conclusion

This paper is concerned with the design of an indirect multivariable adaptive control for a lactic acid fermentation process that is carried out in a cascade of two stirred tank fermentation reactors.

The controller was achieved by assumption that the consumption rates of two limiting substrates are completely unknown and are summarized in two fully unknown time varying parameters which are estimated by means of appropriately observer-based estimators. A simple tuning method of kinetic estimator design parameters was achieved by stability and convergence analysis of the control scheme.

The simulation results showed that the performances of the proposed multivariable adaptive controller are very good. The derived control method can be applied also for a large class of square nonlinear bioprocesses.

Acknowledgment

This work was supported by CNCSIS-UEFISCSU, Romania, Project no. PNII-IDEI 548/2008.