`Journal of Applied MathematicsVolume 2012, Article ID 245315, 13 pageshttp://dx.doi.org/10.1155/2012/245315`
Research Article

## Optimal Control of a Fed-Batch Fermentation Involving Multiple Feeds

1School of Mathematics and Information Science, Shandong Institute of Business and Technology, Yantai 264005, Shandong, China
2School of Energy and Power Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
3School of Mathematical Science, Huaiyin Normal University, Huai'an 223300, Jiangsu, China

Received 19 May 2011; Accepted 14 November 2011

Copyright © 2012 Chongyang Liu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

A nonlinear dynamical system, in which the feed rates of glycerol and alkali are taken as the control functions, is first proposed to formulate the fed-batch culture of 1,3-propanediol (1,3-PD) production. To maximize the 1,3-PD concentration at the terminal time, a constrained optimal control model is then presented. A solution approach is developed to seek the optimal feed rates based on control vector parametrization method and improved differential evolution algorithm. The proposed methodology yielded an increase by 32.17% of 1,3-PD concentration at the terminal time.

#### 1. Introduction

1,3-propanediol (1,3-PD) possesses potential applications on a large commercial scale, especially as a monomer of polyesters or polyurethanes, its microbial production is recently paid attention to for its low cost, high production, and no pollution, and so forth. It is considered to be one of the bulk chemicals, which is likely to be produced by bioprocesses on large scales [1]. During the bioconversion of glycerol to 1,3-PD, the most efficient cultivation method appears to be a fed-batch culture which corrects pH by alkali addition for glycerol supply [2]. In the fed-batch cultivation process of glycerol bioconversion 1,3-PD, several factors influence the process state and govern the process behavior [3]. Along with the concentration of substrate, the process is influenced by the products of metabolism that accumulate in cultivation broth and cause an inhibition of cells’ growth. To maintain a suitable environment for cells’ growth, alkali is also intermittently added to the fermentor. Consequently, two control actions should be considered for modelling and optimal control the fed-batch cultivation process: the feeding with glycerol and the adding with alkali.

Optimal control of fed-batch culture by feed rates has received extensive attention [417]. Initially, the batch model is extrapolated to fed-batch cultivation by incorporating the dilution factors. Unstructured and nonsegregational models with specific rates of cell growth rate, metabolite production rate, and substrate consumption rate have been used to model fed-batch fermentation. The models have been used for optimal control studies by a number of researchers [7, 911]. Recently, assuming the feed of substrate only occurs at the impulsive instants, nonlinear impulsive systems [4] have been extensively investigated to formulate the fermentation process. Subsequently, the properties [5], parameter identification problem [12], and optimal control problem [4, 13] have been investigated. Nonetheless, since the feed rate of substrate is finite, it is not reasonable to describe the actual fed-batch fermentation process by the impulsive system. In contrast, taking the feed rate of substrate as a time-continuous process, a nonlinear multistage was proposed in [8]. The parameter identification problem [6] and optimal control problem [8] for the system are investigated. Moreover, regarding the fed-batch fermentation as switching between the batch process and the feed process, the switched systems and their optimal control are discussed in [1417]. Although the achieved results are interesting, the control action in the above nonlinear dynamical systems and optimal control problems only include the feed rate of the substrate.

Typically, a fed-batch process could have more than one control variable that need to be optimized. This leads to a fairly complex optimization problem when the controlled nonlinear system involving more than one control variables and physical constraints on state variables. In this paper, we propose a nonlinear dynamical system, in which the feed rates of glycerol and alkali are taken as the control functions, to describe 1,3-PD production in fed-batch cultivation process. To maximize the 1,3-PD concentration at the terminal time, a constrained optimal control problem is then presented. Incidently, there exist many methods to solve the feed rates optimization problem involving more than one feed rates, such as maximum principle of Pontryagin [18], Luus-Jaakola search method [19], and genetic algorithm [10]. However, these methods are all applied to the fed-batch process in which the substrates are fed to the fermentor continuously. In the actual fermentation, glycerol and alkali are intermittently fed into fermentor. As a result, the computation is more complex and it is necessary to develop a fast and robust algorithm to solve the complex-constrained optimal control problem. A solution approach is developed to seek the optimal feed rates of glycerol and alkali based on the control vector parametrization method and an improved differential evolution algorithm. Numerical results show that the concentration of 1,3-PD at the terminal time can be increased considerably compared with previous results.

The rest of the paper is organized as follows. The nonlinear dynamical system and constrained optimal control model in fed-batch fermentation process are formulated in Section 2. Section 3 develops a computational approach to solve the constrained optimal control model, while Section 4 illustrates the numerical results. Finally, conclusions are provided in Section 5.

#### 2. Problem Formulation

Based on the nonlinear dynamical system [6] and taking the feed rates of glycerol and alkali as the control functions, mass balances of biomass, substrate, and products in fed-batch culture can be formulated as where , is the state vector whose components represent the extracellular concentrations of biomass, glycerol, 1,3-PD, acetic acid, and ethanol at time in the fermentor, respectively. is the terminal time of the fermentation, and is a given initial state. is the control function whose components denote the feed rates of glycerol and alkali, respectively. is the switching instant such that . In particular, is the moment of adding glycerol, at which the fermentation process switches to continuous culture from batch culture, and denotes the moment of ending the flow of glycerol, at which the fermentation process jumps into batch culture from continuous culture, . Furthermore, for , for , In (2.3), denotes the initial concentration of glycerol in feed. is the dilution rate at time defined by In (2.5), is the initial volume of solution in the fermentor. On the basis of the previous work [20], the specific growth rate of cells is expressed by where is the maximum specific growth rate; is the Monod saturation constant; are the maximal residual substrate and products concentrations; and are the exponents for the substrate and products. The specific consumption rate of substrate is In (2.7), is the maintenance term of substrate consumption under substrate-limited conditions. is the maximum growth yield. is the maximum increment of substrate consumption rate under substrate-sufficient conditions. is the saturation constant for substrate. The specific formation rates , of 1,3-PD and acetic acid are defined as where are the maintenance terms of product formations under substrate-limited conditions; are the maximum product yields; are the maximum increments of product formation rates under substrate-sufficient conditions; are saturation constants for products. Moreover, the specific formation rate of ethanol can be described by in which , and are parameters for determination of yield of ethanol on glycerol.

Under anaerobic conditions at 37°C and pH 7.0, the critical concentrations for cells growth and the parameters in (2.6)–(2.9) are listed in Table 1.

Table 1: The parameters and the values of critical concentrations in the controlled nonlinear system (2.1).

Define where and , are identically equal to zero. , and are positive constants which denote the minimal and maximal rates of adding glycerol and alkali, respectively. Let be the class of all the measurable functions from into with .

There exist critical concentrations, outside which cells cease to growth, of biomass, glycerol, 1,3-PD, acetic acid, and ethanol. Hence, it is biologically meaningful to restrict the concentrations of biomass, glycerol, products, and the volume of culture fluid in a set defined as

For the system (2.1), we confirm that the system has a unique continuous solution on , denoted by , for each . Moreover, the solution is continuous in and is uniformly bounded on [21].

In fed-batch fermentation of glycerol bioconversion to 1,3-PD, controlling the feed rates of glycerol and alkali is to maximize the final 1,3-PD productivity. Therefore, the 1,3-PD concentration at the terminal time is taken as the cost functional, that is, where is the third component of the solution to the system (2.1). Furthermore, the control constraint (2.10) and the state constraint (2.11) should be satisfied.

Thus, a constrained optimal control model in the fed-batch fermentation can be formulated as follows.

#### 3. Computational Methods

In solving the optimal control problem, a particularly attractive technique variously proposed [22, 23] is the parametrization of the control vector into a number of intervals so as to result in an expression as that is, let the time subinterval be partitioned into subintervals with partition points denoted by In the above equation, are known trial functions that need to be chosen. is the value of the th control variable in th interval and is the coefficient that need to be determined from optimization. A number of trial functions based on the use of different basis functions have been used in various work. However, the choice of trial functions affects the evaluation of the exact optimization and needs to be carefully chosen. In this paper, we assume that each control variable in the control vector is approximated by a piecewise constant value in a particular interval , namely,

Let be the solution of the system (2.1) replacing the control function with . Furthermore, denote the set of the admissible parameterized controls by , namely, . Now, (COCP) can be approximated by the following parameter optimization problem

To solve (COCP) by the control vector parametrization method, we need to solve a sequence of problems . However, it is difficult to cope with the state constraints. To surmount these difficulties, let Then, the condition (2.11) is equivalently transcribed into where . However, is nonsmooth in . Consequently, standard optimization routines would have difficulties in dealing with this type of equality constraints. The following smoothing technique is to replace with , where In (3.7), is an adjustable parameter controlling the accuracy of the approximation. Note that is a smooth function in . The equality constraint (3.3) now can be approximated by

As a result, (COCP()) can be approximated by the following approximation problem as follows.

Then, the gradient of the constraint can be computed by the following theorem.

Theorem 3.1. For the constraint given in (3.9), it holds that its gradient with respect to parameterized control is where is the solution of the costate system with the boundary conditions

Proof. The proof can be completed using the method of Chapter  3 in [24].

On this basis, (COCP) can be solved by a sequence of approximation problems . Each of these is viewed as a smooth nonlinear mathematical programming problem solved by various optimization methods such as gradient-based techniques [23]. However, all those techniques are only designed to find local optimal solutions. Furthermore, in solving these , the evaluation of candidate feed rates is a computationally expensive operation because of solving the controlled nonlinear system (2.1). Consequently, finding the global optimum or a good suboptimal solution with traditional algorithms based on gradient method or nontraditional search and optimization techniques based on natural phenomenon such as genetic algorithm [25], evolution strategies [26], and simulation annealing [27] is too consuming, or even impossible within the time available.

Differential evolution (DE), a recent optimization technique, is an exceptionally simple and easy to use evolution strategy, which is significantly faster and robust at numerical optimization and is more likely to find a function’s true global optimum [28]. Differential evolution algorithm has been used in the recent past to solve many engineering optimization problem, see, for example, [29, 30]. When using any population-based search algorithm in general and DE in particular to optimize a function, an acceptable trade-off between convergence rate (with reference to locating optimum) and robustness (with reference to not missing the global optima) must generally be determined. To increase the convergence speed of DE without compromising with the robustness, a modified differential evolution (MDE) is developed to solve nonlinear unconstrained optimization problems encountered in chemical engineering [31]. Nevertheless, the is a nonlinear optimization problem with constraints in state and control parameters, which MDE can not be applied directly to solving it. Hence, the following strategies are added to the MDE [31]. (i)(Handling the control constraint). If there is bound violation for a parameter in the th individual at the th step, then that parameter is generated randomly between given lower and upper bound using the following equation: where is is the number of parameters. (ii)(Dealing with the continuous state constraint). For the parameter of the th individual at the th step, test the value of . If , then the parameter is feasible. Otherwise, that is, , move the parameter towards the feasible region in the direction of with Armijo line search. (iii)(Stopping criteria). The algorithm stops when any of the following conditions holds: (a)the maximal iteration is reached; (b)the maximal deviation between the group’s best fitness values in the last iterations is less than , where is a predefined constant.

Now, we can obtain an approximately optimal control for (COCP) as shown in the following algorithm.

Algorithm 1. Step 1. Choose initial value of .Step 2. Solve approximate problem using the improved MDE algorithm to give .Step 3. Set . If , where is a prespecified positive constant, go to Step 2. Otherwise go to Step 4. Step 4. If , where is a predefined positive constant, go to Step 5. Otherwise, go to Step 1 with increased to for each . Step 5. Construct from by (3.1) and stop.

The piecewise constant control obtained is an approximately optimal solution of (COCP).

#### 4. Numerical Results

The initial state, the initial volume of fermentor, the initial concentration of glycerol in feed, and the fermentation time are ,, , and , respectively. Fed-batch process begins at . The feeding moment and the feeding stopping moment , are determined by the experiment.

In order to save computational time, the fermentation process is partitioned into the first batch phase (Bat.Ph.) and phases I-IX (Phs.I-IX) according to the actual fermentation process. In each of Phs.I-IX, the same feeding strategy is adopted. Moreover, the durations of the feeding processes in Phs. I-IX are 5, 7, 8, 7, 6, 4, 3, 2, 1 seconds in each 100 seconds, leaving 95, 93, 92, 93, 96, 97, 98, and 99 seconds for batch cultures, respectively. It should be mentioned that this approach had been adopted to obtain the experimental data [12]. In addition, the bounds of feed rates of glycerol and alkali in Phs.I-IX are listed in Table 2.

Table 2: The bounds of feed rates in Phs.I-IX.

In the improved MDE algorithm, the number of populations , the maximal iteration , and the parameters , , , , , are, respectively, 86, 300, 0.5, 0.9, 10, , 0.1, and . The specified constant in Algorithm 1 is 1. These parameters are derived empirically after numerous experiments.

Applying Algorithm 1 to the optimal control model, we obtain the optimal feed strategies of glycerol and alkali. Here, the computational process is coded using Microsoft Visual C++ on PC with Intel Core 2 Duo CPU, 2.93 GHz RAM. Especially, the ODEs are numerically calculated by the improved Euler method with the relative error tolerance . The optimal feed rates of glycerol and alkali are plotted using MATLAB R2010a in Figure 1. To show the feed rates of glycerol and alkali in the feeding processes for Ph. I to Ph. IX better, 9 small subfigures are also incorporated in Figure 1, respectively. Under the obtained optimal feed rates, the computational concentration of 1,3-PD at the terminal time is which is increased by 32.17% in comparison with experimental result . In particular, the concentration change of 1,3-PD with respect to fermentation time under the optimal feed rates of glycerol and alkali is shown in Figure 2. From these curves in Figure 2, we conclude that 1,3-PD concentration at the terminal time in this paper is actually higher than the one previously reported.

Figure 1: The optimal feed strategies of 1,3-PD and alkali in fed-batch fermentation process.
Figure 2: The concentration changes of 1,3-PD with respect to fermentation time.

#### 5. Conclusions

Taking the feed rates of glycerol and alkali as the control functions, a nonlinear dynamical system was proposed to describe a fed-batch fermentation. A constrained optimal control model involving the nonlinear dynamical system was then presented to maximize the concentration of 1,3-PD at the terminal time. Based on the control vector parametrization method and the improved MDE algorithm, a computational method was developed to seek the optimal solution of the optimal control model. Numerical results verified the validity of the mathematical model and the effectiveness of the computational method.

#### Acknowledgments

This paper is supported by the Shandong Province Natural Science Foundation of China (Grant no. ZR2010AQ016 and Grant no. ZR2011AL003), the Natural Science Foundation for the Youth of China (Grant no. 11001153), and the TianYuan Special Funds of the National Natural Science Foundation of China (Grant no. 11126077).

#### References

1. K. Menzel, A. P. Zeng, and W. D. Deckwer, “High concentration and productivity of 1,3-propanediol from continuous fermentation of glycerol by Klebsiella pneumoniae,” Enzyme and Microbial Technology, vol. 20, no. 2, pp. 82–86, 1997.
2. A. P. Zeng and H. Biebl, “Bulk chemicals from biotechnology: the case of 1,3-propanediol production and the new trends,” Advances in Biochemical Engineering/Biotechnology, vol. 74, pp. 239–259, 2002.
3. A. P. Zeng, A. Ross, H. Biebl, C. Tag, B. Gunzel, and W. D. Deckwer, “Multiple product inhibition and growth modeling of Clostridium butyricum and Klebsiella pneumoniae in glycerol fermentation,” Biotechnology and Bioengineering, vol. 44, no. 8, pp. 902–911, 1994.
4. C. Gao, E. Feng, Z. Wang, and Z. Xiu, “Nonlinear dynamical systems of bio-dissimilation of glycerol to 1,3-propanediol and their optimal controls,” Journal of Industrial and Management Optimization, vol. 1, no. 3, pp. 377–388, 2005.
5. C.-X. Gao, K.-Z. Li, E.-M. Feng, and Z.-L. Xiu, “Nonlinear impulsive system of fed- batch culture in fermentative production and its properties,” Chaos Solitons Fractals, vol. 28, pp. 271–277, 2006.
6. Z. Gong, “A multistage system of microbial fed-batch fermentation and its parameter identification,” Mathematics and Computers in Simulation, vol. 80, no. 9, pp. 1903–1910, 2010.
7. H.-C. Lim and K.-S. Lee, “Control of bioreactor systems,” in Biotechnology, K. Schugerl, Ed., vol. 4 of Measuring, Modelling and Control, pp. 506–560, VCH, Weinhelm, Germany, 1991.
8. C. Liu, “Optimal control for nonlinear dynamical system of microbial fed-batch culture,” Journal of Computational and Applied Mathematics, vol. 232, no. 2, pp. 252–261, 2009.
9. H. J. Oberle and B. Sothmann, “Numerical computation of optimal feed rates for a fed-batch fermentation model,” Journal of Optimization Theory and Applications, vol. 100, no. 1, pp. 1–13, 1999.
10. D. Sarkar and J. M. Modak, “Optimization of fed-batch bioreactors using genetic algorithm: multiple control variables,” Computers and Chemical Engineering, vol. 28, no. 5, pp. 789–798, 2004.
11. H. S. Shin and H. C. Lim, “Maximization of metabolite in fed-batch cultures. Sufficient conditions for singular arc and optimal feed rate profiles,” Biochemical Engineering Journal, vol. 37, no. 1, pp. 62–74, 2007.
12. G. Wang, E. Feng, and Z. Xiu, “Modeling and parameter identification of microbial bioconversion in fed-batch cultures,” Journal of Process Control, vol. 18, no. 5, pp. 458–464, 2008.
13. H. Wang, E. Feng, and Z. Xiu, “Optimality condition of the nonlinear impulsive system in fed-batch fermentation,” Nonlinear Analysis: Theory, Methods & Applications, vol. 68, no. 1, pp. 12–23, 2008.
14. C. Liu, Z. Gong, and E. Feng, “Modeling and optimal control of a nonlinear dynamical system in microbial fed-batch fermentation,” Mathematical and Computer Modelling, vol. 53, no. 1-2, pp. 168–178, 2011.
15. C. Liu and E. Feng, “Optimal control of switched autonomous systems in microbial fed-batch cultures,” International Journal of Computer Mathematics, vol. 88, no. 2, pp. 396–407, 2011.
16. J. Ye, E. Feng, H. Yin, and Z. Xiu, “Modelling and well-posedness of a nonlinear hybrid system in fed-batch production of 1,3-propanediol with open loop glycerol input and pH logic control,” Nonlinear Analysis: Real World Applications, vol. 12, no. 1, pp. 364–376, 2011.
17. Z. Gong, C. Liu, E. Feng, L. Wang, and Y. Yu, “Modelling and optimization for a switched system in microbial fed-batch culture,” Applied Mathematical Modelling, vol. 35, no. 7, pp. 3276–3284, 2011.
18. D. Levišauskas, V. Galvanauskas, R. Simutis, A. Žilinskas, and J. Žilinskas, “Optimization of biomass production in fed-batch culture by feed and dilution control actions,” Information Technology and Control, vol. 35, no. 4, pp. 383–388, 2006.
19. R. Luus and D. Hennessy, “Optimization of fed-batch reactors by the Luus-Jaakola optimization procedure,” Industrial and Engineering Chemistry Research, vol. 38, no. 5, pp. 1948–1955, 1999.
20. Z.-L. Xiu, A.-P. Zeng, and L.-J. An, “Mathematical modelling of kinetics and research on multiplicity of glyceroll bioconversion to 1,3-propanediol,” Journal of Dalian University of Technology, vol. 4, pp. 428–433, 2000.
21. D.-K. Arrowsmith and C.-M. Place, Ordinary Differential Equations, Chapman and Hall, London, UK, 1982.
22. W.-H. Ray, Advanced Process Control, McGraw-Hill, New York, NY, USA, 1981.
23. K.-L. Teo, C.-J. Goh, and K.-H. Wong, A Unified Computational Approach to Optimal Control Problems, Long Scientific Technical, Essex, UK, 1991.
24. A. Bryson and Y.-C. Ho, Applied Optimal Control, Halsted Press, New York, NY, USA, 1975.
25. J.-H. Holland, Adaptaion in Natural and Artificial Systems, The University of Michigan Press, Ann Arbor, Mich, USA, 1975.
26. H.-P. Schwefel, Numerical Optimization of Computer Models, John Willey & Sons, New York, NY, USA, 1981.
27. S. Kirkpatrick, C. D. Gelatt, Jr., and M. P. Vecchi, “Optimization by simulated annealing,” American Association for the Advancement of Science. Science, vol. 220, no. 4598, pp. 671–680, 1983.
28. K. Price and R. Storn, “Differential Evolution—a simple evolution strategy for fast optimization,” Dr Dobb's Journal, vol. 22, pp. 18–24, 1997.
29. J. P. Chiou and F. S. Wang, “Hybrid method of evolutionary algorithms for static and dynamic optimization problems with application to a fed-batch fermentation process,” Computers and Chemical Engineering, vol. 23, no. 9, pp. 1277–1291, 1999.
30. F. S. Wang and C. H. Shyu, “Optimal feed policy for fed-batch fermentation of ethanol production by Zymomous mobilis,” Bioprocess Engineering, vol. 17, no. 2, pp. 63–68, 1997.
31. B. V. Babu and R. Angira, “Modified differential evolution (MDE) for optimization of non-linear chemical processes,” Computers and Chemical Engineering, vol. 30, no. 6-7, pp. 989–1002, 2006.