Abstract

A model of a waste water treatment plant is investigated. The model is described by a nonlinear system of two differential equations with one bounded control. An optimal control problem of minimizing concentration of the polluted water on the given time interval is stated and solved analytically with the use of the Pontryagin Maximum Principle and Green's Theorem. Computer simulations of a model of an industrial waste water treatment plant show the advantage of using our optimal strategy. Possible applications are discussed.

1. Introduction

The activated sludge process (ASP) is a biochemical process for treating sewage and industrial waste water that uses air (or oxygen) and microorganisms to biologically oxidize organic pollutants, producing a waste sludge (or floc) containing the oxidized material. In general, an activated sludge process has an aeration tank where air (or oxygen) is injected and thoroughly mixed into the waste water and a settling tank (usually referred to as a “clarifier” or “settler”). Flocculation-agglomeration is a process where a solute comes out of solution in the form of floc or flakes. Part of the waste sludge is recycled to the aeration tank where the remaining waste sludge is removed for further treatment and ultimate disposal. A diagram of the process is shown in Figure 1.

The optimal operation of the waste water processes with biological treatment is challenging because of the strong effluent requirements, the complexity of these processes as an object of control, and the need to reduce the operation cost [1].

During the last 30 years various control strategies for the ASP have been developed [2, 3]. Establishing optimal working conditions and control strategies is frequently accomplished with the aid of mathematical models [1, 47]. Relevant work in the investigation and comparison of control strategies was done by [813]. Obviously, the solution depends on the model. What unites all these papers is that either the considered models are so complex that they cannot be solved analytically or that the controls are not bounded and therefore the realism of the model is questionable. The model proposed in [4] is simple enough that it can be investigated analytically. On the other hand, it properly corresponds to the main steps of the ASP and water cleaning control process. In [4] an optimal control problem of the minimization of the waste concentration in the ASP was stated and the Pontryagin Maximum Principle [14] was offered for its solution. However, the complete analysis of the corresponding boundary value problem for the Maximum Principle was not conducted. The author simply offered a numerical solution to the problem at different piecewise constant controls.

The traditional method for solution of optimal control problems is the Pontryagin Maximum Principle (PMP). Moreover, there exist optimal control problems, for which the PMP gives a complete analytical solution. It occurs when the two-point boundary value problem for the Maximum Principle has a unique solution, or when the PMP is not only a necessary, but also a sufficient optimality condition [15]. There exist other optimal control problems, for which the approach based on Green's Theorem is an effective tool for obtaining the complete analytical solutions [16, 17]. In [7] there is an example of such an optimal control problem.

In practical applications one has to take into account the presence of several perturbations, which may degrade the performance of obtained optimal control law. For example, the parameters of the model may not be precisely known. The evolution of the model may be affected by random external perturbations. At last, the state variables of the model may not be accurately measured. Therefore, it is important to design a robust feedback optimal control, which still accomplishes the desired task in the presence of appointed perturbations. Different approaches to the solution of this problem for the ASP are considered in [7, 1824].

The optimal control problem stated in [4] does not fit either the first or the second types of the optimal control problems. In fact, on one hand, using the PMP shows a possibility of the existence of singular arcs at corresponding optimal trajectories [25]. The presence of them greatly complicates the analytical analysis of the considered problem. On the other hand, using the approach based on Green's Theorem proves the absence of singular arcs at optimal trajectories. Simultaneously, this approach overestimates the number of switchings of optimal controls. Lastly, only a combination of results from these different approaches allows us to solve the considered optimal control problem analytically.

Our paper deals with the complete analysis of the model and its corresponding optimal control problem proposed by [4]. It is organized as follows. In Section 2, we discuss the model. In Section 3, we state optimal control problem of minimizing water pollution concentrations on a given time interval. In Section 4, we establish properties of the state variables. Then we find optimal solutions of the considered problem in two stages. At first, in Section 5 we investigate the optimal control problem using the Pontryagin Maximum Principle. Then, in Section 6 we apply to the considered problem the approach based on Green's Theorem. As a final result of these investigations we obtain possible types of optimal solutions. They allow us in Section 7 to reduce the optimal control problem to problem of the finite dimensional optimization. The last problem is solved numerically. A numerical simulation of the ASP for different parameters of the model is conducted in Section 8. Finally, Section 9 presents our conclusions.

2. The Model

Let us consider the model of an activated sludge process. A simplified diagram can be shown in Figure 2.

The process has a reaction tank and a settling tank. Polluted water is introduced into the reaction tank at rate and concentration . Simultaneously, the reaction tank receives biomass at a rate with concentration . Once in the reaction tank, biomass feast on contaminants. The less-polluted water now leaves the reaction tank and proceeds to a filter. The growth rate of the biomass is assumed to be of the Michaelis-Menten type. Flocculation-agglomeration allows a solute to come out of solution in the form of flock or flakes. Part of the waste sludge is recycled to the aeration tank where the remaining waste sludge is removed for further treatment.

This process can be described by the following system of differential equations:

Here is the concentration of biomass, is the concentration of polluted water, is the substrate utilization-yield coefficient, is the maximal-specific rate of bacteria growth, the saturation coefficient.

We consider the value as a control function and the set is the set of all Lebegue measurable functions such that for almost all . The recycle sludge rate is not allowed to take values below a certain lower limit in order to prevent the biomass from being swept out of the aeration tank. An upper limit for is given by the limited power of the recycle pump.

For the model (1) assume . This case is realistic since one normally tries to keep the substrate-to-biomass ratio comparatively low. Denoting the simplified system can be written as

Numerical modeling conducted in [4] shows that the second term in the first equation of (2) can be ignored. Finally we obtain the following system: This model will be considered further.

3. Optimal Control Problem of Minimizing Pollution Concentration on a Given Time Interval

Let be the pollution concentration at moment . For system (3) we will consider an optimal control problem of minimizing the total concentration of pollution over the time interval . The problem can be written as

Let us rewrite the problem (3), (4) in the form, which is more convenient for the subsequent analysis. For this we will use the following substitutions of the state variables: and the control . Moreover, we denote .

Further, instead of the set we will consider the set , which consists of all Lebegue measurable functions such that the inequalities are valid for almost all . Here , .

Then problem (3), (4) can be rewritten as the following optimal control problem: where , .

The existence of the optimal control and its corresponding optimal solutions , for the optimal control problems (7), and (8) follows from [26].

4. Properties of the State Variables

We have the following statement, which can be easily proven using direct integration of the system (7).

Lemma 1. Let be some control function. Then there exist corresponding to this control, , solutions , to the system (7), which on the closed interval satisfy the inequalities

Analyzing system of (7) with the use of Lemma 1 we can conclude that if at some moment of time we have that , then By analogy if at some moment we have , then from (6) we obtain relationship The validity of these relationships leads to the following statement.

Lemma 2. Let be some control function. Suppose that at some moments of time the following relationships hold: then one has for any and for any .

From results of Lemma 2 the following statement is true.

Lemma 3. Let be some control function. Suppose that at some moments of time the following relationships hold: then one has for any and for any .

Moreover, we have the statement.

Lemma 4. Let be some control function. Suppose that at some moments of time the following relationships hold: then one has inequalities respectively.

The validity of Lemma 4 follows from the relationships (6), and (7).

5. Pontryagin Maximum Principle

In order to solve the optimal control problems (7), and (8) at first we will apply the Pontryagin Maximum Principle [14, 15]. For the optimal control and corresponding optimal trajectories , there exist nontrivial solutions , of the adjoint system for which the control is given by where is the switching function. As it follows from (17), the function determines the type of the optimal control .

Systems of (7), (16) and relationships (17) form the two point boundary value problem for the Maximum Principle. Let us study this problem.

For the functions , the following statement is true.

Lemma 5. Let be the optimal control, and are optimal trajectories and , are the solutions of the adjoint system (16) corresponding to them. Then the following inequalities hold: for all .

The proof of this statement is based on integration of the system (16) with the use of Lemma 1.

Using equations of the systems (7), and (16) let us find the derivative of the switching function . We have the expression

Now, let us study the properties of the optimal control . The following statements are true.

Lemma 6. There exists such time that for the optimal control the equality is valid for all .

Proof. For the switching function from the terminal conditions of the system (16) and formulas (18), and (20) we have that From Lemma 1 we obtain the inequality . Since is continuous function, there exists value such that for all . Furthermore, from (17) we have for .

Lemma 7. Let there exists such moment of time that . Then for the optimal control the relationship holds for all .

Proof. From results of Lemmas 1, 2, and 5 for the switching function the inequality is true for all . Therefore, the desired result follows from (17).

Corollary 8. If , then for the optimal control the relationship holds for all .

From Lemma 7 it immediately follows that if the optimal trajectory gets into the region then the corresponding optimal control takes value .

Therefore, the following investigations will be conducted under the condition .

Let us strengthen the result from Lemma 7. We have the statement.

Lemma 9. Let for the optimal trajectories , there exists a moment of time such that . Then the positive value exists so that for the corresponding optimal control the relationship holds for all .

The validity of this fact follows from the inequality , the continuity of the switching function , and the formula (17) for the optimal control .

From this statement we have the existence of the region located in the set and attached from the right to the set , in which the optimal control also takes value . At Figure 3 this region is shown hatched.

6. Green's Theorem

For the subsequent analysis of the optimal control problems (7), and (8) we will use the approach, based on the applying of Green's Theorem [16, 17].

Following from arguments in [16], at first we will conduct auxiliary investigations.

For all we consider the function:

Let us study the curve . We have the following function We see that it is defined only by , where

Moreover, the relationships hold

Note that for the derivatives , of the function at we have the expressions

Then the function is decreasing and concave up. The graph of this function and the allocation of signs of the function are shown in Figure 4.

For the curve we have the following statement.

Lemma 10. In the region there are no interval and values of control such that the curve is a trajectory of the system (7). Moreover, if there exists a moment of time such that for the trajectories , of the system (7), corresponding to the control , the equality is valid, then the following inequalities hold:

Proof. It is sufficient to show the validity of inequalities (29). The first inequality follows from Lemma 4. In order to prove the second inequality we substitute the function into the second equation of the system (7). After necessary transformations we find the expression The statement is proven.

Remark 11. Lemma 10 is valid for the optimal control and its corresponding optimal trajectories , , .

Now, for all for which we consider the function

Let us study the curve . We have the following function: We see that it is defined only by , where

Moreover, the relationships hold where .

Note that for the derivatives , of the function at we have the expressions

Therefore, the function is decreasing and concave up. The graph of this function and the allocation of signs of the function are shown in Figure 5.

For the curves , we have the following statements.

Lemma 12. In the region the curves , have no common points.

The validity of this fact follows from the easily checked inequality and the properties of the functions , obtained above.

Lemma 13. In the region there are no interval and values of control such that the curve is a trajectory of the system (7). Moreover, if there exists a moment of time such that for the trajectories , of the system (7), corresponding to the control , the equality is valid, then the following inequalities hold:

Proof. It is sufficient to show the validity of inequalities (36). The first inequality follows from Lemma 4. In order to prove the second inequality we substitute the function into the second equation of the system (7). After necessary transformations we find the expression The statement is proven.

Remark 14. Lemma 13 is valid for the optimal control and its corresponding optimal trajectories , , .

Next, using the preceding properties of the functions , we conduct the arguments, which are similar to the arguments presented in [16]. One of these arguments is the use of Green's Theorem. In this way, we establish the validity of the bang-bang principle for the optimal control problems (7), and (8).

Theorem 15. Let be the optimal control, and , are its corresponding optimal trajectories in the problems (7), and (8). Then at every moment of time , for which in the region the relationships hold the control takes only values and .

Now, using the definitions of the sets , and results from Lemmas 7, 10, and 13 we will strengthen Theorem 15. As a result, we will formulate the final statement about the type of the optimal control .

Theorem 16. At the problems (7), and (8) the optimal control is the piecewise constant function, which takes only values and .

Next, we study the question about the number of switchings of the optimal control .

At first, we note that as it follows from Lemma 7, if the optimal trajectory gets into the region , then the corresponding optimal control has no switchings and takes only value .

Now, let us consider the region . We conduct the arguments, which are similar to the arguments presented in [16]. As in Theorem 15 one of these arguments is the use of Green's Theorem. In this way, we obtain the following statements.

Lemma 17. Let be the optimal control, and , are its corresponding optimal trajectories in the problems (7), and (8). Suppose there exists such interval , on which the following inequalities hold: Then on this interval the control takes either the constant value from , or it has the moment of switching , for which

Lemma 18. Let be the optimal control, and , are its corresponding optimal trajectories in the problem (7), (8). Suppose there exists such interval , on which the following inequalities hold: Then on this interval the control takes either the constant value from , or it has the moment of switching , for which

Lemma 19. Let be the optimal control, and , are its corresponding optimal trajectories in the problems (7), and (8). Suppose there exists such interval , on which the following inequalities hold: Then on this interval the control takes either the constant value from , or it has the moment of switching , for which

Lemma 20. Let there exists the moment of time such that for the optimal trajectories , the equality is valid. Then the value is not the moment of switching for the corresponding optimal control .

From Lemmas 1719 we make the following conclusion.

Corollary 21. Let be the optimal control, and , are its corresponding optimal trajectories. Let one suppose that is the interval of the maximum length, on which the functions , are sign defined. Then on this interval the control is piecewise constant function with values from , which has at most one moment of switching.

The possible types of switchings of the optimal control in dependence on signs of the functions , are presented by Lemmas 1719.

Let us introduce the sets It is clear that . Sets , , are shown in Figure 6.

Summarizing the preceding arguments we conclude the following.

If the optimal trajectory gets into the region (higher than the curve ), then the corresponding optimal control is either constant with values from , or it has the switching from to .

If the optimal trajectory gets into the region (between the curves and ), then the corresponding optimal control is either constant with values from , or it has the switching from to .

If the optimal trajectory gets into the region (to the left of the curve and to the right of the line ), then the corresponding optimal control is either constant with values from , or it has the switching from to .

All these situations for the optimal trajectory are shown in Figure 7.

Now, let us strengthen Lemma 19. We have the statement.

Lemma 22. Let be the optimal control, and , are its corresponding optimal trajectories. Suppose that on the some interval the trajectory gets into the region . Then on this interval the control is the constant function with value .

Proof. Let us assume the contradiction. Then from Lemma 19 it follows that the optimal control has the moment of switching , for which the equalities (44) hold.
Next, we consider two possible cases.
Case 23. For the trajectory the inclusion is valid. Then from Lemma 6 it follows the existence of the interval , , on which the control takes value . Therefore, on the interval there exists the moment of time , in which the switching of the control from to occurs. This fact contradicts Lemma 19.Case 24. For the trajectory the inclusion is valid. From Lemmas 6 and 7 we again have the existence of the interval , , on which the control takes value . Moreover, the inclusion is true. Therefore, as in the previous case, on the interval there exists the moment of time , in which the switching of the control from to occurs. This fact again contradicts Lemma 19.
Finally, we have the contradiction. Our assumption is wrong. The control is constant on the interval with values from .
Using analogues arguments we conclude that the control does not take value . Then the optimal control on the interval takes only value . This completes the proof.

Now, for the optimal trajectory we analyze into the regions , , , the possible mutual dispositions of the initial point and the final point , comparing the results from Lemmas 17, 18, 20, and 22. Based on such analysis we obtain the possible types of the corresponding optimal control .

Theorem 25. For the problem (7), (8) the optimal control is either a constant function
or a piecewise constant function with one switching where is the moment of switching, or a piecewise constant function with two switchings where is the moments of switching.

7. Solution of the Optimal Control Problem

We will conduct the subsequent solution of the optimal control problems (7), and (8) in the following way.

Let us introduce the set

Next, for any point we define the control of the type

It is easy to see that the control includes all possible types (49)–(51) of the optimal control from Theorem 25 at the corresponding values of switchings , .

Next, we substitute the control into equations of the system (7) and integrate it on the interval . Then we substitute the corresponding formula for the function into the objective function (8).

Hence, we have the function of two variables

Therefore, the optimal control problems (7), and (8) can be restated as a problem of the finite dimensional optimization The methods of the numerical solution of the problem (55) are well developed [27, 28].

8. Computer Simulation

Our theoretical results obtained in the previous sections allow us to select an optimal successful strategy of ASP. In [4] parameter estimation and verification of the model measurement values from a waste water plant were obtained for every hour of an operating period of one week.

Values of will be determined by total organic carbon content in the influent and by the concentration of the suspended solid in the aeration tank.

Let us show our results for the following model parameters:

The optimal control has the type (50) with one moment of switching at hours, which was obtained numerically. So, if we select such optimal policy , then the concentration of the polluted water will be minimized on the interval , where is final operation time (see Figure 8).

9. Conclusions

Activated sludge process involves complex and subtle relationships among a relatively large number of variables. The model investigated in our paper is not intended to be the best ASP model. However, it is nonlinear and it has a bounded control, which makes it quite interesting from the mathematical point of view.

We found the type of optimal control by means of the combination of the Pontryagin Maximum Principle and Green's Theorem. This allowed us to reduce a complex optimal control problem (7), (8) to one of finite dimensional optimization (55).

Our mathematical investigation of the activated sludge process can be summarized by the following components:(1)Complete investigation of a model (7) of the activated sludge process with one bounded control and its corresponding optimal control problem.(2)Development of an optimal control strategy for the recycle flow rate analytically.(3)Computer simulation of the controlled activated sludge process for different model parameters.

Finally, it should be noted that the ideas presented in this study can be applied to other control systems with similar properties.

Acknowledgment

The authors thank Dr. Paul Deignan for his helpful suggestions and style recommendations.