191
Views
0
CrossRef citations to date
0
Altmetric
Electrical & Electronic Engineering

Dynamic programming strategy in optimal controller design for a wind turbine system

ORCID Icon, ORCID Icon &
Article: 2340212 | Received 02 Aug 2022, Accepted 03 Apr 2024, Published online: 17 Apr 2024

Abstract

In this article, an optimal controller is proposed to extract maximum wind energy from the available wind speed. The very fluctuating nature of wind speed has made the process of extracting wind energy complicated. To extract and optimize such a complicated system, a dynamic programming-based optimal control approach is well suited to non-linear wind turbine system models and restrictions. The performance of this control method is tested via MATLAB software. The outcomes of the system have a 7 up to 8.5 tip speed ratio optimal value and the aerodynamic efficiency has a 0.411 conversion value. With the proposed controller, the energy captured is improved by 13.841% and 1.15% for piecewise step input and randomly generated wind speed respectively compared to standard torque control. The lower percentage improvement, in this case, is due to the limited range of the wind speed value given for the simulation. Generally, the optimal control method is globally maximizing wind energy capture for each time step via forward and backward recursion of dynamic programming rather than normal torque control.

1. Introduction

Wind turbine capacity has expanded dramatically over the last few decades, from a few tens of KW to today’s multi-MW level (Srivastava et al., Citation2021). Advanced generators, advanced power converter systems, and control solutions must be developed to make wind turbine units better suitable for power grid integration due to the continuous growth in the power level of wind turbines and their higher penetration into the power grid (Jiao et al., Citation2019). The kinetic energy of the wind is transformed into usable electrical energy by rotating machinery known as a wind turbine. By allowing the rotor speed to adapt to changes in wind speed, variable speed operation was created to increase aerodynamic efficiency in the partial load region. This method reduces drive train strain, making it the most recent trend in wind energy conversion (Santosh Kumar & Suresh Kumar, Citation2018). The main goal of a wind turbine system operating at half load is to track the maximum aerodynamic power coefficient to absorb as much wind energy as possible. Such power coefficients have been tracked using a variety of control techniques. Standard torque control is one of the control algorithms. It maximizes wind energy capture based on the global maximum assumption of the aerodynamic power coefficient. These controllers presume that the global maximum power coefficient is always known, despite their high performance and simplicity of use. Unfortunately, not all wind turbine systems fit this assumption, especially when generator speeds are constrained by demands for extended service lives and inexpensive electrical components (Aittaleb, Citation2020; Apata & Oyedokun, Citation2020). To maximize wind power generation under these circumstances, the optimal controller must be applied. These control techniques can be used to direct the behavior of wind turbines in the future based on a nonlinear turbine model, variation of wind speed. It uses deterministic dynamic programming algorithm to convert an optimal control problem into a discrete optimization problem with constrained. This algorithm optimize wind turbine variables such as turbine rotor speed trajectory, tip speed ratio, pitch angle, generator input torque, and aerodynamic efficiency by preceding forward in time and evaluates the optimal energy capture at every node in the discretized state-time space by proceeding backward in time. In this study, the effectiveness of maximizing energy capture from available wind speed and dynamic wind conditions is demonstrated by comparing the suggested control strategy to standard torque control, in MATLAB simulation. The article contribution is to clearly show the performance of the proposed strategy in relative to the conventional torqe control methods. The next parts of this article are comprised of five sections; wind turbine aerodynamics, optimal control, dynamic programming, result and discussion, and conclusion.

2. System modelling

2.1. Wind turbine aerodynamics

Betz’s law illustrates the theoretical maximum power that can be obtained from the wind. The extracted power can be given by Cortes-Vega et al. (Citation2021) and Coelho (Citation2022) (1) Pextract=12ρπR2Va+Vb2(Vb2Va2)(1) where pextract (power extract) is the maximum power that can be obtained from the wind, va is the wind speed after passing through the turbine, vb  is the wind speed before passing through the turbine. ρ, R are the air density and radius of the blade respectively.

Then the efficiency can be calculated as Cortes-Vega et al. (Citation2021) (2) efficiency=Pextract Pwind  (2) where, (3)  Pwind=12ρπR2Vb3(3)

In Afanasieva et al. (Citation2018), the dynamics of the wind turbine can be represented by the following equation, assuming the drivetrain is stiff and its energy loss is minimal: (4) ω̇=1Jr(τaeroτc)(4) where Jr is the combined rotational inertia of the rotor, gearbox, generator, and shafts,  τaero is aerodynamic torque, which drives the turbine, and τc  is the reactive torque (Cortes-Vega et al., Citation2021). (5) τaero=Pcapωr(5) Pcap  depicts the wind energy gathered. The aerodynamic power coefficient (Cp) establishes the relationship between the captured wind power Pcap  and the available wind power (Pwind). This coefficient indicates how well wind energy is converted into mechanical energy. It is characterized by (6) Cp=PcapPwind(6)

Finally, the aerodynamic power coefficient is developed as in EquationEquation (7). (7) Cp=C1(C2λiC3βC4)eC5λi(7) where, (8) λi=1λ+0.08β0.035β3+1(8)

The value from C1 to C6 and x are constant and given in .

Table 1. Value of aerodynamic power coefficient (Cortes-Vega et al., Citation2021).

The reactive torque: (9) τc=τgNg(9) where τg the turbine generator torque and Ng the gearbox ratio defined as generator shaft speed over the wind turbine rotor speed  (wr).

By combining the above equation, the dynamics of wind turbines can be derived: (10) ẇ=1Jr(π8Dr2ρCpvw3wrτgNg)(10) (11) τg=(π2R2ρCp(λ,β)vw3wrJrdwdt)/Ng(11)

The total wind energy captured over a time interval can be calculated as; (12) Ecap=t0tfPcapdt=t0tfPwind.Cp dt=π8ρDr2.t0tfvw3.Cpdt(12)

The graph in is a two-dimensional plot of Cp as a function of λ (tip speed ratio) and (pitch angle). Each Cp curve represents a distinct value of β. The dashed blue curve is made up of several segments that represent the highest conceivable values of Cp between λ and β. Each segment may correspond to a different β depending on the value of λ.

Figure 1. Cp versus TSR with different pitch angles.

Figure 1. Cp versus TSR with different pitch angles.

The plot shows that a pitch angle of 15°–25° produces the maximum achievable power coefficient at low values of λ, that is, λ < λ1 (L1). For high values of λ, that is, λ > λ2 (L2), achievable maxima of Cp are generated by pitch angles of 1° or 2°. For the range of λ between λ1 and λ2 all of the achievable maxima of Cp are on the 0° pitch angle curve, including the global maximum of Cp. Due to constraints governed by the rotor speed and wind speed, the global maximum of Cp is not always achievable. In this instance, achieving the highest attainable Cp requires the best tuning of pitch angle (β). The magnitude of the power grows together with the wind speed. The relationship between wind-generated mechanical energy and rotor speed for three different wind speeds—10, 11, and 12 m/s—is shown in . Maximizing wind energy capture is equivalent to improving the integral term in EquationEquation (12). For the case of steady-state operation, Cp should be maintained as its global maximum value to maximize the wind energy capture. However, the transient of the turbine may cause it to fall into any zone of Cp as illustrated in , due to the variation in wind speed or the constraint on rotor speed.

Figure 2. Mechanical power versus rotor speed for different wind speeds.

Figure 2. Mechanical power versus rotor speed for different wind speeds.

3. Controller design

3.1 Optimal controller design

The STC control approach depends on global maximum power coefficient. It assumes that global maximum power coefficient ((cp)max) knowledge is always obtainable. The turbine generator torque is controlled in this approach using a feedback control law (Doekemeijer et al., Citation2019), which is stated as follows. (13) τc=τgNg=kτωr2(13) where (14) kτ=12ρairπRr5(cp)maxλ*3=12ρairπRr5cp(λ*,β*λ*3(14)

When substituting this in EquationEquation (10), the model has the following forms. (15) ω·=12JrρairπRr5ωr2[Cpλ3(Cp)maxλ*3](15)

The control law in EquationEquation (13) causes the turbine to accelerate toward the desired set point when the rotor speed is too slow and to decelerate when it is too fast. This generator torque control law will, therefore, in steady-state conditions, balance the aerodynamic and load torques to control the turbine speed to the optimal tip speed ratio (λ*) and pitch angle (β*). Even though standard control of region two wind turbines is widely adopted due to its ease of implementation and excellent performance, it has various flaws that result in significant power losses. The first of these is that the gain kτ cannot be determined with any degree of accuracy. Second, even if it is assumed that kτ; can be precisely calculated by simulation, variations in wind speed drive the turbine to operate a majority of the time off the peak of its Cp–λ curve, resulting in reduced energy capture (Afanasieva et al., Citation2018). Therefore, to overcome the STC's shortcomings, this article offers dynamic programming approach for optimization. It is a numerical approach based on Bellman’s optimality principle for determining the control law that offers the global maximum value for a given objective function while satisfying the system constraints (Sun et al., Citation2019).

In this article, Bolza-type optimal control problems were used. So, the performance index is derived from EquationEquation (3) up to (10) (16) max J=E(N)+π8ρDr2.k=0N1t0tfvw3.Cp(Rωrvw,β)dt(16)

Subjected to: (17) wṙ=1Jr(π8Dr2ρCp(λ,β)vw3wrτgNg)(17) (18) x(0)=x0(18) (19) (ωr)minωr(ωr)max(19) (20) (τg)minτg(τg)max(20) (21) βminββmin(21) where, (ωr)min is the minimum turbine rotor speed, (ωr)max is the maximum turbine speed. The continuous-time model must first be discretized in time before using dynamic programming to solve the continuous-time control problem. So, let’s describe the system using (22) x(k+1)=F(x(k),u(k),k),k=0,1,N1(22) (23) x(k+1)=Ts*1Jr(π8Dr2ρCp(R*x(k)vw,u(k))vw3x(k)τg(k)Ng)+x(k)(23) with the state variable xkXk and the control signal ukUk. And the cost function be (24) Jk(x(k))=J=E(x(kf),kf)+k=0N1E(x(k),u(k))(24) where, x(k), and u(k) are the n and r dimensional state and control vectors, respectively. By using the principle of optimality to find the optimal control u*(k) which is applied to the plant (22) gives optimal state x* (k). Assume for the moment that we considered the best control, state, and cost for each value from k + 1 to N. Then, we write using the principle of optimality at any point in time or stage k. (25) Ek*(x(k))=max[E[x(k),u(k)]+Ek+1*(x*(k+1))](25) (26) Jk*(x(k))=max(Ek+1(k+1))+π8Dr2ρk=0N1Ts*Cp(R*x(k)vw,u2(k))*vw3x(k)(26)

The previous relationship represents the optimum control system’s application of the principle of optimality in mathematical form. It is also known as a dynamic programming functional equation. The ideal values for a single stage from k to k + 1 can therefore be found if the optimal control, state, and energy capture were discovered from any discrete dynamic programing stage k + 1 to the final stage N. For each time steps of the algorithm the optimal value of states, control inputs are calculated by forward proceeding till the system constraint limit. After get this optimal value the energy capture or cost function is optimized from the available optimal value of the system states and control inputs by considering final constraint. The general flow diagram for recursive dynamic programming is shown in .

Figure 3. Recursive dynamic programming algorithm flow chart.

Figure 3. Recursive dynamic programming algorithm flow chart.

4. Results and discussions

With Piecewise Step input, (27) vw(t)=6+2.125*fix(t115)(27)

The performance of both optimal control using a dynamic programming technique and standard torque control by torque feedback control about turbine rotor speed were evaluated. As demonstrated in , the STC control approach appears to converge to the optimal position faster than the optimal one. The reason for this is that the STC approach computes only the global optimal point of the pitch angle and Cp. Based on this maximum value of aerodynamic power coefficient value and pith angle this type of controller extract energy. But, this method will not be much useful when wind speed is varying continuously. After the wind speed gets a value above 6 m/s, the numerical optimal control mechanism has more performance than the STC control method. Discrete dynamic programing algorithm compute the optimal value of each variables of wind turbine by preceding backward and forward for each time step or discrete time. The forward preceding calculates the states (rotor speed of turbine speed), the control input unit (pitch angle and generator input torque), and tip speed ratio. The backward preceding calculates cost go function (energy capture) based on forwarded preceding optimal value of wind turbine variables. Due to this, it can be observed the total captured energy using the optimal numerical method is larger than that of the STC method. This is the result of the numerical method being superior at finding the optimal point for every value of the wind speed in contrast to the STC method which assumes the global optimal point only. Above 11 m/s, the numerical optimal control and standard torque control have approximately similar performance. But due to the state constraint, the numerical way of optimization tries to achieve the final state limits; that is why the DPM-type state has a greater value than STC.

Figure 4. DPM and STC wind energy capture using piecewise wind speed.

Figure 4. DPM and STC wind energy capture using piecewise wind speed.

The steps of optimization of wind energy capture using random wind speed are follows the same procedures for each discrete time steps of dynamic programing algorithm. With random wind speed given in EquationEquation (28), the numerical algorithm of dynamic programming method evaluation of the dynamic model of a nonlinear wind turbine system has better performance. The standard torque control method has easy implementation by assuming the aerodynamic power coefficient is at global maximum value, and the angle of attack is at zero degree, but due to the irregular nature of wind, this assumption is no further applicable to capture wind energy and generate maximum power. This is the reason why STC has less performance than the DPM method. presents the result of wind energy capture using DPM and STC with randomly generated wind speed given in EquationEquation (28). (28) vw(t)=10+0.87sin(225t)+0.5sin(230t)0.625sin(265t)+0.75sin(2135t)+0.65sin(2235t)+0.125sin(2575t)(28)

Figure 5. DPM and STC wind energy capture using randomly generated wind speed.

Figure 5. DPM and STC wind energy capture using randomly generated wind speed.

5. Conclusion

In this article, optimal controller design by using the numerical algorithm for HAWT orientation wind energy conversion system is investigated. Since WT has a complex non-linear dynamic system and the wind speed is determined by piecewise step input and sine function, deterministic dynamic programming of the numerical algorithm has to be used. This type of numerical algorithm solves continuous optimal control problems by converting them to discrete-time system form. Additionally, the dynamic programming algorithm is applicable for highly constrained and nonlinear system models, and it is used to optimize the cost function globally. The optimal values of wind turbine variables such as turbine rotor speed trajectory, tip speed ratio, pitch angle, generator input torque, aerodynamic efficiency are computed by preceding forward in time and evaluates the optimal energy capture at every node in the discretized state-time space by proceeding backward in time. From the simulation result, all wind turbine variables for both piecewise step and sine function-based input gives optimal values.

In general, the modeling results show that the system has an optimal tip speed ratio of 7.5 to 8.5 and an aerodynamic efficiency of 0.411. Furthermore, with the piecewise step input wind speed, the optimal controller captured 13.841% more energy and power than STC. The optimal controller gathered 1.15% more energy and power than the STC for the randomly generated wind speed pattern. The lower percentage improvement, in this case, is due to the limited range of the wind speed value given for the simulation.

For this article deterministic dynamic programing algorithm is applied from cut-in to rated wind speed ranges. Further researcher can be used this algorithm for above rated wind speed till to cut-off regions by considering wind energy optimization function with its constraints ().

Table 2. Parameters of the wind turbine system.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Abibual Abate Mitaw

Abibual Abate Mitaw received the B.Sc. degree in electrical and computer engineering (industrial control engineering) from Hawassa University, Hawassa, Ethiopia, in 2015, and the M.Sc. degree in electrical and computer engineering (control science) from Addis Ababa Institute of Technology, Addis Ababa University, Addis Ababa, Ethiopia, in 2019. He is currently a Senior Lecturer with the B Woldia Institute of Technology, Woldia University. He has published two articles in the Scopus Web of Science Journals. His research interests include robotics, systems, control, electric vehicles, renewable energy, smart microgrids, energy systems, artificial intelligent, and machine learning.

Abrham Tadesse Kassie

Abrham Tadesse Kassie received the B.Sc. degree in electrical and computer engineering (industrial control engineering) from Hawassa University, Hawassa, Ethiopia, in 2015, and the M.Sc. degree in electrical and computer engineering (control and instrumentation engineering) from Addis Ababa Science and Technology University, Addis Ababa, Ethiopia, in 2019. He is currently a Senior Lecturer with the Bahir Dar Institute of Technology, Bahir Dar University. He serves as the Chair for the Control and Instrumentation Engineering, Bahir Dar Institute of Technology. He has published four articles in the Scopus Web of Science Journals. His research interests include robotics, systems, control, electric vehicles, renewable energy, smart microgrids, energy systems, artificial intelligent, and machine learning.

Dereje Shiferaw Negash

Dereje Shiferaw Negash received the M.Tech. and Ph.D. degrees from the Department of Electronics and Computer Engineering, Indian Institute of Technology Roorkee, India, in 2009 and 2011, respectively. He is currently an Assistant Professor with the School of Electrical and Computer Engineering, Addis Ababa University. His research interests include neural networks, fuzzy logic systems, genetic algorithms, and application of AI in nonlinear control and robotics.

References

  • Afanasieva, N. A., Afanasyev, A. M., Dudnik, V. V., Gaponov, V. L., & Kuznetsov, D. M. (2018). Power control of the variable-speed horizontal axis wind turbine in nonlinear wind speed conditions. International Conference on Actual Problems of Electron Devices Engineering (APEDE), Saratov, Russia, 2018, pp. 298–305. https://doi.org/10.1109/APEDE.2018.8542351
  • Aittaleb, A., Sallaou, M., & Zaghar, H. (2020). Optimal design of continuously variable power-split transmissions for the wind energy conversion system. SAE International, 1 (2), 103–113. https://doi.org/10.4271/13-01-02-0006
  • Apata, O., & Oyedokun, D. T. O. (2020). An overview of control techniques for wind turbine systems. Scientific African, 10, e00566. https://doi.org/10.1016/j.sciaf.2020.e00566
  • Coelho, P. (2022). The Betz limit and the corresponding thermodynamic limit. Wind Engineering, 47(2), 491–496. https://doi.org/10.1177/0309524X221130109
  • Cortes-Vega, D., Ornelas-Tellez, F., & Anzurez-Marin, J. (2021). Nonlinear optimal control for PMSG-based wind energy conversion systems in advances in industrial control series. IEEE Latin America Transactions, 19(7), 1191–1198. https://doi.org/10.1109/TLA.2021.9461848
  • Doekemeijer, B. M., Van Wingerden, J.-W., Wingerden, V., & Fleming, P. A. (2019). A tutorial on the synthesis and validation of a closed-loop wind farm controller using a steady-state surrogate model. American Control Conference (ACC), Philadelphia, PA, USA, 2019, pp. 2825–2836. https://doi.org/10.23919/ACC.2019.8815126
  • Jiao, J., Meng, R., Guan, Z., Ren, C., Wang, L., & Zhang, B. (2019). Grid-connected control strategy for bidirectional AC-DC interlinking converter in AC-DC hybrid microgrid. 2019 IEEE 10th International Symposium on Power Electronics for Distributed Generation Systems (PEDG). Xi'an, China, 2019, pp. 341–345. https://doi.org/10.1109/PEDG.2019.8807601
  • Santosh Kumar, C., & Suresh Kumar, L. V. (2018). A look over on prosperous power electronic converters for wind turbine system. Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India, 2018, pp. 842–847. https://doi.org/10.1109/ICECA.2018.8474879
  • Srivastava, P. K., Tiwari, A. N., & Singh, S. (2021). Phase-lag compensator based approach for realizing MPPT through PMSG based wind turbine generator.
  • Sun, B., Tao, Z. Z., & Wang, Y. Y. (2019). Dynamic programming viscosity solution approach and its applications to optimal control problems. In: Smith, F.T., Dutta, H., Mordeson, J.N. (eds.), Mathematics applied to engineering, modelling, and social issues. Studies in systems, decision and control, vol. 200. Cham: Springer. https://doi.org/10.1007/978-3-030-12232-4_12