Literature for the course

The two subdomains of control theory - optimal control and robust control -, which we explore in this course, are both quite mature, and are covered by a wealth of books, introductory and advanced. The same holds for the doman of numerical optimization, which provides important components for both control subdomains.

In our course we do not follow any single textbook chapter by chapter.

Instead, besides our own lecture notes we are going to refer to various study resources once we study the individual (weekly) topics. In doing that we prefer freely available online resources and books available in the university library, but we also give some recommendations for relevant and helpful books that are not freely available.

Below we give a general recommendation on literature categorized into the three domains. Students are not required to obtain those books but perhaps such curated and commented lists might do some service to interested students.

Numerical optimization

The popular [1] offers deep but clear explanations, and [2] is commonly regarded as a comprehensive reference, and yet it is readable. The broad scope of the recently published [3] fits our course nearly perfectly, even including the optimal control part. Very didactic and also accompanied by Matlab and Python codes is [4]. [5] is also recommendable. Unfortunately, none of these books is freely available online.

However, there are a few recently published textbooks that are also legally available online and that are fairly comprehensive and readable: [6], [7] and [8], the latter including code in Julia language. The freely available “convex optimization bible” [9] contains perfect explanations of many advanced optimization concepts such as duality.

Optimal control

One of a few optimal control textbooks that covers also discrete-time problems is the classical textboook [10], which has been lately made available online on the author’s web page.

Majority of classical optimal control textbooks and monographs focus on continuous-time systems, for which we need to invoke calculus of variations. While it is not a trivial subject, an accessible treatment tailored to continuous-time optimal control is provided by [11] (a draft available online). The monograph [12] is regarded a classic, but [13] is perhaps a bit more readable (and affordable as it was reprinted by a low-cost publisher). A few copies of another reprinted classic [14] are available in the library, but freely downloadable electronic version are also available.

While all these classical monographs provide fundamental theoretical insight, computational tools they provide (mostly in one way or another reformulating the optimal control problem into a Riccati equation) are mostly restricted to linear systems. For nonlinear continuous-time systems, hardly anything is as practical as numerical methods as covered for example by [15]. When restricted to discrete-time systems, model predictive control is covered by [16], which is also available online.

Robust control

The topic of robust control is also described in a wealth of books. But unlike in the area of optimization and general optimal control, here we do have a strong preference for a single book, and our choice is fairly confident: [17]. We are going to use it in the last third of the course. A few copies of this book are available in the university library (reserved for the students of this course). In addition, the first three chapters are freely downloadable on the author’s web page. But we strongly recommend considering purchasing the book. It might turn out very useful as a reference even after passing an exam in this course.

Other classical references are [18], [19], [20], [21], [22], but we are not going to used them in our course.

Back to top

References

[1]
D. G. Luenberger and Y. Ye, Linear and Nonlinear Programming, 5th ed. in International Series in Operations Research & Management Science, no. 228. Cham, Switzerland: Springer, 2021. Available: https://doi.org/10.1007/978-3-030-85450-8
[2]
J. Nocedal and S. Wright, Numerical Optimization, 2nd ed. in Springer Series in Operations Research and Financial Engineering. New York: Springer, 2006. Available: https://doi.org/10.1007/978-0-387-40065-5
[3]
A. Hansson and M. Andersen, Optimization for Learning and Control. Hoboken, NJ, USA, 2023. Available: https://www.wiley.com/en-us/Optimization+for+Learning+and+Control-p-9781119809135
[4]
A. Beck, Introduction to Nonlinear Optimization: Theory, Algorithms, and Applications with Python and MATLAB, 2nd ed. in MOS-SIAM Series on Optimization. Philadelphia, PA, USA: Society for Industrial & Applied Mathematics, 2023. Available: https://doi.org/10.1137/1.9781611977622
[5]
G. C. Calafiore, Optimization Models. Cambridge, UK: Cambridge University Press, 2014. Available: https://doi.org/10.1017/CBO9781107279667
[6]
M. Bierlaire, Optimization: Principles and Algorithms, 2nd ed. Lausanne: EPFL Press, 2018. Available: https://transp-or.epfl.ch/books/optimization/html/OptimizationPrinciplesAlgorithms2018.pdf
[7]
J. R. R. A. Martins and A. Ning, Engineering Design Optimization. Cambridge ; New York, NY: Cambridge University Press, 2022. Available: https://mdobook.github.io/
[8]
M. J. Kochenderfer and T. A. Wheeler, Algorithms for Optimization. The MIT Press, 2019. Accessed: Dec. 29, 2020. [Online]. Available: https://algorithmsbook.com/optimization/
[9]
S. Boyd and L. Vandenberghe, Convex Optimization, Seventh printing with corrections 2009. Cambridge, UK: Cambridge University Press, 2004. Available: https://web.stanford.edu/~boyd/cvxbook/
[10]
F. L. Lewis, D. Vrabie, and V. L. Syrmo, Optimal Control, 3rd ed. John Wiley & Sons, 2012. Accessed: Mar. 09, 2022. [Online]. Available: https://lewisgroup.uta.edu/FL%20books/Lewis%20optimal%20control%203rd%20edition%202012.pdf
[11]
D. Liberzon, Calculus of Variations and Optimal Control Theory: A Concise Introduction. Princeton University Press, 2011. Available: http://liberzon.csl.illinois.edu/teaching/cvoc/cvoc.html
[12]
A. E. Bryson Jr. and Y.-C. Ho, Applied Optimal Control: Optimization, Estimation and Control, Revised edition. CRC Press, 1975.
[13]
D. E. Kirk, Optimal Control Theory: An Introduction, Reprint of the 1970 edition. Dover Publications, 2004.
[14]
B. D. O. Anderson and J. B. Moore, Optimal Control: Linear Quadratic Methods, Reprint of the 1989 edition. Dover Publications, 2007. Available: http://users.cecs.anu.edu.au/~john/papers/BOOK/B03.PDF
[15]
J. T. Betts, Practical Methods for Optimal Control Using Nonlinear Programming, 3rd ed. in Advances in Design and Control. Society for Industrial and Applied Mathematics, 2020. doi: 10.1137/1.9781611976199.
[16]
J. B. Rawlings, D. Q. Mayne, and M. M. Diehl, Model Predictive Control: Theory, Computation, and Design, 2nd ed. Madison, Wisconsin: Nob Hill Publishing, LLC, 2017. Available: http://www.nobhillpublishing.com/mpc-paperback/index-mpc.html
[17]
S. Skogestad and I. Postlethwaite, Multivariable Feedback Control: Analysis and Design, 2nd ed. Wiley, 2005. Available: https://folk.ntnu.no/skoge/book/
[18]
B. A. Francis, A Course in H\(\infty\) Control Theory. in Lecture Notes in Control and Information Sciences. Berlin Heidelberg: Springer-Verlag, 1987. doi: 10.1007/BFb0007371.
[19]
K. Zhou and J. C. Doyle, Essentials of Robust Control, 1st ed. Prentice Hall, 1997.
[20]
R. S. Sánchez-Peña and M. Sznaier, Robust Systems Theory and Applications, 1st ed. Wiley-Interscience, 1998.
[21]
M. Green, D. J. N. Limebeer, and Engineering, Linear Robust Control, Reprint of the 1995 edition by Pearson Education. Mineola, N.Y: Dover Publications, 2012.
[22]
E. Lavretsky and K. Wise, Robust and Adaptive Control: With Aerospace Applications, 2nd ed. in Advanced Textbooks in Control and Signal Processing (C&SP). Cham: Springer, 2024. Available: https://doi.org/10.1007/978-3-031-38314-4