History of variational principles in physics
In physics, a variational principle is an alternative method for determining the state or dynamics of a physical system, by identifying it as an extremum (minimum, maximum or saddle point) of a function or functional. Variational methods are exploited in many modern software to simulate matter and light.
Since the development of analytical mechanics in the 18th century, the fundamental equations of physics have usually been established in terms of action principles, where the variational principle is applied to the action of a system in order to recover the fundamental equation of motion.
This article describes the historical development of such action principles and other variational methods applied in physics. See History of physics for an overview and Outline of the history of physics for related histories.
Antiquity
[edit]Variational principles are found among earlier ideas in surveying and optics. The rope stretchers of ancient Egypt stretched corded ropes between two points to measure the path which minimized the distance of separation, and Claudius Ptolemy, in his Geographia (Bk 1, Ch 2), emphasized that one must correct for "deviations from a straight course"; in ancient Greece Euclid states in his Catoptrica that, for the path of light reflecting from a mirror, the angle of incidence equals the angle of reflection; and Hero of Alexandria later showed that this path was the shortest length and least time.[1]: 580
First variational principles
[edit]Principle of virtual work
[edit]In the static analysis of objects under forces but fixed at mechanical equilibrium, the principle of virtual work imagines tiny mathematical shifts away from equilibrium. Each shift does work—energy lost or gained—against the forces, but the sum of all these bits of virtual work must be zero. This principle was developed by Johann Bernoulli in a letter to Pierre Varignon in 1715, but never separately published.[2]: 23 Cornelius Lanczos uses a slightly different definition as the single postulate for all analytic mechanics, showing thereby the power of energy based variational principles over Newtonian mechanics.[2]: 87
D'Alembert's principle
[edit]In 1743 Jean le Rond d'Alembert generalized the concept we now call virtual work to dynamical systems with rigid constraints, like rods or string under tension, a form that became known as the d'Alembert principle.[3]: 190 In the case of static (in equilibrium) rigid bodies without friction, the principle of virtual work says the net work of all applied forces () under variation of positions () is zero:
A similar condition but valid for dynamics (systems in motion) introduces, for each force, the change in momentum :
which is d'Alembert's principle.[4]: 17
Principle of least time
[edit]The earlier geometrical ideas in optics were generalized by Pierre de Fermat, who, in the 17th century, refined the principle to "light travels between two given points along the path of shortest time"; now known as the principle of least time or Fermat's principle. Fermat showed that principle predicts the observed law of refraction. His approach was metaphysical, arguing that Nature acts simply and economically.[1]: 580
The brachystochrone problem
[edit]![](http://upload.wikimedia.org/wikipedia/commons/thumb/6/63/Brachistochrone.gif/220px-Brachistochrone.gif)
In 1696 Johann Bernoulli posed a puzzle to European mathematicians: derive a curve for motion of a frictionless bead falling between a higher and a lower point in the least possible time. He named the curve the "brachistochrone", (from brachystos, "shortest", and chronos, "time")[5]: 31 Isaac Newton, Gottfried Wilhelm Leibniz and others contributed solutions, and in 1718 Johann Bernoulli published an analysis based on the solution created by his brother James Bernoulli. All of these works, especially the approach taken by the Bernoullis, involved reasoning about small deviations in the path taken by the falling bead. Thus this became the first application of the variational technique, albeit as a special-case rather than a general principle.[5]: 68
Principle of least action
[edit]In 1744[6] and 1746,[7] Pierre Louis Maupertuis generalized Fermat's concept to mechanics,[8]: 97 in the form of a principle of least action. Maupertuis argued metaphysically, he felt that "Nature is thrifty in all its actions", and applied the principle broadly:
The laws of movement and of rest deduced from this principle being precisely the same as those observed in nature, we can admire the application of it to all phenomena. The movement of animals, the vegetative growth of plants ... are only its consequences; and the spectacle of the universe becomes so much the grander, so much more beautiful, the worthier of its Author, when one knows that a small number of laws, most wisely established, suffice for all movements.
— Pierre Louis Maupertuis[9]
This notion of Maupertuis, although somewhat deterministic today, does capture much of the essence of variational mechanics.
In application to physics, Maupertuis suggested that the quantity to be minimized was the product of the duration (time) of movement within a system by the action; his definitions of action varied with the problems he discussed.[1]: 581 One form he used was called "vis viva",
which is the integral of twice what we now call the kinetic energy T of the system.
Euler's refinement
[edit]Leonhard Euler corresponded with Maupertuis from 1740 to 1744;[1]: 582 in 1744 Euler proposed a refined formulation of the least action principle in 1744.[10] He writes[11]
- "Let the mass of the projectile be M, and let its squared velocity resulting from its height be while being moved over a distance ds. The body will have a momentum that, when multiplied by the distance ds, will give , the momentum of the body integrated over the distance ds. Now I assert that the curve thus described by the body to be the curve (from among all other curves connecting the same endpoints) that minimizes or, provided that M is constant, ."[Note 1]
As Euler states, is the integral of the momentum over distance traveled (note that here contrary to usual notation denotes the squared velocity) which, in modern notation, equals the abbreviated action:[4]: 359
In rather general terms he wrote that "Since the fabric of the Universe is most perfect and is the work of a most wise Creator, nothing whatsoever takes place in the Universe in which some relation of maximum and minimum does not appear."
Euler continued to write on the topic; in his Reflexions sur quelques loix generales de la nature (1748), he called the quantity "effort". His expression corresponds to what we would now call potential energy, so that his statement of least action in statics is equivalent to the principle that a system of bodies at rest will adopt a configuration that minimizes total potential energy.
Lagrangian mechanics
[edit]The first use of the term "method of variations" came in 1755 through the work of a young Joseph Louis Lagrange; Euler presented Lagrange's approach to the Berlin Academy in 1756 as the "calculus of variations". Unlike Euler, Lagrange's approach was purely analytic rather than geometrical. Lagrange introduced the idea of variation of entire curves or paths between the endpoints than of individual coordinates. For this he introduced a new form of a differential, written , that acts on integrals rather than acting on coordinates.[5]: 111 His notation continues to be used today.[1]: 583
Hamilton-Jacobi mechanics
[edit]The variational principle was not used to derive the equations of motion until almost 75 years later, when William Rowan Hamilton in 1834 and 1835[12] applied the variational principle to the Lagrangian function (where T is the kinetic energy and V the potential energy of an object) to obtain what are now called the Euler–Lagrange equations. Hamilton believed his results were constrained by conservation of energy, which he called conservation of living force.[13]: 163
While few German scientists read English papers in this era, in 1836 the German mathematician Carl Gustav Jacobi read of Hamilton's work and immediately began new mathematical work, publishing ground breaking work on the variational principle in the following year.[14] Among Jacobi's results was the extension of Hamilton's method to time-dependent potentials (or "force functions" as they were known at that time).[13]: 201
Extensions by Gauss and Hertz
[edit]Other extremal principles of classical mechanics were formulated, such as Carl Friedrich Gauss's 1829 principle of least constraint and its corollary, Heinrich Hertz's 1896 principle of least curvature.
Action principle names
[edit]Action principles were developed by trial and error over three centuries; the names of the principles are not self-describing.[15] Richard Feynman, through his PhD thesis[16] and later through his reinvention of the undergraduate physics course, reinvigorated the field of variational principles in physics.[15] In the process he upended the terminology. Feynman called Hamilton's principal function simply the "action" and Hamilton's principle he called "the principle of least action".[17] The table below summarizes the key terminology found in modern physics literature.
action | principle | ||||
---|---|---|---|---|---|
definition | historical name | modern name | definition | common name | Alternative name |
Hamilton's principle function[4]: 431 | action[15][4]: 359 | Hamilton's principle[15][18][4] | Least action,[17][19]: 46 Stationary action [20] | ||
action[4]: 359 | abbreviated[15][4]: 359 or Maupertuis[18] action | Maupertuis's principle[18][15] | Least action[4]: 356 |
The notation means variations on with fixed; means variation with constant energy.[18] The abbreviated action is sometimes labeled .[15] Some authors use "stationary action" or "least action" to mean any variational principle involving action.[2]: viii [21]: 92
Modern action principles
[edit]In relativity
[edit]In 1915 David Hilbert applied variational principles to derive the gravitational field equations of general relativity in agreement with Albert Einstein's derivation.[22] (Einstein and Hilbert discussed Einstein's work on general relativity in person and letters throughout 1915.[23]) Hilbert's approach required accepting the variational principle as "axiomatic", a broadly accepted requirement today but questionable to the physicists of 1915. Hilbert's variations were based on what became known as the Einstein–Hilbert action, given by
- ,
where κ is Einstein gravitational constant, is the determinant of a spacetime Lorentz metric and is the scalar curvature.
In quantum mechanics
[edit]Variational principles played decisive roles at critical times in the development of quantum mechanics.
Sommerfeld's atom
[edit]Following Max Planck's proposal that quantum radiators explain the blackbody radiation spectrum and Albert Einstein hypothesis of quantum radiation to explain the photoelectric effect, Niels Bohr proposed quantized energy levels for the orbits in his model of the atom, thereby explaining the Balmer series for absorption of radiation by atoms. However this hypothesis involved no mechanical model. Arnold Sommerfeld then showed that quantization of the action of orbits for Hydrogen predicted the Balmer series, complete with relativistic corrections leading to fine structure in spectral lines. However, this approach could not be extended to atoms with more electrons and, more fundamentally, the quantum hypothesis itself had no explanation from this classical mechanics solution.[21]: 97
Schrödinger's equation
[edit]Combining Einstein's relativity and photoelectric effect results, De Broglie suggested that Sommerfeld's quantized action may relate to quantized wave effects; Erwin Schrödinger took up this idea, applying Hamilton's optico-mechanical analogy to connect the quantized action to Hamilton-Jacobi equations for the action. Hamilton's connection between light rays and light waves now became a connection between matter trajectories and de Broglie matter waves.[21]: 119 The resulting Schrödinger equation became the first successful quantum mechanics.
Dirac's quantum action
[edit]The work that built on Schrödinger's equation relied on analogies to Hamiltonian mechanics. In 1933 Paul Dirac published a paper seeking an alternative formulation based on Lagrangian mechanics. He was motivated by the power of the action principle and the relativistic invariance of the action itself.[24] Dirac was able to show that the wavefunctions probability amplitude at was related to the amplitude at through an complex exponential function of the action.[25]: 1025
Feynman's least action mechanics
[edit]In 1942, nearly a decade after Dirac's work, Richard Feynman built a new quantum mechanics formulation on the action principle. Feynman interpreted Dirac's formula as a physical recipe for the probability amplitude contributions from every possible path between and . These possibilities interfere; constructive interference gives the paths with the most amplitude. In the classical limit with large values of action compared to , the single classical path given by the action principle results.[25]: 1027
Schwinger's quantum action principle
[edit]In 1950, Julian Schwinger revisited Dirac's Lagrangian paper to develop the action principle in a different direction.[25]: 1082 Unlike Feynman's focus on paths, Schwinger's approach was "differential" or local.
In particle physics
[edit]The Standard Model is defined in terms of a Lagrangian density that includes all known elementary particles, the Higgs field and three of the fundamental interactions (electromagnetism, weak interaction and strong interaction, not including gravitational interaction). Its formulation started in the 1970s and has successfully explained almost all experimental results related to microscopic physics.[26]
Teleology in action principles
[edit]The breadth of physical phenomena subject to study by action principles lead scientists from all centuries to view these concepts as especially fundamental; the connection of two points by paths lead some to suggest a "purpose" to the selection of one particular path.[27] This teleological viewpoint runs from the earliest physics through Fermat, Maupertuis, and on up to Max Planck, without, however, any scientific backing.[21]: 162 The use of colorful language continues in the modern era with phrases like "Nature's command (to) Explore all paths!"[28] or "It isn't that a particle takes the path of least action but that it smells all the paths in the neighborhood...".[17]: II:19
Variational methods
[edit]Ritz's work on elasticity and waves
[edit]Lord Rayleigh was the first to popularly adapt the variational principles for the search of eigenvalues and eigenvectors for the study of elasticity and classical waves in his 1877 Theory of Sound.[29] The Rayleigh method allows approximation of the fundamental frequencies without full knowledge of the material composition and without the requirement of computational power.[29] From 1903 to 1908, Walther Ritz introduced a series of improved methods for static and free vibration problems based on the optimization of an ansatz or trial function. Ritz demonstrated his use in the Euler–Bernoulli beam theory and the determination of Chladni figures.[29]
For years, Ritz works were poorly cited in Western Europe and would only become popular after Ritz death in 1909.[30] In Russia, physicists like Ivan Bubnov (in 1913) and Boris Galerkin (in 1915) would rediscover and popularize some of Ritz's methods from 1908. In 1940, Georgii I. Petrov improved these approximations.[30] These methods are now known under different names, including Bubnov–Galerkin, Petrov–Galerkin and Ritz–Galerkin methods.[29]
In 1911, Rayleigh complemented Ritz for his method for solving Chladni's problem, but complained for the lack of citation of his earlier work. However the similarity between Rayleigh's and Ritz's method has sometimes been challenged.[29][31][30] Ritz's methods are sometimes referred as Rayleigh–Ritz method or simply Ritz method, depending on the procedure.[29][30] Ritz's method led to the development of finite element method for the numerical solution of partial differential equations in physics.[30]
For quantum systems
[edit]The variational method of Ritz would found his use quantum mechanics with the development of Hellmann–Feynman theorem. The theorem was first discussed by Schrödinger in 1926, the first proof was given by Paul Güttinger in 1932, and later rediscovered independently by Wolfgang Pauli and Hans Hellmann in 1933, and by Feynman in 1939.[citation needed]
In quantum chemistry and condensed matter physics, variational methods were developed to study atoms, molecules, nuclei and solids under a quantum mechanical framework. Some of these include the use of Ritz methods for the determination of the spectra of the helium atom, 1930 Hartree–Fock method, 1964 density functional theory and variational Monte Carlo and 1992 density matrix renormalization group (DMRG).[citation needed]
Quantum algorithms
[edit]In 2014, variational principles were part of a hybrid strategy, called noisy intermediate-scale quantum (NISQ) computing, to combine powerful but imperfect quantum computers coupled with classical computers.[32] The first proposals included a variational quantum eigensolver[33] to exploit quantum phenomena to simulate atoms and small molecules using variational methods and an approximate optimization algorithm.[34][35]
Footnote
[edit]- ^ Original: "Sit massa corporis projecti ==M, ejusque, dum spatiolum == ds emetitur, celeritas debita altitudini == v; erit quantitas motus corporis in hoc loco == ; quae per ipsum spatiolum ds multiplicata, dabit motum corporis collectivum per spatiolum ds. Iam dico lineam a corpore descriptam ita fore comparatam, ut, inter omnes alias lineas iisdem terminis contentas, sit , seu, ob M constans, minimum."
References
[edit]- ^ a b c d e Kline, Morris (1972). Mathematical Thought from Ancient to Modern Times. New York: Oxford University Press. pp. 167–168. ISBN 0-19-501496-0.
- ^ a b c Coopersmith, Jennifer (2017). The lazy universe: an introduction to the principle of least action. Oxford; New York, NY : Oxford University Press. ISBN 978-0-19-874304-0.
- ^ Hankins, Thomas L. (1990). Jean d'Alembert: science and the enlightenment. Classics in the history and philosophy of science. New York Philadelphia London: Gordon and Breach. ISBN 978-2-88124-399-8.
- ^ a b c d e f g h Goldstein, Herbert; Poole, Charles P.; Safko, John L. (2008). Classical mechanics (3. ed., [Nachdr.] ed.). San Francisco Munich: Addison Wesley. ISBN 978-0-201-65702-9.
- ^ a b c Goldstine, Herman H. (1980). A History of the Calculus of Variations from the 17th through the 19th Century. Studies in the History of Mathematics and Physical Sciences. Vol. 5. New York, NY: Springer New York. doi:10.1007/978-1-4613-8106-8. ISBN 978-1-4613-8108-2.
- ^ de Maupertuis, P. L. M. (1744). "Accord de différentes loix de la nature qui avoient jusqu'ici paru incompatibles". Mémoires de l'Académie Royale des Sciences de Paris: 417–426.
- ^ de Mapertuis, M. (1746). "Les Loix du mouvement et du repos déduites d'un principe metaphysique". Histoire de l'Académie Royale des Sciences et des Belles Lettres: 267–294.
- ^ Whittaker, Edmund T. (1989). A history of the theories of aether & electricity. 2: The modern theories, 1900 - 1926 (Repr ed.). New York: Dover Publ. ISBN 978-0-486-26126-3.
- ^ Chris Davis. Idle theory Archived 2006-06-15 at the Wayback Machine (1998)
- ^ Leonhard Euler, Methodus Inveniendi Lineas Curvas Maximi Minive Proprietate Gaudentes. (1744) Bousquet, Lausanne & Geneva. 320 pages. Reprinted in Leonhardi Euleri Opera Omnia: Series I vol 24. (1952) C. Cartheodory (ed.) Orell Fuessli, Zurich. scanned copy of complete text at The Euler Archive, Dartmouth.
- ^ Euler, Methodus Inveniendi Lineas Curvas Maximi Minive Proprietate Gaudentes: Additamentum II, Ibid.
- ^ W.R. Hamilton, "On a General Method in Dynamics.", Philosophical Transactions of the Royal Society Part I (1834) p.247-308; Part II (1835) p. 95-144. (From the collection Sir William Rowan Hamilton (1805-1865): Mathematical Papers edited by David R. Wilkins, School of Mathematics, Trinity College, Dublin 2, Ireland. (2000); also reviewed as On a General Method in Dynamics)
- ^ a b Nakane, Michiyo; Fraser, Craig G. (2002). "The Early History of Hamilton-Jacobi Dynamics 1834–1837". Centaurus. 44 (3–4): 161–227. doi:10.1111/j.1600-0498.2002.tb00613.x. ISSN 0008-8994. PMID 17357243.
- ^ G.C.J. Jacobi, Vorlesungen über Dynamik, gehalten an der Universität Königsberg im Wintersemester 1842-1843. A. Clebsch (ed.) (1866); Reimer; Berlin. 290 pages, available online Œuvres complètes volume 8 at Gallica-Math from the Gallica Bibliothèque nationale de France.
- ^ a b c d e f g Hanc, Jozef; Taylor, Edwin F.; Tuleja, Slavomir (1 July 2005). "Variational mechanics in one and two dimensions". American Journal of Physics. 73 (7): 603–610. Bibcode:2005AmJPh..73..603H. doi:10.1119/1.1848516. ISSN 0002-9505.
- ^ Feynman, Richard P. (August 2005). "THE PRINCIPLE OF LEAST ACTION IN QUANTUM MECHANICS". Feynman's Thesis — A New Approach to Quantum Theory (Thesis). pp. 1–69. doi:10.1142/9789812567635_0001. ISBN 978-981-256-366-8.
- ^ a b c Feynman, Richard P. (2011). The Feynman lectures on physics. Volume 2: Mainly electromagnetism and matter (The new millennium edition, paperback first published ed.). New York: Basic Books. ISBN 978-0-465-02494-0.
- ^ a b c d Gray, C G; Karl, G; Novikov, V A (1 February 2004). "Progress in classical and quantum variational principles". Reports on Progress in Physics. 67 (2): 159–208. arXiv:physics/0312071. Bibcode:2004RPPh...67..159G. doi:10.1088/0034-4885/67/2/R02. ISSN 0034-4885. S2CID 10822903.
- ^ Hand, Louis N.; Finch, Janet D. (13 November 1998). Analytical Mechanics (1 ed.). Cambridge University Press. doi:10.1017/cbo9780511801662. ISBN 978-0-521-57572-0.
- ^ Schwinger, Julian (1966). "Relativistic Quantum Field Theory". Science. 153 (3739): 949–953. Bibcode:1966Sci...153..949S. doi:10.1126/science.153.3739.949. PMID 17837239. Retrieved 19 November 2023.
- ^ a b c d Yourgrau, Wolfgang; Mandelstam, Stanley (1979). Variational principles in dynamics and quantum theory. Dover books on physics and chemistry (Republ. of the 3rd ed., publ. in 1968 ed.). New York, NY: Dover Publ. ISBN 978-0-486-63773-0.
- ^ Mehra, Jagdish (1987). "Einstein, Hilbert, and the Theory of Gravitation". In Mehra, Jagdish (ed.). The physicist's conception of nature (Reprint ed.). Dordrecht: Reidel. ISBN 978-90-277-2536-3.
- ^ Straumann, Norbert. General relativity (2 ed.). Dordrecht: Springer.
- ^ Dirac, P. A. M. (August 2005). "The Lagrangian in Quantum Mechanics". Feynman's Thesis — A New Approach to Quantum Theory. WORLD SCIENTIFIC. pp. 111–119. doi:10.1142/9789812567635_0003. ISBN 978-981-256-366-8.
- ^ a b c Mehra, Jagdish, and Rechenberg, Helmut. The Conceptual Completion and Extensions of Quantum Mechanics 1932-1941. Epilogue: Aspects of the Further Development of Quantum Theory 1942-1999: Subject Index: Volumes 1 to 6. Germany, Springer, 2001.
- ^ Woithe, Julia; Wiener, Gerfried J; Van der Veken, Frederik F (May 2017). "Let's have a coffee with the Standard Model of particle physics!". Physics Education. 52 (3): 034001. Bibcode:2017PhyEd..52c4001W. doi:10.1088/1361-6552/aa5b25. ISSN 0031-9120.
- ^ Stöltzner, Michael (1994). "Action Principles and Teleology". In H. Atmanspacher; G. J. Dalenoort (eds.). Inside Versus Outside. Springer Series in Synergetics. Vol. 63. Berlin: Springer. pp. 33–62. doi:10.1007/978-3-642-48647-0_3. ISBN 978-3-642-48649-4.
- ^ Ogborn, Jon; Taylor, Edwin F. (2005). "Quantum physics explains Newton's laws of motion" (PDF). Physics Education. 40 (1): 26. Bibcode:2005PhyEd..40...26O. doi:10.1088/0031-9120/40/1/001. S2CID 250809103.
- ^ a b c d e f Leissa, A.W. (2005). "The historical bases of the Rayleigh and Ritz methods". Journal of Sound and Vibration. 287 (4–5): 961–978. Bibcode:2005JSV...287..961L. doi:10.1016/j.jsv.2004.12.021.
- ^ a b c d e Gander, Martin J.; Wanner, Gerhard (2012). "From Euler, Ritz, and Galerkin to Modern Computing". SIAM Review. 54 (4): 627–666. doi:10.1137/100804036. ISSN 0036-1445.
- ^ Ilanko, Sinniah (2009). "Comments on the historical bases of the Rayleigh and Ritz methods". Journal of Sound and Vibration. 319 (1–2): 731–733. Bibcode:2009JSV...319..731I. doi:10.1016/j.jsv.2008.06.001.
- ^ Bharti, Kishor; Cervera-Lierta, Alba; Kyaw, Thi Ha; Haug, Tobias; Alperin-Lea, Sumner; Anand, Abhinav; Degroote, Matthias; Heimonen, Hermanni; Kottmann, Jakob S.; Menke, Tim; Mok, Wai-Keong; Sim, Sukin; Kwek, Leong-Chuan; Aspuru-Guzik, Alán (15 February 2022). "Noisy intermediate-scale quantum algorithms". Reviews of Modern Physics. 94 (1): 015004. arXiv:2101.08448. Bibcode:2022RvMP...94a5004B. doi:10.1103/RevModPhys.94.015004. hdl:10356/161272. ISSN 0034-6861. S2CID 231662441.
- ^ Peruzzo, Alberto; McClean, Jarrod; Shadbolt, Peter; Yung, Man-Hong; Zhou, Xiao-Qi; Love, Peter J.; Aspuru-Guzik, Alán; O’Brien, Jeremy L. (23 July 2014). "A variational eigenvalue solver on a photonic quantum processor". Nature Communications. 5 (1). doi:10.1038/ncomms5213. ISSN 2041-1723. PMC 4124861. PMID 25055053.
- ^ Farhi, Edward; Goldstone, Jeffrey; Gutmann, Sam (14 November 2014). "A Quantum Approximate Optimization Algorithm". arXiv:1411.4028.
- ^ Blekos, Kostas; Brand, Dean; Ceschini, Andrea; Chou, Chiao-Hui; Li, Rui-Hao; Pandya, Komal; Summer, Alessandro (2 June 2024). "A review on Quantum Approximate Optimization Algorithm and its variants". Physics Reports. A review on Quantum Approximate Optimization Algorithm and its variants. 1068: 1–66. arXiv:2306.09198. doi:10.1016/j.physrep.2024.03.002. ISSN 0370-1573.