Mountain Car

Mountain Car
State dimension:	1
Differential states:	2
Discrete control functions:	1

The Mountain Car problem proposes a vehicle stuck in a “well.” It lacks the power to directly climb out of the well, but instead must accelerate repeatedly forwards and backwards until it has achieved the energy necessary to exit the well.

The problem is a popular machine learning test case. It first appeared in the PhD thesis of Andrew Moore in 1990. [Moo90]. The implementation here is taken from [] and based on that given by Melnikov, Makmal, and Briegel [MMB14]. Its dynamics are given by a two-dimensional ODE model.

The optimal integer control functions exhibits a bang bang structure.

Mathematical formulation

$\begin{array}{lll}\underset{w}{\min }& & -x_2(1)\\ \text{subject to}\\ \dot{x_1}(t)& =& -(w(t)+\frac{1}{2}\cdot w(t{)}^2)\cdot x_1(t),\\ \dot{x_2}(t)& =& w(t)\cdot x_1(t),\\ x(0)& =& (1,0{)}^T,\\ w(t)& \in & [0,5]\end{array}$

Reference Solutions

Here is one local solution to the above control problem.

• Reference solution plots
• 
  States and discretized control for a local optimum.

Miscellaneous and Further Reading

This formulation detailed description can be found in [1].

References

[1] https://apmonitor.com/do/index.php/Main/DynamicOptimizationBenchmarks