Module Fehu_envs.Mountain_carSource

Example

Train an agent to reach the goal by building momentum:

  let rng = Rune.Rng.create () in
  let env = Fehu_envs.Mountain_car.make ~rng () in
  let obs, _ = Fehu.Env.reset env () in
  let rec run_episode steps =
    let action = (* policy decision based on position and velocity *) in
    let t = Fehu.Env.step env action in
    if t.terminated then
      Printf.printf "Goal reached in %d steps!\n" steps
    else if t.truncated then
      Printf.printf "Failed to reach goal in 200 steps\n"
    else
      run_episode (steps + 1)
  in
  run_episode 0

Tips

• Classic exploration challenge: car engine is too weak to drive directly up the hill
• Agent must learn to build momentum by driving back and forth
• Sparse reward makes this difficult for naive value-based methods
• Consider reward shaping (e.g., bonus for reaching higher positions) or policy gradient methods
• Good for testing exploration strategies and delayed reward learning