Skip to content

katipber/hillclimber

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HillClimber

HillClimber is an implementation of HillClimbing algorithm to optimize the weights of a given neural network.

This repository also contains:

  • A Dash application to visualize the searching process and the search graph (partially, since the graph has more than 3 dimensions).
  • A Jupyter notebook to demonstrate how to use the packages.
  • Sample log and model files.

Tech / Frameworks

  • OpenAI Gym
  • PyTorch
  • Plotly Dash
  • Numpy
  • Pandas
  • SciPy

Screenshots

CartPole-v1 MountainCar-v0 LunarLander-v2
CartPole MountainCar LunarLander
~10-30 seconds ~1-10 minutes ~10-60 minutes

CartPole Score Graph

CartPole Score


MountainCar Search Graph

MountainCar Search


LunarLander Search Graph

LunarLander Search

Credits

I was inspired by this video of TheComputerScientist. It is a nice channel if you are interested in AI.

Also recorder.py is taken from highway-env. I was planning to include highway environment in this project as well, but for some reason each episode took around 3-12 seconds during my trials, so I decided not to.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors