bug: increasing gamma about evo

[jarbus]

experimenting with always including best, issue still occurs. it appears
that gamma keeps increasing as no better solutions are found, and mutation
rate keeps increasing.

Now I think it will be helpful to run experiments without a dynamic mutation rate,
and without a dynamic gamma.

The population also averages their behaviors along one main cluster, it looks like.

See results in outs/ga-forage-daytime/gesmr-adapt-10kp-elite1

[jarbus]

this was apparently fine with gesmr-adapt-2kp. I don't remember what commit I ran it on, though.

[jarbus]

testing with no separate elite computation now
result: gamma collapse

[jarbus]

maybe need to do normal gaussian noise for updates? probably not

[jarbus]

x: half gamma on new best, commit d7e44ac on branch elite1

result: half gamma seems more stable, but new solutions are a negligible improvement on previous best. avg fitness plateaus at 1.5, mins at .5, maxes at 2.5 for most generations. This only uses 1m params

novelty isn't doing anything either, policies coverge on going to same corner after brief period of exploration

ideas:
more elites
more tests
larger grid + window sizes (increases model size too)
single agent

[jarbus]

todo: figure out how to launch visualization jobs of elites from julia