It's really, really rough. Well, early. I'm doing WEBGL targets (compiled to WASM/browser) first partly because browsers are so constrained network-wise: only able to use Websockets and/or WebRTC and ...

Change: We will modify the reward for touching the ball and the existential reward/penalty to increase as the game progresses. This makes the agent more aggressive and strategic later in the episode.