Sorry all, I was at my co-ed softball game and the game day bots filled 25GB of disc in 3 hours.
I’ll do a post mortem tomorrow. First thought is that I should absolutely not host the bots on the game servers as the app. I apologize for any inconvenience I caused. It’s unacceptable and it won’t happen again.
We’ve identified the issue that caused the crash.
A hotfix to truncate the post body (in case we’ve gone over the 10k limit) caused an unhandled exception. This crashed some game threads (and all post game threads) and caused an ungodly amount of logs to be pumped out.
I am working with another (possibly two) developers now on these bots. The bots are still very alpha so please be patient. I am only going to turn on a few bots today, and if all goes well, will scale them up.
With all the beefiness I added to our fanaticus server, the one thing I didn’t upgrade was the disc space. That wouldn’t have prevented this error from happening but it would have bought me enough time to return from my game and resolve the issue.