Test Software
CrawlCrawler is still very much a test project. The big thing to watch out for is that the morgue parser is very fragile, so there will be data errors. I also have no sense of what load this service will see, so don't be surprised if it's slow, or down. If you encounter any bugs or have suggestions, please open a GitHub issue or start a GitHub discussion.
CrawlCrawler is a proof of concept for what's possible with DCSS data. As a turn-based game, every action in every game is recorded — giving us a depth of data that most games simply don't have, and making it possible to build search and analytics experiences that are unique to our community. This tool is built on a shaky foundation — parsing morgue files is genuinely hard, and the parser is far from perfect — but it's enough to show what's possible.
The real gem here is the streak analytics. I crawled 53,000 games listed on CAO's streak page, and around 30,000 were still available. Because these runs come from players sustaining long streaks, the dataset offers unusually strong insight into high-level consistent play.
This site uses Google Analytics to understand how people are using the tool so I can improve it. It is not used for ads or monetization.
If you like what you see here, please check out the appeal.
These are other tools I use, shoot me note if you'd like yours added.