Upcoming Events
This page will give a schedule for upcoming events including estimated times for when the next set of data dumps will be published. This page will be update frequently.
The ingest for March comments was delayed slightly a few weeks ago to address some issues with the main ingest server. I am now using a new ingest server that is hosted on Digital Ocean in their San Fran datacenter. The response times have improved tremendously compared to the previous server which was hosted in Phoenix. The datacenter for the previous server apparently was over-provisioned and caused a lot of latency which frequently affected the ingest (causing the ingest to fall behind). The new server now collects comments and submissions within 2 seconds of their being made to Reddit with a success rate over 99.9%.
Current Schedule
- April comments should be available around May 20 ,2018.
This page was last modified on