Wednesday 19th October 2016

Issue with Data-Collection and Queues

09:15 Queues have catched up, everything working again! More details about the problem and our response in a bit. 08:45 Workers are catching up again, should take some minutes but then the data will be there again. 08:43 Fixed the problem, the Beanstalkd queue daemon directly crashed after restarting due to an invalid binary log file. After deleting it the restart was possible again. 08:32 We are having issues with our queue. Investigating... 08:25 Alerts coming in about not running workers.