We are experiencing an issue causing delayed event processing

We are resolving the incident as all systems are operational and a permanent fix is in place.

Due to replaying certain events to guarantee delivery, there is a slight chance that some customers might experience duplicate alerts in the next 15 minutes.

We have identified the issue and have deployed a temporary fix to stop events from being delayed. And are already monitoring a fully recovered event processing queue. So far the partial impact was only identified on Grafana and Zabbix events.

We are investigating an issue where certain monitoring tool events are processed with a delay.