Some services are down
Resolved
Jun 21, 2023 at 12:49pm UTC
All services are running.
Two data nodes got stuck with bulk queue resolution. We had to redeploy the ElasticSearch cluster in AWS managed service manually.
Affected services
Updated
Jun 21, 2023 at 12:04pm UTC
UI is accessible now. We are finalizing and starting a further investigation with AWS.
Scheduling will be enabled soon
Affected services
Updated
Jun 21, 2023 at 11:36am UTC
We are checking the cluster health before pushing to production again
Affected services
Updated
Jun 21, 2023 at 09:40am UTC
We are experiencing an incident
Our AWS OpenSearch cluster is stuck with a growing bulk queue. It is an Amazon-managed service, so we are waiting for AWS support for the solution.
We believe in fully operational status in an hour or less.
We appreciate your patience.
Affected services
Created
Jun 21, 2023 at 08:06am UTC
APUtime Cron went down.
Affected services