Mainnet liveness outage

Incident Report for EigenDA

Resolved

Between 12:40:00 UTC - 13:25:00 UTC Eigen DA's Eigen quorum signing rate dropped to 40% resulting in liveness outage. The outage was triggered when a single operator, who was recently delegated 84M Eigen post unlock (60% stake share), failed to sign multiple batches due to the batch size exceeding the gRPC message size limit. Oncall engineers reduced the DA batch interval to shrink batch sizes and recover liveness. We are actively working with this operator to distribute their stake across multiple nodes.

Posted Oct 05, 2024 - 12:40 UTC