Arena Details How It Runs Its Billions-Scale Data Stack

Arena.ai (formerly LMSYS Chatbot Arena), the AI model evaluation platform, has shared the engineering practices behind the data infrastructure that supports real-world tasks from millions of users, accompanied by an explainer clip from its engineering team. The company noted that once worldwide users bring real-world tasks at this scale, optimizing hot/cold storage—how to separate frequently accessed data from rarely accessed data—quickly becomes a hard problem. It discussed CDC (Change Data Capture) replication, the tradeoffs of ephemeral storage, and best practices for building data infrastructure at a scale of billions of data points.