Scaling MongoDB to a Million Collections

June 21, 2017

Speaker: Michael Cahill, Director of Engineering (Storage), MongoDB 
Level: 300 (Advanced)
Track: How We Build MongoDB

When the WiredTiger storage engine was created, the use case we had in mind was applications with modest numbers of collections. That led to various choices during the design, such as storing each collection in a separate file. However, MongoDB customers have an enormous variety of use cases, including multi-tenant applications where each user has a separate database and each database contains hundreds of collections.

To support these applications efficiently, we have evolved the storage layer with better testing, better analysis tools, and more scalable data structures and algorithms. This session will explain how we can now run workloads with over a million collections.

What You Will Learn:

How MongoDB represents collections and indexes in the storage layer.

The system resources involved in accessing multiple collections and indexes from different client connections.

The system limits MongoDB may hit as you add more collections, and how to increase or work around those limits.

Previous Presentation
Enabling Clinical Research in the Real World
Enabling Clinical Research in the Real World

Speaker: Brenda Deverell Cortez, Software Developer, Koneksa Health Speaker: Tom Hosford, VP Engineering, ...

Next Presentation
Jumpstart: Your Introduction to MongoDB
Jumpstart: Your Introduction to MongoDB

Speaker: Jay Gordon, Developer Advocate, MongoDB Level: 100 (Beginner) Track: Jumpstart MongoDB has grown...