Some options for large number key/value databases
Some options for large number key/value databases include:
Cassandra: Apache Cassandra is a distributed database designed to handle large amounts of data across many servers. It is known for its high scalability and ability to handle huge amounts of data without compromising performance.
MongoDB: MongoDB is a popular NoSQL database that uses a flexible document-oriented data model, allowing it to store large amounts of data efficiently. It is highly scalable and can handle huge amounts of data with ease.
Redis: Redis is an in-memory data store that is often used for caching, but it can also be used as a key/value database. It is highly performant and can handle large amounts of data quickly.
HBase: HBase is a distributed, column-oriented database that is built on top of Hadoop. It is designed to handle large amounts of data and can scale horizontally to accommodate growing data sets.
DynamoDB: Amazon DynamoDB is a cloud-based key/value database offered by Amazon Web Services. It is designed to handle large amounts of data with low latency and high scalability.
Other
- Postgres: Obviously an overkill for just storing key-value
- Badger: Buggy, crashes sometimes, corrupts database. Updates break compatibility. Uses C code.
- Bolt: No longer actively maintained, suffers from out of memory crashes and corrupted database.
- Bitcask: High memory usage (more than disk).
- Pogreb: Pure Go, but not more than 4 billion records supported
- etcd-io/bbolt It was a forked of bolt db and still maintained by etcd team