#Looking for file format

7 messages · Page 1 of 1 (latest)

keen basin
#

Hi!
I'm looking for a fast file format that can store large amount of small data.
I want it to :

  • have a java way to read and write it
  • store 12 bytes as the key and a float as the value
  • store over 800 000 000 row
  • not be too slow to write
  • be fast to find keys, and its associated value
surreal garnetBOT
#

Hey, @keen basin!
Please remember to /close this post once your question has been answered!

keen basin
#

I do not need it to :

  • be human readable
  • be lightweight
  • have an external tool to read or write
floral stump
#

A b-plus tree should do.

karmic marlin
#

https://www.dizitart.org/nitrite-database.html
In terms of a practical, easy solution, you can use this. It is a no-sql pure-java database that indexes on each entry's id, so fast lookup

Dizitart | Nitrite

Nitrite database is an open source nosql embedded document store written in Java with MongoDB like API. It supports both in-memory and single file based persistent store.

keen basin
#

thanks ! worked