Engine/platform for handling data.
- Aug'2013: used by BangWithFriends
notes from 2002-2005
- see Jim Menard http://www.io.com/~jimm/writing/alternate_storage.html - When the Relational Hammer Whacks Your Thumb
Dave McCusker wrote the MorkDb which has been used in various pieces of Mozilla. Nearly everything is representable as objects with attributes. Attributes are cells, objects are rows, tables are collections.
Cog is the Checkpointed Object Graph object database, providing semi-transparent persistence for large sets of interrelated Python objects. It handles automatic loading of objects on reference, and saving of modified objects back to disk. http://www.randomly.org/projects/cog/ - see 2002-12-10-CogPersistence
book's on Intelligent Database
The File System!
pro: data safety (not likely to lose entire data set); can easily use many existing file-processing tools
con/risk: overhead of thousands of tiny files; search/index performance (could use hybrid: put indexes in some separate binary structure (but then you can't use file-processing tools because the index can't stay in Data Synch with the base data, though maybe there are some narrow cases where that's OK).
logical file system design
Also worth remembering