Commit graph

7 commits

Author SHA1 Message Date
c11ab303d2 implement simple compaction 2025-01-04 05:30:10 +00:00
e027bc234e use did/createdAt/cid prefix on written records
this means we can skip over dids we don't care about without parsing
JSON *AND* we get good lexicographic sorting of log files (which will be
useful for more complex compaction later)
2025-01-03 06:45:38 +00:00
0d2412813f filter duplicate cids 2024-11-30 20:17:49 +00:00
e9af92c00f rename scan.ts to scan-from-raw.ts and give it a simple cli for byteoffset 2024-11-29 06:26:41 +00:00
1e0ff83f8b fix compaction sorting and missing live lookups 2024-11-28 06:08:02 +02:00
c539a4dc5a move to flat files idk 2024-11-28 05:08:47 +02:00
47678e1e95 (wip) initial commit 2024-11-27 18:30:50 +02:00