Store size: repack in gc, and text blobs without CBOR framing issue #40
closed: completed andymccall opened this · 0 comments
andymccall
Backlog P1. The Linux tip's store is 390 MB after oxy gc against 311 MB for Git. Its content chunks compress to 312 MB at zstd level 3, level with Git. The rest comes from two things: gc leaves the first pack as written, and every line of a text blob carries a CBOR length header (35 MB compressed). Plan: gc repacks everything into one pack at a higher level (done: 357 MB), then change format version 3 stores text blobs as the file's bytes, re-split by the line rule.
Backlog P1. The Linux tip's store is 390 MB after oxy gc against 311 MB for Git. Its content chunks compress to 312 MB at zstd level 3, level with Git. The rest comes from two things: gc leaves the first pack as written, and every line of a text blob carries a CBOR length header (35 MB compressed). Plan: gc repacks everything into one pack at a higher level (done: 357 MB), then change format version 3 stores text blobs as the file's bytes, re-split by the line rule.