Backlog 3: the full vscode import, and what it needs next 2517abe64654
refs #35
- Author
- Andy McCall @andymccall <[email protected]>
- When
- · 2026-09-30 03:43 UTC
- Signature
- ✔ signed by Andy McCall
- Hash
2517abe64654dbbf11a0ea52b9ca2d53cbc000c398326655704b0d70d0aae84a- Depends on
- 1681323d1dff 33e77a5526fa 36695c5e02ef
- Depended on by
- f6451fbbae3f
- In bookmarks
- agents-in-readme bare-hashes carried-not-removed carry-identical doctor-trust identical-sides keyless-tags main merge-remote-bookmark only-help-103 paths-for-resolutions-and-amend push-notes show-stat subrepo-pin-state switch-says
- In tags
- v0.1.0 v0.10.0 v0.11.0 v0.2.0 v0.3.0 v0.3.1 v0.4.0 v0.4.1 v0.4.2 v0.4.3 v0.4.4 v0.4.5 v0.4.6 v0.5.0 v0.5.1 v0.6.0 v0.7.0 v0.8.0 v0.9.0
- Edits
- 1 atom, 0 tree operations, 1 file
Browse the tree at this change
modified docs/backlog-overnight-3.md +3 −0
| … | 206 unchanged lines |
||
| 207 | 207 | - **Format 3**: text blobs hold the lines' bytes, with no CBOR framing (1122dcb3). The runner (oxygenflow#16) and hub (oxygenhub#59) were deployed with the new reader first. |
|
| 208 | 208 | - **Linux tip**: the store is 324 MB after gc (objects 306 MB; Git 311 MB). The first commit takes 32.6 s (Git 33.7 to 37.9 s), measured while Earth ran at load average 11 during the vscode import. |
|
| 209 | 209 | - **H2**: the vscode import (H4) runs on Earth as a service. |
|
| 210 | + | - 2026-09-30 **H4 attempted**: the full vscode import (166 425 commits) under a 14 GB cap. With changes added mixed (e15074c7), it still grew about 0.4 MB per commit: 4.3 GB after 35 minutes and roughly 9 000 commits, far past the cap long before the end. It was stopped. The growth is the importer's kept states: each is a deep clone of a history-only state (change metadata, tree maps, the deferred edits of every file), up to eight at a time, with a new clone at every branch point. |
|
| 211 | + | - **Next (H2b)**: make a state cheap to clone by sharing its parts (per-file deferred entries and graphs behind `Arc`, copied on write; the change map and tree likewise), so kept states share what they have in common. |
|
| 212 | + | - **Also**: an import should report progress on long runs. |
|
| 210 | 213 |