OXYGENHUB
# dbf06d342e1d oxygen / docs / guide.md
21.4 KiB · Markdown · last changed Refuse a bookmark at one head that leaves earlier work out 1 month ago renderedsource blame history raw
ee06a6c5 Andy McCall ↶ 1
# Oxygen user guide
2
3
This guide is organised by task. It assumes the `oxy` binary is on your
4
path (`cargo build --release` puts it in `target/release/`). The design
5
behind every command is in [spec.md]spec.md; this guide only tells you
6
what to type and what to expect.
7
8
Oxygen tracks *changes* rather than snapshots: a change is the set of
9
edits you made, it commutes with unrelated changes, and conflicts are
10
recorded in history instead of blocking you. Two ideas recur below:
11
12
- A **bookmark** (default `main`) names a *state*: the set of changes it
13
  contains. A state can have several **heads** when independent changes
14
  have not been related to each other; that is normal, not a problem.
15
- The **working copy** is itself a change that Oxygen rewrites every time
16
  it looks at your files. `oxy commit` turns it into a real change.
17
18
Output uses colour and glyphs on a terminal; pipe it, pass `--plain`, or set
19
`NO_COLOR` for plain ASCII.
20
21
## 1. Set yourself up
22
23
```
24
oxy identity create --name "Ada Lovelace" --email [email protected]
25
oxy config --user core.sign change
26
```
27
28
`identity create` generates a composite Ed25519 + ML-DSA-65 key pair, keeps
29
the secret in `~/.config/oxy/keys/`, and records you as the default author
30
in `~/.config/oxy/config.toml`. With `core.sign = change` every commit is
31
signed; without it, changes are sealed in batches when you push (also
32
authenticated, just later). Use `--local` to record the identity in one
33
repository only.
34
35
`oxy identity show` prints the key, its expiry, delegates, and whether the
36
secret is available. `oxy identity export` writes the public identity to a
37
file to hand to whoever manages a trust policy (section 8).
38
39
## 2. Start a repository
40
41
```
42
mkdir project && cd project
43
oxy init
44
oxy status
45
```
46
9ac1fbe2 Andy McCall ↶ 47
`oxy init` creates `.oxy/`. Add `.oxyignore` (gitignore syntax, per
48
directory, negations with `!`) for files that should never be tracked;
49
`/target` and `*.tmp` are typical entries. As in Git, ignore rules only
50
affect untracked files: a file already in history stays tracked until you
51
delete it.
ee06a6c5 Andy McCall ↶ 52
53
To take over an existing Git project, see section 12.
54
55
## 3. Everyday work
56
57
```
58
oxy status                 # what changed since the last commit
59
oxy diff                   # the edits, file by file
60
oxy commit -m "Add retry loop"
61
oxy log                    # newest first; -n 10, -v for full messages
62
oxy show 658990aa          # one change by ChangeId prefix, #hash prefix, or @
63
```
64
957fee30 Andy McCall ↶ 65
Commit part of what changed with `oxy commit PATH.. -m "..."` (only those
66
paths; the rest stays as uncommitted work) or `oxy commit -i -m "..."`, which
67
offers each hunk in turn like `git add -p`; a hunk that another chosen hunk
68
needs, such as the directory a new file lives in, comes along by itself.
69
50a046e4 Andy McCall ↶ 70
`status --json` prints the same for tools, with every conflict's kind, path and
71
contributing ChangeIds. On a terminal, `status` lists each path with a mark: `✚ added`, `✎ modified`, `✖ removed`,
ee06a6c5 Andy McCall ↶ 72
`➜ renamed`, `⚙ mode`. Renames are detected: a removed file and an added
73
file of the same kind whose contents are at least half alike are recorded
74
as a move of the same file, so identity survives a rename.
75
76
Files containing NUL bytes are stored whole ("opaque"); text files are
77
stored line by line and merge line by line. `.oxyattributes` overrides the
78
guess (section 14).
79
80
Every change has two names: a **ChangeId** (`658990aa…`) that survives
81
rewrites, and a content hash (`#7469d16c…`) that changes when the change is
82
edited. Use whichever you have; prefixes work.
83
fbda43e7 Andy McCall ↶ 84
## 3a. Bookmarks: branches without merges
85
86
A bookmark names a state; each workspace works on one (`main` to begin
87
with). Because changes commute, "merging" is the union of two bookmarks'
88
heads, with no merge change and any real conflict recorded as in section 6.
89
90
```
91
oxy bookmark create feature        # at the working copy's base
92
oxy bookmark switch feature        # check it out; commits now go here
93
oxy commit -m "Feature work"
94
oxy bookmark switch main
95
oxy merge feature                  # main now holds both; working copy follows if clean
96
oxy bookmark list                  # ● current, heads, ↑n/↓n against origin
97
oxy push -b feature                # publish a bookmark other than the current one
98
oxy bookmark set feature 658990aa  # move it; oxy bookmark delete feature to drop it
99
```
100
101
`oxy checkout feature` materialises a bookmark without switching to it, and
102
a bookmark name works wherever a change is expected when it has one head.
103
Each workspace remembers its own bookmark, so two directories can sit on
104
two bookmarks of one repository.
105
4fe7d604 Andy McCall ↶ 106
**A state is its heads, not a history.** If you are coming from Git, this
107
is the one thing to know. A bookmark holds its heads and what they depend
108
on, and a change depends only on the changes it builds on (the files it
109
touched), not on everything recorded before it. So on a bookmark with
110
several heads, a new bookmark at one change can be a much older-looking
111
tree. `oxy bookmark create NAME CHANGE` refuses when that would leave out
112
earlier work and lists what it would lack. Then pick one:
113
114
```
115
oxy bookmark create logo 745307b4 --upto  # everything here up to that change, as a Git branch would be
116
oxy bookmark create logo 745307b4 --only  # just that change and what it depends on
117
oxy bookmark create logo                  # the whole current state, usually what you want
118
```
119
120
`oxy bookmark switch` says when the bookmark you switch to lacks changes
121
that the one you left has.
122
314db9b4 Andy McCall ↶ 123
### A develop / feature flow
124
125
Names with `/` work everywhere, pushing included:
126
127
```
128
oxy bookmark create feature/42-login          # at the working copy's base
129
oxy bookmark switch feature/42-login --carry  # started already? take the edits along
130
oxy commit -F msg.txt                         # a long message from a file
131
oxy push -b feature/42-login
132
oxy bookmark switch develop
133
oxy merge feature/42-login                    # the working copy follows when it was clean
134
oxy push                                      # develop, with the feature in it
135
oxy bookmark delete feature/42-login          # oxy push --delete feature/42-login on the remote
136
```
137
138
`bookmark switch` stops when the working copy has uncommitted edits, so
139
nothing is lost by accident. There are two ways past it:
140
- `--carry` takes the edits along. It is refused only when the target
141
  bookmark has other versions of the files they touch.
142
- `--discard` drops the edits.
143
144
`oxy describe` names what the working copy holds, for build stamps:
145
- a tag, when a tag holds exactly this state;
146
- otherwise the nearest tag with the distance from it and the change;
147
- or, with no tag behind it, the bookmark and the change;
148
- with `-dirty` added when there are uncommitted edits.
149
ee06a6c5 Andy McCall ↶ 150
## 4. Fix up history
151
152
Oxygen keeps its own record of every operation, so all of these are safe to
153
try and to undo.
154
155
```
156
oxy describe -m "Better message"        # reword the head the working copy sits on
157
oxy describe 658990aa -m "..."          # reword any change; dependents are rewritten
158
oxy amend                               # fold the working copy into the head
159
oxy amend --into 658990aa               # fold it into an older change
160
oxy split 658990aa src/parser.rs        # split a head: those paths become a separate first change
161
oxy abandon 658990aa                    # drop a change; its content stays on disk
728da0f9 Andy McCall ↶ 162
oxy squash 658990aa --into 9df9ac29     # fold a change into one it depends on
163
oxy rebase 658990aa --onto feature      # re-express a change against another base
ee06a6c5 Andy McCall ↶ 164
oxy undo                                # undo the last operation, whatever it was
165
oxy op log                              # the operation log
166
```
167
168
Rewriting a change that others depend on rewrites them too, keeping their
728da0f9 Andy McCall ↶ 169
ChangeIds. Because unrelated changes already coexist, `rebase` is rarely
170
needed; its job is to change what a change is said to build on, for instance
171
to drop a dependency on something you are about to abandon. Where a dependent referred to a line that no longer exists, the
ee06a6c5 Andy McCall ↶ 172
reference is re-anchored to the nearest surviving line and `oxy abandon`
173
prints a note about it.
174
957fee30 Andy McCall ↶ 175
## 4a. Who wrote this, and what broke it
176
177
```
178
oxy blame src/parser.rs          # every line: the change that introduced it, author, age
179
oxy blame src/parser.rs --json
180
```
181
182
Blame is exact: each line is an atom that remembers the change that
183
introduced it, so renames cost nothing and there is no heuristic.
184
185
```
186
oxy bisect start
187
oxy bisect good v1.2             # a change, bookmark or tag known to be fine
188
oxy bisect bad main              # and one known to be broken
189
oxy bisect run make test         # exit 0 good, 125 skip, anything else bad
190
oxy bisect reset                 # back to where you were
191
```
192
193
Without `run`, each step checks out a state to test and you answer with
194
`oxy bisect good`, `bad`, or `skip`. The candidates are the changes the bad
195
state has that the good one lacks, ordered so every tested state is
196
well-formed; the answer is the first change whose inclusion breaks things.
197
ee06a6c5 Andy McCall ↶ 198
## 5. Move around
199
200
```
201
oxy checkout                    # the bookmark's heads
202
oxy checkout 658990aa           # the state of one change and its dependencies
203
oxy checkout v1.2               # a tag
204
oxy checkout --discard ...      # throw away uncommitted work first
205
```
206
207
Checking out a single older change gives you the files that change and its
208
dependencies touch, not a full snapshot from that date: in Oxygen a change
209
depends only on what it actually builds on.
210
211
## 6. Conflicts
212
213
A conflict never stops a commit, fetch, or pull. It is recorded in the
214
state and shown by `oxy status`, which exits with status 2 while any
215
conflict remains. Conflicted text files are written with markers:
216
217
```
218
<<<<<<< oxy conflict 1 of 2, side 1: change k7m2p9 "Add retry loop"
219
... lines ...
220
======= oxy conflict 1 of 2, side 2: change q3x8w1 "Refactor client"
221
... lines ...
222
>>>>>>> oxy conflict 1 of 2 end
223
```
224
225
Edit the file to what it should be (keep one side, both, or neither) and
226
remove the markers. Tree conflicts, such as two files wanting the same
227
name, appear as `<name>.oxy-conflict-<n>` candidates: keep the one you
228
want under the right name and delete the rest.
229
230
```
231
oxy resolve      # which conflicts your edits resolve, which still have markers
232
oxy commit -m "Resolve retry vs refactor"
233
```
234
235
The commit is recorded as a *resolution*, a change that depends on every
236
side of the conflict; anyone who fetches it gets the conflict resolved.
237
238
## 7. Work with others
239
240
Run a server (any machine with the repositories under one directory):
241
242
```
243
oxy serve --root /srv/oxy --bind 0.0.0.0:8890 --token SECRET \
244
          --tls-cert cert.pem --tls-key key.pem
245
```
246
247
Without `--tls-*` the server speaks plain HTTP; keep that on a loopback
248
address or behind a TLS terminator. `--token` makes pushes require a bearer
249
token; reads stay open.
250
251
On your machine:
252
253
```
254
oxy clone https://host:8890/project
255
cd project
256
oxy config remote.origin.token SECRET   # or export OXY_TOKEN
257
oxy config remote.origin.ca my-ca.pem   # self-signed server: extra roots to trust (or OXY_CA)
258
oxy push
259
oxy pull
260
```
261
262
- `oxy fetch` updates `origin/main` without touching your bookmark.
263
- `oxy pull` fetches, then makes your bookmark the union of both sides.
264
  There is no merge commit; unrelated changes simply coexist, and a real
265
  conflict is recorded as in section 6. The working copy follows when it was
266
  clean.
267
- `oxy push` sends your changes and moves the remote bookmark. If the remote
268
  moved since you last fetched, the push is refused: pull and push again.
269
  `--force` overrides the compare-and-swap.
270
- `oxy remote add|remove|list` manages remotes; the clone source is `origin`.
271
272
A repository can also be cloned from a local path, which is handy for tests
273
and for a bare "hub" on a shared disk.
274
275
## 8. Decide who may publish: the trust policy
276
277
Without a policy a repository is *unverified*: everything is accepted and
278
every remote command says so. A policy names root keys and the keys allowed
279
to update each bookmark; servers and clients enforce it.
280
281
```
282
oxy policy init                    # your key becomes the only root; push publishes it
283
oxy policy show
284
oxy policy grant alice.identity    # alice.identity came from her `oxy identity export`
285
oxy policy grant ci.identity --pattern 'release/*'
286
oxy policy revoke 9458b656         # by KeyId prefix
287
oxy verify                         # signature status of every change in the log
288
```
289
290
Several people can hold root keys:
291
292
```
293
oxy policy root add bob.identity
294
oxy policy root threshold 2        # future updates need two root signatures
295
```
296
297
Once the threshold is above one, an update you make alone becomes a
298
*proposal file* (`policy-<serial>.proposal`, or `--out`). Send it to another
299
root holder, who runs `oxy policy sign policy-7.proposal`; whoever completes
300
the threshold applies it, and the next push publishes it. Everyone else
301
picks it up on fetch, verifying each step from the policy they already
302
trust.
303
304
## 9. Keys over time
305
306
```
307
oxy identity rotate                   # fresh key pair; old signatures stay valid
308
oxy identity renew --expires 365      # same keys, new expiry in days (0 = never)
309
oxy identity delegate add ci.identity # let another key sign on your behalf
310
oxy identity delegate remove 3f2a…
311
oxy identity revoke                   # retire your own key
312
oxy identity revoke 3f2a… --reason "laptop stolen"   # any key, if you hold a root
313
```
314
315
Rotation, renewal, and delegation all issue a successor identity that names
316
the previous one. If a policy names your key, it is updated to the successor
317
in the same step (as a proposal when more root signatures are needed).
318
Changes signed before the rotation remain authorised; a revoked key
319
authorises nothing. `oxy verify` shows signatures by revoked keys as valid
320
but revoked.
321
322
## 10. Tags and workspaces
323
324
```
325
oxy tag create v1.2 -m "First release"   # the current heads; or name changes
326
oxy tag list
327
oxy workspace add ../project-hotfix      # a second checkout sharing the repository
328
oxy workspace list
329
oxy workspace forget ../project-hotfix
330
```
331
332
A tag is an immutable state, signed when you have a key, and travels with
333
push and fetch. Workspaces have their own working copy and bookmark
334
(`workspace.bookmark`) but share objects and history.
335
fc1a466a Andy McCall ↶ 336
### Receipts from CI
337
338
A runner such as OxygenFlow signs a receipt for every job it runs: what ran,
339
in what environment, on which files, and the result. Receipts are kept with
340
the state they ran on.
341
342
```
343
oxy receipt list                         # receipts for the bookmark's state
344
oxy receipt show 3f2a9c                  # one in full, with its signature checked
345
oxy receipt export 3f2a9c build.receipt  # hand it to someone
346
oxy receipt verify build.receipt         # check one without keeping it
347
oxy receipt import build.receipt         # verify and keep it
348
```
349
ee06a6c5 Andy McCall ↶ 350
## 11. Big repositories: partial, sparse, shallow
351
352
```
353
oxy clone URL --max-blob 1M          # files above 1 MiB are fetched on first read
354
oxy clone URL --sparse src --sparse docs   # materialise only these subtrees
355
oxy clone URL --depth 50             # only the last 50 levels of history
356
oxy sparse src docs tests            # change the filter later
357
oxy deepen 100                       # fetch more history below the boundary
358
```
359
360
Lazy blobs and sparse trees do not affect commits: what you do not have is
361
left exactly as it was. A shallow clone starts from a *checkpoint* of the
362
state, so status and commit work at full speed from the first minute.
363
4dee277c Andy McCall ↶ 364
## 11a. Nested repositories (submodules)
365
366
A subrepo is another repository checked out at a path and pinned to a state,
367
Oxygen or Git. The pin is versioned like a file, so two people pinning
368
different states get an ordinary conflict.
369
370
```
371
oxy submodule add https://host/lib.git libs/lib     # Git or Oxygen URL; records .oxymodules
372
oxy commit -m "Add lib"                              # the pin is committed with the parent
373
oxy submodule status                                 # pin vs what is on disk
374
oxy submodule update --init                          # after a clone: fetch nested repositories
375
oxy submodule remove libs/lib                        # drop the node; the directory stays
376
```
377
378
Committing the parent records whatever the nested repository is at, and
379
checking out an older parent state moves the nested repository back, unless
380
it has uncommitted changes, which are never overwritten. An absent nested
381
repository keeps its pin until you run `update --init`. Git submodules
382
survive `oxy git import` as Git pins and go back out as gitlinks on export.
383
ee06a6c5 Andy McCall ↶ 384
## 12. Git interoperability
385
386
```
387
oxy git import ../project.git ./project-oxy --branch main   # convert a Git history
388
oxy git fetch https://github.com/you/project.git            # bring new Git commits in
389
oxy git push  https://github.com/you/project.git            # publish your changes to Git
390
oxy git export ../mirror.git                                # a plain Git mirror of the bookmark
391
```
392
393
Import turns each commit into one change (merge commits become
394
resolutions), keeps authors and hashes as `Git-Author`/`Git-Commit`
395
trailers, detects renames, and skips submodules. `git fetch`/`git push` keep
396
a bare mirror under `.oxy/git/`; a push is refused until the remote's tip
397
has been fetched, so it always fast-forwards. Exported commits carry
398
`Change-Id` and `Oxy-Hash` trailers.
399
400
## 13. Automate: hooks
401
402
Executables in `.oxy/hooks/<event>` (never cloned) receive one JSON object
403
on stdin. `pre-commit`, `pre-push` and other `pre-*` hooks veto by exiting
404
non-zero, and their stderr becomes the error message. Events:
405
`pre-commit`, `post-commit`, `pre-push`, `post-fetch`, `post-checkout`, and
406
`semantic-deps`, which runs at commit when `hooks.semantic-deps = true` and
407
answers `{"deps": ["<hash>", …]}` to make the change depend on more than it
408
textually references.
409
410
## 14. Per-path attributes, ignores, locks
411
412
`.oxyattributes` uses gitattributes syntax:
413
414
```
415
*.png     binary
416
*.txt     text eol=lf
417
*.psd     lockable nocompress
418
```
419
420
`binary`/`text` override content sniffing, `eol=lf|crlf` normalises line
421
endings in the store and on checkout, `nocompress` stores chunks raw, and
422
`lockable` files are checked out read-only until you take the local lock:
423
424
```
425
oxy lock assets/logo.psd
426
oxy unlock assets/logo.psd
427
```
428
429
Locks are advisory and local; server-side locks are planned.
430
431
## 15. Configuration
432
433
Two files, both `key = "value"` lines: `~/.config/oxy/config.toml`
434
(`oxy config --user KEY VALUE`) and `.oxy/config` (`oxy config KEY VALUE`).
0bdc3f91 Andy McCall ↶ 435
The repository file wins. `OXY_HOME` relocates the user directory. `OXY_TIMINGS=1` prints how long each phase of a snapshot takes (loading the base state, rendering it, reading the working copy, building the change) to standard error, for finding out where a slow command spends its time.
ee06a6c5 Andy McCall ↶ 436
437
| Key | Meaning |
438
|---|---|
439
| `author.name`, `author.email`, `author.key` | who you are; `key` is set by `identity create` |
440
| `core.sign` | `change` to sign every commit; otherwise seals at push |
441
| `core.op-retention` | days for which old operations keep their states alive (90) |
442
| `core.gc-grace` | days an unreachable object survives (14) |
443
| `core.checkpoint-interval` | changes between automatic checkpoints (256) |
444
| `filter.max-blob`, `filter.paths` | lazy blobs and sparse subtrees (section 11) |
445
| `hooks.semantic-deps` | run the semantic-deps hook at commit |
446
| `workspace.bookmark` | this workspace's bookmark (`main`) |
447
| `remote.<name>.url`, `.token`, `.ca` | remotes; token and CA fall back to `OXY_TOKEN` and `OXY_CA` |
448
449
## 16. Shell prompt
450
451
`oxy prompt` prints `main 658990aa*+2` (bookmark, working copy, `*` dirty,
452
`!` conflicted, ahead/behind origin) in a few milliseconds and records
453
nothing. See [prompt.md]prompt.md for bash, oh-my-bash, zsh, and fish
454
snippets and the `--format` placeholders.
455
456
## 17. Housekeeping
457
458
```
459
oxy gc              # pack loose objects, prune unreachable ones past the grace period
460
oxy gc --now        # ignore the grace period (only when nothing else is writing)
387335ff Andy McCall ↶ 461
oxy fsck            # check every object, the op log, references, signatures, checkpoints
3e5772cc Andy McCall ↶ 462
oxy doctor          # check identity, config and remotes, with what to do about each problem
ee06a6c5 Andy McCall ↶ 463
oxy checkpoint      # serialise the bookmark's state so large histories load instantly
464
```
465
466
Both run automatically: packing when loose objects pile up, checkpoints
467
every `core.checkpoint-interval` changes.
468
c6aa5bd9 Andy McCall ↶ 469
## 17a. Scripting and editors
470
471
Every reporting command takes `--json` (`status`, `log --path`, `show`,
472
`diff`, `hunks`, `blame`, `resolve`, `op log`, `bookmark list`, `remote list`,
473
`fetch`, `pull`, `push`, `submodule status`, `bisect status`, `verify`,
474
`policy show`, `root`, `version`). `oxy cat PATH -r CHANGE` prints a file as
475
it was, `oxy discard PATH..` restores files to the base, and `oxy hunks`
476
numbers the working copy's hunks for `commit --hunks` and `discard --hunks`.
477
ee06a6c5 Andy McCall ↶ 478
## 18. If something looks wrong
479
480
- **"the remote has change … which you do not; pull first"**: someone
481
  pushed since your last fetch. `oxy pull`, then push.
482
- **"policy needs N root signature(s)"** on fetch: the server's policy was
483
  updated in a way your copy cannot verify. Ask a root holder whether the
484
  chain of updates was published; a fresh clone trusts the current policy.
485
- **`oxy status` exits 2**: conflicts remain; see section 6.
486
- **Many heads on `main`**: independent changes that do not reference one
487
  another. Nothing to fix; the state is their union.
488
- **Undo anything**: `oxy undo` reverts the last operation, including
489
  pulls, checkouts, and rewrites.
d42369ab Andy McCall 490
491
## Shell completions and man pages
492
493
```sh
494
oxy completions bash > ~/.local/share/bash-completion/completions/oxy   # bash
495
oxy completions zsh > "${fpath[1]}/_oxy"                                 # zsh
496
oxy completions fish > ~/.config/fish/completions/oxy.fish               # fish
497
oxy man --dir ~/.local/share/man/man1                                    # then: man oxy-commit
498
```
499
500
The oh-my-bash plugin in `contrib/oh-my-bash` loads the bash completions itself.