OXYGENHUB
# b9bf7eec1f2d oxygen / docs / guide.md
22.1 KiB · Markdown · last changed bookmark create/set --only: say that it can leave a file partly edited 23 days ago renderedsource blame history raw
ee06a6c5 Andy McCall ↶ 1
# Oxygen user guide
2
3
This guide is organised by task. It assumes the `oxy` binary is on your
4
path (`cargo build --release` puts it in `target/release/`). The design
5
behind every command is in [spec.md]spec.md; this guide only tells you
6
what to type and what to expect.
7
8
Oxygen tracks *changes* rather than snapshots: a change is the set of
9
edits you made, it commutes with unrelated changes, and conflicts are
10
recorded in history instead of blocking you. Two ideas recur below:
11
12
- A **bookmark** (default `main`) names a *state*: the set of changes it
13
  contains. A state can have several **heads** when independent changes
14
  have not been related to each other; that is normal, not a problem.
15
- The **working copy** is itself a change that Oxygen rewrites every time
16
  it looks at your files. `oxy commit` turns it into a real change.
17
18
Output uses colour and glyphs on a terminal; pipe it, pass `--plain`, or set
19
`NO_COLOR` for plain ASCII.
20
21
## 1. Set yourself up
22
23
```
24
oxy identity create --name "Ada Lovelace" --email [email protected]
25
oxy config --user core.sign change
26
```
27
28
`identity create` generates a composite Ed25519 + ML-DSA-65 key pair, keeps
29
the secret in `~/.config/oxy/keys/`, and records you as the default author
30
in `~/.config/oxy/config.toml`. With `core.sign = change` every commit is
31
signed; without it, changes are sealed in batches when you push (also
32
authenticated, just later). Use `--local` to record the identity in one
33
repository only.
34
35
`oxy identity show` prints the key, its expiry, delegates, and whether the
36
secret is available. `oxy identity export` writes the public identity to a
37
file to hand to whoever manages a trust policy (section 8).
38
39
## 2. Start a repository
40
41
```
42
mkdir project && cd project
43
oxy init
44
oxy status
45
```
46
9ac1fbe2 Andy McCall ↶ 47
`oxy init` creates `.oxy/`. Add `.oxyignore` (gitignore syntax, per
48
directory, negations with `!`) for files that should never be tracked;
49
`/target` and `*.tmp` are typical entries. As in Git, ignore rules only
50
affect untracked files: a file already in history stays tracked until you
51
delete it.
ee06a6c5 Andy McCall ↶ 52
53
To take over an existing Git project, see section 12.
54
55
## 3. Everyday work
56
57
```
58
oxy status                 # what changed since the last commit
59
oxy diff                   # the edits, file by file
60
oxy commit -m "Add retry loop"
61
oxy log                    # newest first; -n 10, -v for full messages
62
oxy show 658990aa          # one change by ChangeId prefix, #hash prefix, or @
63
```
64
957fee30 Andy McCall ↶ 65
Commit part of what changed with `oxy commit PATH.. -m "..."` (only those
66
paths; the rest stays as uncommitted work) or `oxy commit -i -m "..."`, which
67
offers each hunk in turn like `git add -p`; a hunk that another chosen hunk
68
needs, such as the directory a new file lives in, comes along by itself.
69
50a046e4 Andy McCall ↶ 70
`status --json` prints the same for tools, with every conflict's kind, path and
71
contributing ChangeIds. On a terminal, `status` lists each path with a mark: `✚ added`, `✎ modified`, `✖ removed`,
ee06a6c5 Andy McCall ↶ 72
`➜ renamed`, `⚙ mode`. Renames are detected: a removed file and an added
73
file of the same kind whose contents are at least half alike are recorded
74
as a move of the same file, so identity survives a rename.
75
76
Files containing NUL bytes are stored whole ("opaque"); text files are
77
stored line by line and merge line by line. `.oxyattributes` overrides the
78
guess (section 14).
79
80
Every change has two names: a **ChangeId** (`658990aa…`) that survives
81
rewrites, and a content hash (`#7469d16c…`) that changes when the change is
82
edited. Use whichever you have; prefixes work.
83
fbda43e7 Andy McCall ↶ 84
## 3a. Bookmarks: branches without merges
85
86
A bookmark names a state; each workspace works on one (`main` to begin
87
with). Because changes commute, "merging" is the union of two bookmarks'
88
heads, with no merge change and any real conflict recorded as in section 6.
89
90
```
91
oxy bookmark create feature        # at the working copy's base
92
oxy bookmark switch feature        # check it out; commits now go here
93
oxy commit -m "Feature work"
94
oxy bookmark switch main
95
oxy merge feature                  # main now holds both; working copy follows if clean
96
oxy bookmark list                  # ● current, heads, ↑n/↓n against origin
97
oxy push -b feature                # publish a bookmark other than the current one
98
oxy bookmark set feature 658990aa  # move it; oxy bookmark delete feature to drop it
99
```
100
101
`oxy checkout feature` materialises a bookmark without switching to it, and
102
a bookmark name works wherever a change is expected when it has one head.
103
Each workspace remembers its own bookmark, so two directories can sit on
104
two bookmarks of one repository.
105
4fe7d604 Andy McCall ↶ 106
**A state is its heads, not a history.** If you are coming from Git, this
107
is the one thing to know. A bookmark holds its heads and what they depend
108
on, and a change depends only on the changes it builds on (the files it
109
touched), not on everything recorded before it. So on a bookmark with
110
several heads, a new bookmark at one change can be a much older-looking
111
tree. `oxy bookmark create NAME CHANGE` refuses when that would leave out
112
earlier work and lists what it would lack. Then pick one:
113
114
```
115
oxy bookmark create logo 745307b4 --upto  # everything here up to that change, as a Git branch would be
116
oxy bookmark create logo 745307b4 --only  # just that change and what it depends on
117
oxy bookmark create logo                  # the whole current state, usually what you want
118
```
119
06d16dc2 Andy McCall ↶ 120
`oxy bookmark set NAME CHANGE` asks the same when the move would lose
121
changes the bookmark holds that were recorded before CHANGE, and takes
122
`--upto` and `--only` too. After merging a proposal's target into its
123
bookmark to resolve conflicts, `oxy bookmark set NAME CHANGE --upto`
124
keeps everything the bookmark held.
125
b9bf7eec Andy McCall ↶ 126
`--only` is exact, and that can surprise: other changes to the same files
127
are left out, so a file can come out partly edited (a pipeline file that
128
no longer parses, say). To put one change on top of a bookmark's work,
129
give that bookmark's heads with it, as `oxy bookmark show main` prints
130
them: `oxy bookmark set fix <main's heads> 745307b4`.
131
4fe7d604 Andy McCall ↶ 132
`oxy bookmark switch` says when the bookmark you switch to lacks changes
133
that the one you left has.
134
314db9b4 Andy McCall ↶ 135
### A develop / feature flow
136
137
Names with `/` work everywhere, pushing included:
138
139
```
140
oxy bookmark create feature/42-login          # at the working copy's base
141
oxy bookmark switch feature/42-login --carry  # started already? take the edits along
142
oxy commit -F msg.txt                         # a long message from a file
143
oxy push -b feature/42-login
144
oxy bookmark switch develop
145
oxy merge feature/42-login                    # the working copy follows when it was clean
146
oxy push                                      # develop, with the feature in it
147
oxy bookmark delete feature/42-login          # oxy push --delete feature/42-login on the remote
148
```
149
150
`bookmark switch` stops when the working copy has uncommitted edits, so
151
nothing is lost by accident. There are two ways past it:
152
- `--carry` takes the edits along. It is refused only when the target
153
  bookmark has other versions of the files they touch.
154
- `--discard` drops the edits.
155
156
`oxy describe` names what the working copy holds, for build stamps:
157
- a tag, when a tag holds exactly this state;
158
- otherwise the nearest tag with the distance from it and the change;
159
- or, with no tag behind it, the bookmark and the change;
160
- with `-dirty` added when there are uncommitted edits.
161
ee06a6c5 Andy McCall ↶ 162
## 4. Fix up history
163
164
Oxygen keeps its own record of every operation, so all of these are safe to
165
try and to undo.
166
167
```
168
oxy describe -m "Better message"        # reword the head the working copy sits on
169
oxy describe 658990aa -m "..."          # reword any change; dependents are rewritten
170
oxy amend                               # fold the working copy into the head
171
oxy amend --into 658990aa               # fold it into an older change
172
oxy split 658990aa src/parser.rs        # split a head: those paths become a separate first change
173
oxy abandon 658990aa                    # drop a change; its content stays on disk
728da0f9 Andy McCall ↶ 174
oxy squash 658990aa --into 9df9ac29     # fold a change into one it depends on
175
oxy rebase 658990aa --onto feature      # re-express a change against another base
ee06a6c5 Andy McCall ↶ 176
oxy undo                                # undo the last operation, whatever it was
177
oxy op log                              # the operation log
178
```
179
180
Rewriting a change that others depend on rewrites them too, keeping their
728da0f9 Andy McCall ↶ 181
ChangeIds. Because unrelated changes already coexist, `rebase` is rarely
182
needed; its job is to change what a change is said to build on, for instance
183
to drop a dependency on something you are about to abandon. Where a dependent referred to a line that no longer exists, the
ee06a6c5 Andy McCall ↶ 184
reference is re-anchored to the nearest surviving line and `oxy abandon`
185
prints a note about it.
186
957fee30 Andy McCall ↶ 187
## 4a. Who wrote this, and what broke it
188
189
```
190
oxy blame src/parser.rs          # every line: the change that introduced it, author, age
191
oxy blame src/parser.rs --json
192
```
193
194
Blame is exact: each line is an atom that remembers the change that
195
introduced it, so renames cost nothing and there is no heuristic.
196
197
```
198
oxy bisect start
199
oxy bisect good v1.2             # a change, bookmark or tag known to be fine
200
oxy bisect bad main              # and one known to be broken
201
oxy bisect run make test         # exit 0 good, 125 skip, anything else bad
202
oxy bisect reset                 # back to where you were
203
```
204
205
Without `run`, each step checks out a state to test and you answer with
206
`oxy bisect good`, `bad`, or `skip`. The candidates are the changes the bad
207
state has that the good one lacks, ordered so every tested state is
208
well-formed; the answer is the first change whose inclusion breaks things.
209
ee06a6c5 Andy McCall ↶ 210
## 5. Move around
211
212
```
213
oxy checkout                    # the bookmark's heads
214
oxy checkout 658990aa           # the state of one change and its dependencies
215
oxy checkout v1.2               # a tag
216
oxy checkout --discard ...      # throw away uncommitted work first
217
```
218
219
Checking out a single older change gives you the files that change and its
220
dependencies touch, not a full snapshot from that date: in Oxygen a change
221
depends only on what it actually builds on.
222
223
## 6. Conflicts
224
225
A conflict never stops a commit, fetch, or pull. It is recorded in the
226
state and shown by `oxy status`, which exits with status 2 while any
227
conflict remains. Conflicted text files are written with markers:
228
229
```
230
<<<<<<< oxy conflict 1 of 2, side 1: change k7m2p9 "Add retry loop"
231
... lines ...
232
======= oxy conflict 1 of 2, side 2: change q3x8w1 "Refactor client"
233
... lines ...
234
>>>>>>> oxy conflict 1 of 2 end
235
```
236
237
Edit the file to what it should be (keep one side, both, or neither) and
238
remove the markers. Tree conflicts, such as two files wanting the same
239
name, appear as `<name>.oxy-conflict-<n>` candidates: keep the one you
240
want under the right name and delete the rest.
241
242
```
243
oxy resolve      # which conflicts your edits resolve, which still have markers
244
oxy commit -m "Resolve retry vs refactor"
245
```
246
247
The commit is recorded as a *resolution*, a change that depends on every
248
side of the conflict; anyone who fetches it gets the conflict resolved.
249
250
## 7. Work with others
251
252
Run a server (any machine with the repositories under one directory):
253
254
```
255
oxy serve --root /srv/oxy --bind 0.0.0.0:8890 --token SECRET \
256
          --tls-cert cert.pem --tls-key key.pem
257
```
258
259
Without `--tls-*` the server speaks plain HTTP; keep that on a loopback
260
address or behind a TLS terminator. `--token` makes pushes require a bearer
261
token; reads stay open.
262
263
On your machine:
264
265
```
266
oxy clone https://host:8890/project
267
cd project
268
oxy config remote.origin.token SECRET   # or export OXY_TOKEN
269
oxy config remote.origin.ca my-ca.pem   # self-signed server: extra roots to trust (or OXY_CA)
270
oxy push
271
oxy pull
272
```
273
274
- `oxy fetch` updates `origin/main` without touching your bookmark.
275
- `oxy pull` fetches, then makes your bookmark the union of both sides.
276
  There is no merge commit; unrelated changes simply coexist, and a real
277
  conflict is recorded as in section 6. The working copy follows when it was
278
  clean.
279
- `oxy push` sends your changes and moves the remote bookmark. If the remote
280
  moved since you last fetched, the push is refused: pull and push again.
281
  `--force` overrides the compare-and-swap.
282
- `oxy remote add|remove|list` manages remotes; the clone source is `origin`.
283
284
A repository can also be cloned from a local path, which is handy for tests
285
and for a bare "hub" on a shared disk.
286
287
## 8. Decide who may publish: the trust policy
288
289
Without a policy a repository is *unverified*: everything is accepted and
290
every remote command says so. A policy names root keys and the keys allowed
291
to update each bookmark; servers and clients enforce it.
292
293
```
294
oxy policy init                    # your key becomes the only root; push publishes it
295
oxy policy show
296
oxy policy grant alice.identity    # alice.identity came from her `oxy identity export`
297
oxy policy grant ci.identity --pattern 'release/*'
298
oxy policy revoke 9458b656         # by KeyId prefix
299
oxy verify                         # signature status of every change in the log
300
```
301
302
Several people can hold root keys:
303
304
```
305
oxy policy root add bob.identity
306
oxy policy root threshold 2        # future updates need two root signatures
307
```
308
309
Once the threshold is above one, an update you make alone becomes a
310
*proposal file* (`policy-<serial>.proposal`, or `--out`). Send it to another
311
root holder, who runs `oxy policy sign policy-7.proposal`; whoever completes
312
the threshold applies it, and the next push publishes it. Everyone else
313
picks it up on fetch, verifying each step from the policy they already
314
trust.
315
316
## 9. Keys over time
317
318
```
319
oxy identity rotate                   # fresh key pair; old signatures stay valid
320
oxy identity renew --expires 365      # same keys, new expiry in days (0 = never)
321
oxy identity delegate add ci.identity # let another key sign on your behalf
322
oxy identity delegate remove 3f2a…
323
oxy identity revoke                   # retire your own key
324
oxy identity revoke 3f2a… --reason "laptop stolen"   # any key, if you hold a root
325
```
326
327
Rotation, renewal, and delegation all issue a successor identity that names
328
the previous one. If a policy names your key, it is updated to the successor
329
in the same step (as a proposal when more root signatures are needed).
330
Changes signed before the rotation remain authorised; a revoked key
331
authorises nothing. `oxy verify` shows signatures by revoked keys as valid
332
but revoked.
333
334
## 10. Tags and workspaces
335
336
```
337
oxy tag create v1.2 -m "First release"   # the current heads; or name changes
338
oxy tag list
339
oxy workspace add ../project-hotfix      # a second checkout sharing the repository
340
oxy workspace list
341
oxy workspace forget ../project-hotfix
342
```
343
344
A tag is an immutable state, signed when you have a key, and travels with
345
push and fetch. Workspaces have their own working copy and bookmark
346
(`workspace.bookmark`) but share objects and history.
347
fc1a466a Andy McCall ↶ 348
### Receipts from CI
349
350
A runner such as OxygenFlow signs a receipt for every job it runs: what ran,
351
in what environment, on which files, and the result. Receipts are kept with
352
the state they ran on.
353
354
```
355
oxy receipt list                         # receipts for the bookmark's state
356
oxy receipt show 3f2a9c                  # one in full, with its signature checked
357
oxy receipt export 3f2a9c build.receipt  # hand it to someone
358
oxy receipt verify build.receipt         # check one without keeping it
359
oxy receipt import build.receipt         # verify and keep it
360
```
361
ee06a6c5 Andy McCall ↶ 362
## 11. Big repositories: partial, sparse, shallow
363
364
```
365
oxy clone URL --max-blob 1M          # files above 1 MiB are fetched on first read
366
oxy clone URL --sparse src --sparse docs   # materialise only these subtrees
367
oxy clone URL --depth 50             # only the last 50 levels of history
368
oxy sparse src docs tests            # change the filter later
369
oxy deepen 100                       # fetch more history below the boundary
370
```
371
372
Lazy blobs and sparse trees do not affect commits: what you do not have is
373
left exactly as it was. A shallow clone starts from a *checkpoint* of the
374
state, so status and commit work at full speed from the first minute.
375
4dee277c Andy McCall ↶ 376
## 11a. Nested repositories (submodules)
377
378
A subrepo is another repository checked out at a path and pinned to a state,
379
Oxygen or Git. The pin is versioned like a file, so two people pinning
380
different states get an ordinary conflict.
381
382
```
383
oxy submodule add https://host/lib.git libs/lib     # Git or Oxygen URL; records .oxymodules
384
oxy commit -m "Add lib"                              # the pin is committed with the parent
385
oxy submodule status                                 # pin vs what is on disk
386
oxy submodule update --init                          # after a clone: fetch nested repositories
387
oxy submodule remove libs/lib                        # drop the node; the directory stays
388
```
389
390
Committing the parent records whatever the nested repository is at, and
391
checking out an older parent state moves the nested repository back, unless
392
it has uncommitted changes, which are never overwritten. An absent nested
393
repository keeps its pin until you run `update --init`. Git submodules
394
survive `oxy git import` as Git pins and go back out as gitlinks on export.
395
ee06a6c5 Andy McCall ↶ 396
## 12. Git interoperability
397
398
```
399
oxy git import ../project.git ./project-oxy --branch main   # convert a Git history
400
oxy git fetch https://github.com/you/project.git            # bring new Git commits in
401
oxy git push  https://github.com/you/project.git            # publish your changes to Git
402
oxy git export ../mirror.git                                # a plain Git mirror of the bookmark
403
```
404
405
Import turns each commit into one change (merge commits become
406
resolutions), keeps authors and hashes as `Git-Author`/`Git-Commit`
407
trailers, detects renames, and skips submodules. `git fetch`/`git push` keep
408
a bare mirror under `.oxy/git/`; a push is refused until the remote's tip
409
has been fetched, so it always fast-forwards. Exported commits carry
410
`Change-Id` and `Oxy-Hash` trailers.
411
412
## 13. Automate: hooks
413
414
Executables in `.oxy/hooks/<event>` (never cloned) receive one JSON object
415
on stdin. `pre-commit`, `pre-push` and other `pre-*` hooks veto by exiting
416
non-zero, and their stderr becomes the error message. Events:
417
`pre-commit`, `post-commit`, `pre-push`, `post-fetch`, `post-checkout`, and
418
`semantic-deps`, which runs at commit when `hooks.semantic-deps = true` and
419
answers `{"deps": ["<hash>", …]}` to make the change depend on more than it
420
textually references.
421
422
## 14. Per-path attributes, ignores, locks
423
424
`.oxyattributes` uses gitattributes syntax:
425
426
```
427
*.png     binary
428
*.txt     text eol=lf
429
*.psd     lockable nocompress
430
```
431
432
`binary`/`text` override content sniffing, `eol=lf|crlf` normalises line
433
endings in the store and on checkout, `nocompress` stores chunks raw, and
434
`lockable` files are checked out read-only until you take the local lock:
435
436
```
437
oxy lock assets/logo.psd
438
oxy unlock assets/logo.psd
439
```
440
441
Locks are advisory and local; server-side locks are planned.
442
443
## 15. Configuration
444
445
Two files, both `key = "value"` lines: `~/.config/oxy/config.toml`
446
(`oxy config --user KEY VALUE`) and `.oxy/config` (`oxy config KEY VALUE`).
0bdc3f91 Andy McCall ↶ 447
The repository file wins. `OXY_HOME` relocates the user directory. `OXY_TIMINGS=1` prints how long each phase of a snapshot takes (loading the base state, rendering it, reading the working copy, building the change) to standard error, for finding out where a slow command spends its time.
ee06a6c5 Andy McCall ↶ 448
449
| Key | Meaning |
450
|---|---|
451
| `author.name`, `author.email`, `author.key` | who you are; `key` is set by `identity create` |
452
| `core.sign` | `change` to sign every commit; otherwise seals at push |
453
| `core.op-retention` | days for which old operations keep their states alive (90) |
454
| `core.gc-grace` | days an unreachable object survives (14) |
455
| `core.checkpoint-interval` | changes between automatic checkpoints (256) |
456
| `filter.max-blob`, `filter.paths` | lazy blobs and sparse subtrees (section 11) |
457
| `hooks.semantic-deps` | run the semantic-deps hook at commit |
458
| `workspace.bookmark` | this workspace's bookmark (`main`) |
459
| `remote.<name>.url`, `.token`, `.ca` | remotes; token and CA fall back to `OXY_TOKEN` and `OXY_CA` |
460
461
## 16. Shell prompt
462
463
`oxy prompt` prints `main 658990aa*+2` (bookmark, working copy, `*` dirty,
464
`!` conflicted, ahead/behind origin) in a few milliseconds and records
465
nothing. See [prompt.md]prompt.md for bash, oh-my-bash, zsh, and fish
466
snippets and the `--format` placeholders.
467
468
## 17. Housekeeping
469
470
```
471
oxy gc              # pack loose objects, prune unreachable ones past the grace period
472
oxy gc --now        # ignore the grace period (only when nothing else is writing)
387335ff Andy McCall ↶ 473
oxy fsck            # check every object, the op log, references, signatures, checkpoints
3e5772cc Andy McCall ↶ 474
oxy doctor          # check identity, config and remotes, with what to do about each problem
ee06a6c5 Andy McCall ↶ 475
oxy checkpoint      # serialise the bookmark's state so large histories load instantly
476
```
477
478
Both run automatically: packing when loose objects pile up, checkpoints
479
every `core.checkpoint-interval` changes.
480
c6aa5bd9 Andy McCall ↶ 481
## 17a. Scripting and editors
482
483
Every reporting command takes `--json` (`status`, `log --path`, `show`,
484
`diff`, `hunks`, `blame`, `resolve`, `op log`, `bookmark list`, `remote list`,
485
`fetch`, `pull`, `push`, `submodule status`, `bisect status`, `verify`,
486
`policy show`, `root`, `version`). `oxy cat PATH -r CHANGE` prints a file as
487
it was, `oxy discard PATH..` restores files to the base, and `oxy hunks`
488
numbers the working copy's hunks for `commit --hunks` and `discard --hunks`.
489
ee06a6c5 Andy McCall ↶ 490
## 18. If something looks wrong
491
492
- **"the remote has change … which you do not; pull first"**: someone
493
  pushed since your last fetch. `oxy pull`, then push.
494
- **"policy needs N root signature(s)"** on fetch: the server's policy was
495
  updated in a way your copy cannot verify. Ask a root holder whether the
496
  chain of updates was published; a fresh clone trusts the current policy.
497
- **`oxy status` exits 2**: conflicts remain; see section 6.
498
- **Many heads on `main`**: independent changes that do not reference one
499
  another. Nothing to fix; the state is their union.
500
- **Undo anything**: `oxy undo` reverts the last operation, including
501
  pulls, checkouts, and rewrites.
d42369ab Andy McCall 502
503
## Shell completions and man pages
504
505
```sh
506
oxy completions bash > ~/.local/share/bash-completion/completions/oxy   # bash
507
oxy completions zsh > "${fpath[1]}/_oxy"                                 # zsh
508
oxy completions fish > ~/.config/fish/completions/oxy.fish               # fish
509
oxy man --dir ~/.local/share/man/man1                                    # then: man oxy-commit
510
```
511
512
The oh-my-bash plugin in `contrib/oh-my-bash` loads the bash completions itself.