OXYGENHUB
# 314db9b4f3f8 oxygen / docs / guide.md
20.6 KiB · Markdown · last changed Failed file writes name the file; the guide shows the feature flow 1 month ago renderedsource blame history raw
ee06a6c5 Andy McCall ↶ 1
# Oxygen user guide
2
3
This guide is organised by task. It assumes the `oxy` binary is on your
4
path (`cargo build --release` puts it in `target/release/`). The design
5
behind every command is in [spec.md]spec.md; this guide only tells you
6
what to type and what to expect.
7
8
Oxygen tracks *changes* rather than snapshots: a change is the set of
9
edits you made, it commutes with unrelated changes, and conflicts are
10
recorded in history instead of blocking you. Two ideas recur below:
11
12
- A **bookmark** (default `main`) names a *state*: the set of changes it
13
  contains. A state can have several **heads** when independent changes
14
  have not been related to each other; that is normal, not a problem.
15
- The **working copy** is itself a change that Oxygen rewrites every time
16
  it looks at your files. `oxy commit` turns it into a real change.
17
18
Output uses colour and glyphs on a terminal; pipe it, pass `--plain`, or set
19
`NO_COLOR` for plain ASCII.
20
21
## 1. Set yourself up
22
23
```
24
oxy identity create --name "Ada Lovelace" --email [email protected]
25
oxy config --user core.sign change
26
```
27
28
`identity create` generates a composite Ed25519 + ML-DSA-65 key pair, keeps
29
the secret in `~/.config/oxy/keys/`, and records you as the default author
30
in `~/.config/oxy/config.toml`. With `core.sign = change` every commit is
31
signed; without it, changes are sealed in batches when you push (also
32
authenticated, just later). Use `--local` to record the identity in one
33
repository only.
34
35
`oxy identity show` prints the key, its expiry, delegates, and whether the
36
secret is available. `oxy identity export` writes the public identity to a
37
file to hand to whoever manages a trust policy (section 8).
38
39
## 2. Start a repository
40
41
```
42
mkdir project && cd project
43
oxy init
44
oxy status
45
```
46
9ac1fbe2 Andy McCall ↶ 47
`oxy init` creates `.oxy/`. Add `.oxyignore` (gitignore syntax, per
48
directory, negations with `!`) for files that should never be tracked;
49
`/target` and `*.tmp` are typical entries. As in Git, ignore rules only
50
affect untracked files: a file already in history stays tracked until you
51
delete it.
ee06a6c5 Andy McCall ↶ 52
53
To take over an existing Git project, see section 12.
54
55
## 3. Everyday work
56
57
```
58
oxy status                 # what changed since the last commit
59
oxy diff                   # the edits, file by file
60
oxy commit -m "Add retry loop"
61
oxy log                    # newest first; -n 10, -v for full messages
62
oxy show 658990aa          # one change by ChangeId prefix, #hash prefix, or @
63
```
64
957fee30 Andy McCall ↶ 65
Commit part of what changed with `oxy commit PATH.. -m "..."` (only those
66
paths; the rest stays as uncommitted work) or `oxy commit -i -m "..."`, which
67
offers each hunk in turn like `git add -p`; a hunk that another chosen hunk
68
needs, such as the directory a new file lives in, comes along by itself.
69
50a046e4 Andy McCall ↶ 70
`status --json` prints the same for tools, with every conflict's kind, path and
71
contributing ChangeIds. On a terminal, `status` lists each path with a mark: `✚ added`, `✎ modified`, `✖ removed`,
ee06a6c5 Andy McCall ↶ 72
`➜ renamed`, `⚙ mode`. Renames are detected: a removed file and an added
73
file of the same kind whose contents are at least half alike are recorded
74
as a move of the same file, so identity survives a rename.
75
76
Files containing NUL bytes are stored whole ("opaque"); text files are
77
stored line by line and merge line by line. `.oxyattributes` overrides the
78
guess (section 14).
79
80
Every change has two names: a **ChangeId** (`658990aa…`) that survives
81
rewrites, and a content hash (`#7469d16c…`) that changes when the change is
82
edited. Use whichever you have; prefixes work.
83
fbda43e7 Andy McCall ↶ 84
## 3a. Bookmarks: branches without merges
85
86
A bookmark names a state; each workspace works on one (`main` to begin
87
with). Because changes commute, "merging" is the union of two bookmarks'
88
heads, with no merge change and any real conflict recorded as in section 6.
89
90
```
91
oxy bookmark create feature        # at the working copy's base
92
oxy bookmark switch feature        # check it out; commits now go here
93
oxy commit -m "Feature work"
94
oxy bookmark switch main
95
oxy merge feature                  # main now holds both; working copy follows if clean
96
oxy bookmark list                  # ● current, heads, ↑n/↓n against origin
97
oxy push -b feature                # publish a bookmark other than the current one
98
oxy bookmark set feature 658990aa  # move it; oxy bookmark delete feature to drop it
99
```
100
101
`oxy checkout feature` materialises a bookmark without switching to it, and
102
a bookmark name works wherever a change is expected when it has one head.
103
Each workspace remembers its own bookmark, so two directories can sit on
104
two bookmarks of one repository.
105
314db9b4 Andy McCall ↶ 106
### A develop / feature flow
107
108
Names with `/` work everywhere, pushing included:
109
110
```
111
oxy bookmark create feature/42-login          # at the working copy's base
112
oxy bookmark switch feature/42-login --carry  # started already? take the edits along
113
oxy commit -F msg.txt                         # a long message from a file
114
oxy push -b feature/42-login
115
oxy bookmark switch develop
116
oxy merge feature/42-login                    # the working copy follows when it was clean
117
oxy push                                      # develop, with the feature in it
118
oxy bookmark delete feature/42-login          # oxy push --delete feature/42-login on the remote
119
```
120
121
`bookmark switch` stops when the working copy has uncommitted edits, so
122
nothing is lost by accident. There are two ways past it:
123
- `--carry` takes the edits along. It is refused only when the target
124
  bookmark has other versions of the files they touch.
125
- `--discard` drops the edits.
126
127
`oxy describe` names what the working copy holds, for build stamps:
128
- a tag, when a tag holds exactly this state;
129
- otherwise the nearest tag with the distance from it and the change;
130
- or, with no tag behind it, the bookmark and the change;
131
- with `-dirty` added when there are uncommitted edits.
132
ee06a6c5 Andy McCall ↶ 133
## 4. Fix up history
134
135
Oxygen keeps its own record of every operation, so all of these are safe to
136
try and to undo.
137
138
```
139
oxy describe -m "Better message"        # reword the head the working copy sits on
140
oxy describe 658990aa -m "..."          # reword any change; dependents are rewritten
141
oxy amend                               # fold the working copy into the head
142
oxy amend --into 658990aa               # fold it into an older change
143
oxy split 658990aa src/parser.rs        # split a head: those paths become a separate first change
144
oxy abandon 658990aa                    # drop a change; its content stays on disk
728da0f9 Andy McCall ↶ 145
oxy squash 658990aa --into 9df9ac29     # fold a change into one it depends on
146
oxy rebase 658990aa --onto feature      # re-express a change against another base
ee06a6c5 Andy McCall ↶ 147
oxy undo                                # undo the last operation, whatever it was
148
oxy op log                              # the operation log
149
```
150
151
Rewriting a change that others depend on rewrites them too, keeping their
728da0f9 Andy McCall ↶ 152
ChangeIds. Because unrelated changes already coexist, `rebase` is rarely
153
needed; its job is to change what a change is said to build on, for instance
154
to drop a dependency on something you are about to abandon. Where a dependent referred to a line that no longer exists, the
ee06a6c5 Andy McCall ↶ 155
reference is re-anchored to the nearest surviving line and `oxy abandon`
156
prints a note about it.
157
957fee30 Andy McCall ↶ 158
## 4a. Who wrote this, and what broke it
159
160
```
161
oxy blame src/parser.rs          # every line: the change that introduced it, author, age
162
oxy blame src/parser.rs --json
163
```
164
165
Blame is exact: each line is an atom that remembers the change that
166
introduced it, so renames cost nothing and there is no heuristic.
167
168
```
169
oxy bisect start
170
oxy bisect good v1.2             # a change, bookmark or tag known to be fine
171
oxy bisect bad main              # and one known to be broken
172
oxy bisect run make test         # exit 0 good, 125 skip, anything else bad
173
oxy bisect reset                 # back to where you were
174
```
175
176
Without `run`, each step checks out a state to test and you answer with
177
`oxy bisect good`, `bad`, or `skip`. The candidates are the changes the bad
178
state has that the good one lacks, ordered so every tested state is
179
well-formed; the answer is the first change whose inclusion breaks things.
180
ee06a6c5 Andy McCall ↶ 181
## 5. Move around
182
183
```
184
oxy checkout                    # the bookmark's heads
185
oxy checkout 658990aa           # the state of one change and its dependencies
186
oxy checkout v1.2               # a tag
187
oxy checkout --discard ...      # throw away uncommitted work first
188
```
189
190
Checking out a single older change gives you the files that change and its
191
dependencies touch, not a full snapshot from that date: in Oxygen a change
192
depends only on what it actually builds on.
193
194
## 6. Conflicts
195
196
A conflict never stops a commit, fetch, or pull. It is recorded in the
197
state and shown by `oxy status`, which exits with status 2 while any
198
conflict remains. Conflicted text files are written with markers:
199
200
```
201
<<<<<<< oxy conflict 1 of 2, side 1: change k7m2p9 "Add retry loop"
202
... lines ...
203
======= oxy conflict 1 of 2, side 2: change q3x8w1 "Refactor client"
204
... lines ...
205
>>>>>>> oxy conflict 1 of 2 end
206
```
207
208
Edit the file to what it should be (keep one side, both, or neither) and
209
remove the markers. Tree conflicts, such as two files wanting the same
210
name, appear as `<name>.oxy-conflict-<n>` candidates: keep the one you
211
want under the right name and delete the rest.
212
213
```
214
oxy resolve      # which conflicts your edits resolve, which still have markers
215
oxy commit -m "Resolve retry vs refactor"
216
```
217
218
The commit is recorded as a *resolution*, a change that depends on every
219
side of the conflict; anyone who fetches it gets the conflict resolved.
220
221
## 7. Work with others
222
223
Run a server (any machine with the repositories under one directory):
224
225
```
226
oxy serve --root /srv/oxy --bind 0.0.0.0:8890 --token SECRET \
227
          --tls-cert cert.pem --tls-key key.pem
228
```
229
230
Without `--tls-*` the server speaks plain HTTP; keep that on a loopback
231
address or behind a TLS terminator. `--token` makes pushes require a bearer
232
token; reads stay open.
233
234
On your machine:
235
236
```
237
oxy clone https://host:8890/project
238
cd project
239
oxy config remote.origin.token SECRET   # or export OXY_TOKEN
240
oxy config remote.origin.ca my-ca.pem   # self-signed server: extra roots to trust (or OXY_CA)
241
oxy push
242
oxy pull
243
```
244
245
- `oxy fetch` updates `origin/main` without touching your bookmark.
246
- `oxy pull` fetches, then makes your bookmark the union of both sides.
247
  There is no merge commit; unrelated changes simply coexist, and a real
248
  conflict is recorded as in section 6. The working copy follows when it was
249
  clean.
250
- `oxy push` sends your changes and moves the remote bookmark. If the remote
251
  moved since you last fetched, the push is refused: pull and push again.
252
  `--force` overrides the compare-and-swap.
253
- `oxy remote add|remove|list` manages remotes; the clone source is `origin`.
254
255
A repository can also be cloned from a local path, which is handy for tests
256
and for a bare "hub" on a shared disk.
257
258
## 8. Decide who may publish: the trust policy
259
260
Without a policy a repository is *unverified*: everything is accepted and
261
every remote command says so. A policy names root keys and the keys allowed
262
to update each bookmark; servers and clients enforce it.
263
264
```
265
oxy policy init                    # your key becomes the only root; push publishes it
266
oxy policy show
267
oxy policy grant alice.identity    # alice.identity came from her `oxy identity export`
268
oxy policy grant ci.identity --pattern 'release/*'
269
oxy policy revoke 9458b656         # by KeyId prefix
270
oxy verify                         # signature status of every change in the log
271
```
272
273
Several people can hold root keys:
274
275
```
276
oxy policy root add bob.identity
277
oxy policy root threshold 2        # future updates need two root signatures
278
```
279
280
Once the threshold is above one, an update you make alone becomes a
281
*proposal file* (`policy-<serial>.proposal`, or `--out`). Send it to another
282
root holder, who runs `oxy policy sign policy-7.proposal`; whoever completes
283
the threshold applies it, and the next push publishes it. Everyone else
284
picks it up on fetch, verifying each step from the policy they already
285
trust.
286
287
## 9. Keys over time
288
289
```
290
oxy identity rotate                   # fresh key pair; old signatures stay valid
291
oxy identity renew --expires 365      # same keys, new expiry in days (0 = never)
292
oxy identity delegate add ci.identity # let another key sign on your behalf
293
oxy identity delegate remove 3f2a…
294
oxy identity revoke                   # retire your own key
295
oxy identity revoke 3f2a… --reason "laptop stolen"   # any key, if you hold a root
296
```
297
298
Rotation, renewal, and delegation all issue a successor identity that names
299
the previous one. If a policy names your key, it is updated to the successor
300
in the same step (as a proposal when more root signatures are needed).
301
Changes signed before the rotation remain authorised; a revoked key
302
authorises nothing. `oxy verify` shows signatures by revoked keys as valid
303
but revoked.
304
305
## 10. Tags and workspaces
306
307
```
308
oxy tag create v1.2 -m "First release"   # the current heads; or name changes
309
oxy tag list
310
oxy workspace add ../project-hotfix      # a second checkout sharing the repository
311
oxy workspace list
312
oxy workspace forget ../project-hotfix
313
```
314
315
A tag is an immutable state, signed when you have a key, and travels with
316
push and fetch. Workspaces have their own working copy and bookmark
317
(`workspace.bookmark`) but share objects and history.
318
fc1a466a Andy McCall ↶ 319
### Receipts from CI
320
321
A runner such as OxygenFlow signs a receipt for every job it runs: what ran,
322
in what environment, on which files, and the result. Receipts are kept with
323
the state they ran on.
324
325
```
326
oxy receipt list                         # receipts for the bookmark's state
327
oxy receipt show 3f2a9c                  # one in full, with its signature checked
328
oxy receipt export 3f2a9c build.receipt  # hand it to someone
329
oxy receipt verify build.receipt         # check one without keeping it
330
oxy receipt import build.receipt         # verify and keep it
331
```
332
ee06a6c5 Andy McCall ↶ 333
## 11. Big repositories: partial, sparse, shallow
334
335
```
336
oxy clone URL --max-blob 1M          # files above 1 MiB are fetched on first read
337
oxy clone URL --sparse src --sparse docs   # materialise only these subtrees
338
oxy clone URL --depth 50             # only the last 50 levels of history
339
oxy sparse src docs tests            # change the filter later
340
oxy deepen 100                       # fetch more history below the boundary
341
```
342
343
Lazy blobs and sparse trees do not affect commits: what you do not have is
344
left exactly as it was. A shallow clone starts from a *checkpoint* of the
345
state, so status and commit work at full speed from the first minute.
346
4dee277c Andy McCall ↶ 347
## 11a. Nested repositories (submodules)
348
349
A subrepo is another repository checked out at a path and pinned to a state,
350
Oxygen or Git. The pin is versioned like a file, so two people pinning
351
different states get an ordinary conflict.
352
353
```
354
oxy submodule add https://host/lib.git libs/lib     # Git or Oxygen URL; records .oxymodules
355
oxy commit -m "Add lib"                              # the pin is committed with the parent
356
oxy submodule status                                 # pin vs what is on disk
357
oxy submodule update --init                          # after a clone: fetch nested repositories
358
oxy submodule remove libs/lib                        # drop the node; the directory stays
359
```
360
361
Committing the parent records whatever the nested repository is at, and
362
checking out an older parent state moves the nested repository back, unless
363
it has uncommitted changes, which are never overwritten. An absent nested
364
repository keeps its pin until you run `update --init`. Git submodules
365
survive `oxy git import` as Git pins and go back out as gitlinks on export.
366
ee06a6c5 Andy McCall ↶ 367
## 12. Git interoperability
368
369
```
370
oxy git import ../project.git ./project-oxy --branch main   # convert a Git history
371
oxy git fetch https://github.com/you/project.git            # bring new Git commits in
372
oxy git push  https://github.com/you/project.git            # publish your changes to Git
373
oxy git export ../mirror.git                                # a plain Git mirror of the bookmark
374
```
375
376
Import turns each commit into one change (merge commits become
377
resolutions), keeps authors and hashes as `Git-Author`/`Git-Commit`
378
trailers, detects renames, and skips submodules. `git fetch`/`git push` keep
379
a bare mirror under `.oxy/git/`; a push is refused until the remote's tip
380
has been fetched, so it always fast-forwards. Exported commits carry
381
`Change-Id` and `Oxy-Hash` trailers.
382
383
## 13. Automate: hooks
384
385
Executables in `.oxy/hooks/<event>` (never cloned) receive one JSON object
386
on stdin. `pre-commit`, `pre-push` and other `pre-*` hooks veto by exiting
387
non-zero, and their stderr becomes the error message. Events:
388
`pre-commit`, `post-commit`, `pre-push`, `post-fetch`, `post-checkout`, and
389
`semantic-deps`, which runs at commit when `hooks.semantic-deps = true` and
390
answers `{"deps": ["<hash>", …]}` to make the change depend on more than it
391
textually references.
392
393
## 14. Per-path attributes, ignores, locks
394
395
`.oxyattributes` uses gitattributes syntax:
396
397
```
398
*.png     binary
399
*.txt     text eol=lf
400
*.psd     lockable nocompress
401
```
402
403
`binary`/`text` override content sniffing, `eol=lf|crlf` normalises line
404
endings in the store and on checkout, `nocompress` stores chunks raw, and
405
`lockable` files are checked out read-only until you take the local lock:
406
407
```
408
oxy lock assets/logo.psd
409
oxy unlock assets/logo.psd
410
```
411
412
Locks are advisory and local; server-side locks are planned.
413
414
## 15. Configuration
415
416
Two files, both `key = "value"` lines: `~/.config/oxy/config.toml`
417
(`oxy config --user KEY VALUE`) and `.oxy/config` (`oxy config KEY VALUE`).
0bdc3f91 Andy McCall ↶ 418
The repository file wins. `OXY_HOME` relocates the user directory. `OXY_TIMINGS=1` prints how long each phase of a snapshot takes (loading the base state, rendering it, reading the working copy, building the change) to standard error, for finding out where a slow command spends its time.
ee06a6c5 Andy McCall ↶ 419
420
| Key | Meaning |
421
|---|---|
422
| `author.name`, `author.email`, `author.key` | who you are; `key` is set by `identity create` |
423
| `core.sign` | `change` to sign every commit; otherwise seals at push |
424
| `core.op-retention` | days for which old operations keep their states alive (90) |
425
| `core.gc-grace` | days an unreachable object survives (14) |
426
| `core.checkpoint-interval` | changes between automatic checkpoints (256) |
427
| `filter.max-blob`, `filter.paths` | lazy blobs and sparse subtrees (section 11) |
428
| `hooks.semantic-deps` | run the semantic-deps hook at commit |
429
| `workspace.bookmark` | this workspace's bookmark (`main`) |
430
| `remote.<name>.url`, `.token`, `.ca` | remotes; token and CA fall back to `OXY_TOKEN` and `OXY_CA` |
431
432
## 16. Shell prompt
433
434
`oxy prompt` prints `main 658990aa*+2` (bookmark, working copy, `*` dirty,
435
`!` conflicted, ahead/behind origin) in a few milliseconds and records
436
nothing. See [prompt.md]prompt.md for bash, oh-my-bash, zsh, and fish
437
snippets and the `--format` placeholders.
438
439
## 17. Housekeeping
440
441
```
442
oxy gc              # pack loose objects, prune unreachable ones past the grace period
443
oxy gc --now        # ignore the grace period (only when nothing else is writing)
387335ff Andy McCall ↶ 444
oxy fsck            # check every object, the op log, references, signatures, checkpoints
3e5772cc Andy McCall ↶ 445
oxy doctor          # check identity, config and remotes, with what to do about each problem
ee06a6c5 Andy McCall ↶ 446
oxy checkpoint      # serialise the bookmark's state so large histories load instantly
447
```
448
449
Both run automatically: packing when loose objects pile up, checkpoints
450
every `core.checkpoint-interval` changes.
451
c6aa5bd9 Andy McCall ↶ 452
## 17a. Scripting and editors
453
454
Every reporting command takes `--json` (`status`, `log --path`, `show`,
455
`diff`, `hunks`, `blame`, `resolve`, `op log`, `bookmark list`, `remote list`,
456
`fetch`, `pull`, `push`, `submodule status`, `bisect status`, `verify`,
457
`policy show`, `root`, `version`). `oxy cat PATH -r CHANGE` prints a file as
458
it was, `oxy discard PATH..` restores files to the base, and `oxy hunks`
459
numbers the working copy's hunks for `commit --hunks` and `discard --hunks`.
460
ee06a6c5 Andy McCall ↶ 461
## 18. If something looks wrong
462
463
- **"the remote has change … which you do not; pull first"**: someone
464
  pushed since your last fetch. `oxy pull`, then push.
465
- **"policy needs N root signature(s)"** on fetch: the server's policy was
466
  updated in a way your copy cannot verify. Ask a root holder whether the
467
  chain of updates was published; a fresh clone trusts the current policy.
468
- **`oxy status` exits 2**: conflicts remain; see section 6.
469
- **Many heads on `main`**: independent changes that do not reference one
470
  another. Nothing to fix; the state is their union.
471
- **Undo anything**: `oxy undo` reverts the last operation, including
472
  pulls, checkouts, and rewrites.
d42369ab Andy McCall 473
474
## Shell completions and man pages
475
476
```sh
477
oxy completions bash > ~/.local/share/bash-completion/completions/oxy   # bash
478
oxy completions zsh > "${fpath[1]}/_oxy"                                 # zsh
479
oxy completions fish > ~/.config/fish/completions/oxy.fish               # fish
480
oxy man --dir ~/.local/share/man/man1                                    # then: man oxy-commit
481
```
482
483
The oh-my-bash plugin in `contrib/oh-my-bash` loads the bash completions itself.