writeonce/runtime/src/CODE-LOGIC.md
shoney.arickathil 62d29d6a77 docs(24): T10 closeout — stories done, board, graph, ledger, CODE-LOGIC
Iteration 24 closes, absorbing 31 and 34. No code in this commit.

- stories 24, 31, 34 -> `status: done`, each with a landing banner. 24's
  records the gate numbers and BOTH disclosed deviations: monitor takes
  three arguments (the caller may be `main`, which has no mailbox) and a
  v1 `call` reply is a typed scalar (which is what let the agreement be
  checked at compile time, WO-E226). 31's notes it landed INSIDE 24 and
  that a fifth mechanism it never anticipated came out of proving the
  gate — the drain guarantee (40). 34's names the gap it did NOT close:
  still no RNG, so CSRF/sessions stay blocked
- board: in-progress row cleared, marker doc deleted (convention), the
  standup entry in the six-question shape, chain note — next link is
  databasev2 4 (io_uring group-commit, chain 5)
- graph: PUBSUB2 (pub/sub + WebSockets, "rejected until here") -> done
- porch ledger: a WebSocket/pub-sub row added; the cancellation row now
  says what it actually waits on rather than repeating "the arc"; the
  README's "no WebSockets/SSE" limitation was stale — WebSockets are
  supported, SSE and chunked encoding are not
- CODE-LOGIC: runtime/src gains the actor-lifecycle section (call, death,
  the cap counter's sender/home-thread split, the monitor walk, the timer
  list), the drain guarantee, and the digest section; docs/examples/chat
  gains its own — actor topology, WHY two actors per connection, fd
  ownership, and the shutdown choreography

Battery after the doc edits: wovm-test 36 suites 0 fail, woc-test exit 0,
oop-e2e 119/0, chat 11/0, web-app 46/0, linkcheck clean.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-28 00:06:31 +02:00

22 KiB
Raw Blame History

runtime/src — how the VM is put together

Written 2026-08-14, when the runtime grew the systems stdlib and json; the file table was brought back in line with src/ on 2026-08-26 (park.c and crypto.c had arrived with iterations 11/35 and 34 and were missing). Read this before changing a file here; the normative contracts are docs/plan/oop-vm/00-wob-format.md (the .wob format, opcodes, builtin ids) and 08-builtin-surface.md (what each builtin means in source terms). wob.h is the machine-readable twin of the first: constants there and prose there must never disagree.

The files, in dependency order

file what it owns
wob.h every format constant: header offsets, field kinds, opcodes, builtin ids, trap codes, the 16-byte object header, the class descriptor
obj.h/.c the per-shard arena, object allocation (traced instances link onto the traced list, born white — black mid-cycle), the per-class may-gcref fixpoint, wo_str (header + length + inline bytes, no NUL)
cont.h/.c multi and map as native classes: struct heads in the arena, backing arrays malloc'd, map lookup a linear scan over parallel key/value arrays
gc.h/.c the kind-directed dispatcher (wo_drop_kind/wo_drop_obj) for owned values, and the incremental tri-color mark-sweep for traced (inferred-gc) objects: per-shard traced list, snapshot-at-beginning roots, Yuasa deletion barrier (the wo_drop_kind GCREF case + SETF), budgeted mark and sweep slices (iteration 7b — RC and Bacon–Rajan are gone)
borrow.h/.c the borrow word: shared counts and the exclusive sentinel
loader.h/.c parse and validate an image; the validation contract in its header comment is exactly what the interpreter may then assume
vm.h/.c the register interpreter: window-overlap calls, dual-flavor dispatch, traps, unwinding, catch frames
builtin.h/.c the pure builtins: print, containers, text
sysio.c the OS half: fs, time, env, net, proc
json.c json.encode / json.decode, driven by class metadata
park.c/.h the park plane (iteration 11 + 35, added after this doc was first written): the raw io_uring ABI mirrored from uapi with no liburing, the epoll fallback, fiber parking and unparking, and the per-call deadlines the _dl net members lower to. This is where a blocking builtin becomes "the shard runs someone else"
crypto.c/.h SHA-1, SHA-256, HMAC-SHA256 (iteration 34, builtin ids 85–87): hand-rolled per the no-dependency doctrine, accepted against FIPS 180 / RFC 2202 / RFC 4231 vectors in test/test_crypto.c
main.c the CLI: find an image (argument or embedded trailer), build argv, call the entry, map its result to an exit code; post-exit gc pump (a rootless cycle frees everything unreachable, in budgeted slices)

builtin.c's wo_builtin is the single entry point the interpreter calls; it forwards ids at or above WO_B_SYS_FIRST to sysio.c and the json pair to json.c. Splitting by translation unit keeps the kernel-touching code and the format-walking code out of the hot builtin switch.

Two invariants worth stating plainly

The loader is the only validator. Everything the interpreter skips checking — opcode ranges, register operands, jump targets, builtin arities, window sizes, table ordering — is checked once at load. The exceptions are deliberate and documented: GETF/SETF field indexes and receiver shapes stay runtime checks, because registers are untyped (the spec's residual-check doctrine). If you add an opcode or a builtin, its validation goes in loader.c's switch and its arity in b_arity, or the interpreter is running unvalidated bytes.

Traps never leak. A trap unwinds frames innermost-outward, and in each one the drop-table entry governing that frame's current instruction says which registers hold owned or counted values. The governing instruction is the trapping pc for the innermost frame and the CALL (saved pc − 1) for every outer one. Registers are nulled as they are released, so window overlap cannot double-free.

try/catch (the catch stack)

TRY A sBx pushes {depth, handler pc, error register}; ENDTRY pops it. On a trap with a catch frame live, vm_trap:

  1. fills vm->caught (the same structured error the uncaught surface prints),
  2. unwinds every frame above the catching one, exactly as an uncaught trap would,
  3. releases what the try region owned in the catching frame — the difference between the drop entry at the trapping instruction and the entry at the handler pc, which is why the compiler must record an entry at the handler,
  4. points that frame at the handler and returns 0, so TRAPF reloads and keeps interpreting.

A frame that returns pops the catch frames it registered (DROP_CATCHES), so a return out of a try region cannot leave a handler aimed at a dead window. With ncatch == 0 every trap behaves byte-for-byte as it did before the feature existed — that is the property to preserve when touching this code.

Records the VM fills but does not know

Three builtins return a record: fs.stat, time.local, proc.run, plus err_fill for a catch arm. The VM cannot name a source type, so the compiler passes the record's class id as the call's last argument and the builtin fills fields by index. The field order is therefore a contract, written beside each case in sysio.c and mirrored in compiler/src/types.ml's predeclared records. Change one side and the other silently writes to the wrong slot.

Class metadata and json (.wob v2)

The class table carries, per field, its name constant, the class it refers to (or a json-raw marker) and a container field's element kinds. That is what lets json.c be one implementation for every shape instead of per-type generated code:

  • encode takes the top-level value's static kind from the compiler, because a register alone cannot say whether it holds an i64 or a pointer. Everything nested comes from object headers (which carry class_id) and the class table.
  • decode parses and binds straight into the target class: keys matched against field names, a nested object built as that field's class, an array as a multi of that field's element kind, unknown keys skipped, absent keys left as the zero word (nil). Malformed input yields nil rather than trapping — that is what makes json.decode(t) as T a checked decode.

Two limits are inherent to the kind byte and are documented, not bugs to discover: a Bool field encodes as 0/1, and a fractional JSON number decodes by truncation.

Program mode

main.c accepts an entry taking no arguments or exactly one multi Text. The list holds the program's own arguments — not the program name, and not the image path a wovm image.wob args... invocation carries — so args[0] is the first real argument. The entry's return value is the process exit code (low byte); a trap is exit 1 with the fixed trap N in METHOD at line L: MESSAGE line on stderr, which the conformance harness parses.

Where to look when something breaks

  • A wild pointer inside a builtin usually means the compiler put the wrong thing in a register: check the method's disassembly (woc --dump-bc) before suspecting the C.
  • make -C runtime wovm-asan builds the sanitized binary; the unit suites (just wovm-test) run every test/test_*.c under ASan+UBSan in both dispatch flavors, so a fallback-only bug cannot hide.
  • runtime/test/wob_build.c is an independent image assembler. A builder/loader disagreement shows up as a unit-test failure, which is the point of having two encoders.

Fibers and actors (the 8+11 arc, stage 1 — 2026-08-20)

A wo_fiber is the interpreter state wo_vm used to hold inline (register window, frame stack, catch stack, caught error); the vm keeps the module, the runtime, the current-fiber pointer, and a FIFO run queue. The reduction budget (WO_REDUCTIONS, default 4000) is checked ONLY at loop back-edges and AFTER the jump lands — a pre-instruction save at budget 1 re-executes the jump into the same decrement and livelocks (test_fiber pins budget 1 as exact round-robin). Main returning ends the program: every other fiber unwinds through the drop maps (fib_reap_all); a spawned fiber's uncaught trap kills that fiber alone.

An actor (wo_actor) is runtime-owned state + a receive method index + a growable FIFO mailbox + at most ONE delivery fiber (one message at a time); delivery re-queues per message so an actor never monopolizes the shard. The runtime owns each message: it is dropped after its receive call returns, and actor state / queued messages / the in-flight message are GC roots scanned beside the fiber frames. spawn = BUILTIN 68 (instance + receive's method index, compile-time constant); send = BUILTIN 69 (the message is excluded from the emitter's fresh-arg drops — ownership moved).

Float and Bytes (iteration 19 — .wob v5)

The registers did not change shape: a Float IS the register's 64 bits read as an f64, converted only by wo_f64/wo_bits in wob.h (memcpy, so strict-aliasing-clean and free at -O1). Nothing else in the runtime knows the difference, which is why the change is opcodes and kind bytes rather than a layout.

  • Two failure worlds. WOP_DIV traps DIV0; WOP_FDIV never traps. That asymmetry is the contract, not an oversight — IEEE quiet semantics mean Inf and NaN flow instead of raising, so a compute-bound handler cannot be killed by data. WOP_FNEG flips the sign bit rather than subtracting from zero, which is the only way -0.0 is reachable.
  • IEEE compares are not the index's order. FEQ/FLT/FLE are IEEE (NaN == NaN is 0, 0.0 == -0.0 is 1). Indexes and order by need a total order instead, so wo_float_cmp (wob.h) sorts NaN last and treats the two zeros as equal, and table.c's idx_float_key canonicalizes an index column's bits to match. Skip that canonicalization and a unique Float column accepts both -0.0 and 0.0, and a probe for one misses a row stored as the other — the bug this pairing exists to prevent.
  • A ?Float's nil is a reserved quiet NaN (WO_NIL_FLOAT), not the zero word (+0.0) and not WO_NIL_SCALAR (whose bits are -2.0). Arithmetic produces the platform's canonical quiet NaN, so a computed NaN never reads as absence. Both json paths that write a nil word — the omitted-key prefill in jparse_object and the explicit null in jparse_value — must know this; either one alone leaves a null price reading back as zero.
  • Bytes is wo_str with a different class_id. Same struct, same allocator, same free (gc.c handles both ids), so lifetime handling can never diverge. WO_B_TEXT_COPY preserves the id, which is what lets every existing copy-on-ownership-boundary serve both carriers; copying a Bytes as a Text would launder it into the wrong world, and the distinct id exists precisely to stop that.
  • One float renderer, three callers. wo_float_text backs float_to_text, string interpolation, and json.encode. Shortest digits that reparse to the same BITS (bits, not ==: -0.0 == 0.0 is true, so a value comparison would let 0 stand in for -0.0), then fixed notation preferred over exponential in 1e-6 … 1e21 — pure "shortest" renders a price of 900.0 as 9e+02.
  • The durability path never renders. wal.c writes a Float as its raw word and a Bytes as the same length-prefixed blob a Text uses, so replay is bit-exact for NaN, ±Inf, and -0.0. test_wal's test_float_bytes_replay asserts on bits for exactly that reason.

The Int bitwise set (iteration 36 — .wob v6)

  • One shared case-body text serves both dispatch flavors — the new CASE blocks sit in the Int neighborhood after LE, so -DWO_ISO_C cannot rot (same discipline as every opcode before them).
  • SHL shifts the unsigned register word (wrapping, like ADD — a signed left-shift overflow would be UB); SHR casts to int64_t first, so it is ARITHMETIC — gcc/clang define signed >> as sign-extending, and those are the only compilers this runtime targets.
  • The count check is a trap, not a mask. x86 masks the count mod 64, which would make x << 64 == x silently; Go saturates to 0/-1, spec surface for generic-width code this VM does not have. WO_T_SHIFT (12) follows the DIV0 precedent instead: named, catchable, honest. It can only fire on a count computed at run time — woc rejects literal out-of-range counts as WO-E223.
  • The loader validates the five opcodes as plain three-register forms — the count is a register, not an immediate, so there is nothing to range-check at load time.

The transparent DB actor (arc stage 3, 2026-08-21)

  • The database is an actor on shard 0. A worker shard's DB builtin never touches an engine (its rt.db is NULL, asserted at serve entry): wo_db_rpc (vm.c) marshals the statement, ships it in a kind-3 envelope to the primary's inbox, and parks the fiber; the primary executes it serialized inside its inbox drain (wo_vm_adopt case 3, wo_db_exec_req) and ships the same request back as a kind-4 reply, which unparks the fiber; the builtin RE-EXECUTES and consumes the answer.
  • VM heaps never cross shards. The requester ENCODES its argument values into engine slots on its own thread (wo_db_val_encode) — an owner-side read of a requester's Text would race that shard's collector writing header mark bits. Replies come back as plain ids (scan/probe), a deep-cloned engine value (get-field, decoded into the requester's arena), or a bare id (insert). Traps and messages are byte-identical to the local path; the ack crosses shards only after the owner's WAL commit.
  • The reply park holds no plane wait. WO_PARK_INBOX (park_fd -2) joins the parked list only; the wake is wo_io_unpark from the envelope drain. Deadline scans key on park_fd == -1 EXACTLY — a -2 must never be read as a deadline. A busy shard adopts its inbox once per reduction slice, so a computing primary bounds a worker's DB latency to one slice.
  • Ring params are per-vm (wo_vm.io_params) — never share them. They were one file static; a worker's lazy wo_vm_init memset+refilled it while another shard read ring offsets out of it, submits landed at garbage offsets, and parked fibers lost their wakes (~1/20 hangs at default cores, found by stage 3's cross-shard traffic). A short io_uring_enter submit is a failure, never a success — that check is what turns any relapse into a loud WO_T_IO instead of a silent hang.
  • Proof: just db-actor (docs/examples/db-actor — multi-shard set ×3, both forced backends, single-shard byte-exact, WO_DATA replay pair); ASan/TSan clean on the RPC path.

Net deadlines + the deadline tick (iteration 35)

  • _dl builtins (91–95) are per-call: the fiber carries the absolute deadline (dl_active/dl_at) across the park protocol's re-execution; a timeout is the EXPECTED nil/false result, never a trap. ms <= 0 is the pre-35 behavior bit for bit.
  • One op per fd-park stays the law. Deadlines ride ONE per-shard TIMEOUT ("tick", sentinel user_data) armed for the nearest fd-park deadline; the post-CQE sweep wakes expired parks and POLL_REMOVE tombstones their poll. epoll needs no ops — its deadline scan grew the fd-park case. Full design + rejected alternatives: docs/superpowers/specs/2026-08-23-net-seams-park-design.md.
  • Fibers pool, never free mid-run (vm->fib_pool): the loser of a readiness-vs-deadline race can complete one wait late, and its user_data must never point at freed memory. Worst case anywhere is a spurious wake, absorbed by re-execution. Pool dies with the vm; steady-state size = peak live fibers.
  • listen_unix sets O_NONBLOCK on the listener itself — accept4's SOCK_NONBLOCK flags the ACCEPTED socket only; a blocking listener would block the whole shard (found by the seam probe, both backends).

Actor lifecycle: call, death, monitor, timers (iteration 24, ids 88–90)

Four pieces that together answer "what happens to an actor that is waiting, that dies, that watches, or that wants to be woken later". All four live in vm.c with their entry points in builtin.c; the structures are in vm.h.

call (id 88) — a send that waits. An ordinary send returns immediately; call parks the calling fiber and resumes it with the receive's return value. The reply is a typed scalar, which is what let the agreement be checked at compile time (WO-E226) rather than carried as a tagged value at runtime. The caller is never left hanging: if the callee dies mid-call, or the address is already dead, the caller traps catchably instead of parking forever. That is the property worth keeping in mind when reading the code — every path out of a call either resumes the fiber or traps it.

Death. A receive that traps uncaught marks the actor dead on its home thread. From then on sends to it drop silently, calls trap, queued callers are error-unparked, and its state and mailbox are released. Silent-drop for sends is deliberate: a sender cannot handle another actor's failure, and making every send fallible would put a try on every line.

The mailbox cap and its counter. One cap for every mailbox (default 1024, WO_MAILBOX overrides at boot; the chat gate shrinks it to 8 to force the policy). pending counts sent-but-not-delivered. It is incremented by the sender, on any shard, and decremented by the home thread at delivery — so it is touched only through wo_mbox_reserve/wo_mbox_release and their __atomic builtins. The consequence is disclosed rather than hidden: the cap can overshoot by at most the number of in-flight sends. Overflow is fail-fast — the send raises a catchable WO_T_ACTOR (trap 13), which is what lets a room drop a slow member instead of growing without bound.

monitor (id 89) — the death notice. wo_monitor is one registration: observer, the moved-in notice message, next. The list lives on the watched actor and is owned by its home thread, so the death walk needs no lock — dying is a home-thread event and the list is right there. The notice is the observer's own M-typed message, so an observer receives death notices in the same shape as everything else. Monitoring an already-dead actor fires immediately rather than silently doing nothing. An observer whose mailbox is full loses the notice, with a disclosed stderr line — the alternative was blocking a death walk on a slow observer.

It takes three arguments (watched, observer, msg), not the two the spec first proposed, because the caller may be main, which has no mailbox and so cannot be an implicit observer.

time.after (id 90) — one-shot, no cancel. wo_timer is at (wall ms), target, message, next. The list lives on the arming fiber's shard and is scanned by the same deadline machinery that already serves fd-park deadlines, so timers cost no new wait mechanism. Firing is an ordinary runtime send, which means it inherits the ordinary rules: a full target drops with a stderr line, a dead target drops silently. There is no cancel; the idiom is a generation counter in the message, which the timer-generation corpus fixture pins.

Where to look when a lifecycle thing misbehaves: wo_vm_actor_monitor and wo_vm_timer_after in vm.c are the two entry points; shard_main and NEXT_RUNNABLE() decide when a shard runs, adopts, or stops. The corpus fixtures monitor-death, timer-delivery and timer-generation are the smallest working examples of each.

The shutdown drain guarantee (iteration 40)

A message sent before the stop flag is observed is delivered and run before the engine stops. Stated because it was once untrue in a way nothing caught.

wo_engine_stop sets eng_shutdown, wakes every worker, joins them, and only then tears down — freeing whatever envelopes are still queued. So a worker that leaves its loop early takes its inbox with it. NEXT_RUNNABLE() has always encoded the right behaviour for a worker holding a live fiber: on a stop it returns 2 and keeps draining, because "only the PRIMARY's stop ends the program". shard_main's idle branch did the opposite — it reaped and broke — so a shard whose actors happened to be between messages at SIGTERM abandoned everything still in flight.

It now honours the same contract: while the primary's window is open an idle worker adopts its inbox and runs what arrives, sched_yielding on an empty poll so a drain cannot burn a core per shard and starve the actors it exists to let run. Only eng_shutdown — which the primary sets after main returns — ends it.

Two things follow that are easy to get wrong. The window is the primary's, so a program that wants a longer drain holds it open itself; main cannot park after the stop flag, because a park there unwinds. And the whole path is unreachable at WO_SHARDS=1, where wo_engine_stop returns at nshards <= 1.

Digests: sha1, sha256, hmac_sha256 (iteration 34, ids 85–87)

crypto.c holds SHA-1 and SHA-256 over a single buffer and HMAC-SHA-256 on top of the latter, each returning a fresh Bytes. No streaming API and no other primitives — these exist because WebSocket's handshake needs SHA-1 and ETags need SHA-256, and that is the whole of the demand so far.

Correctness is pinned to the published vectors rather than to itself: RFC 3174 for SHA-1, the FIPS/RFC 6234 vectors for SHA-256, RFC 4231 for HMAC, in runtime/test/test_crypto.c (18 checks). There is still no RNG anywhere in the runtime — HMAC authenticates a token but cannot mint one, which is why iteration 39 leads with a random-bytes builtin.