Runtime source notesImplementation evidence1.5 KB

TinyRustLM Runtime Source Integration Notes

Synthesis of the uploaded Rust runtime source files into ModelBreeder architecture: .slm packages, adapter ABI, eval sidecars, diagnostics, and browser WASM exports.

Download original MarkdownSHA-256 e86a66b02e6371f1fa2b2cca2e944138b63cc2f30a5c303270d6e75f24650acd
Raw source report

This page renders the original supplied document for reference. It has not been fact-checked line by line. Use the curated learning guides for normalized terminology, maturity labels, implementation boundaries, and safety framing.

TinyRustLM Runtime Source Integration Notes

The uploaded Rust source files make the ModelBreeder theory more concrete. They demonstrate a local-first, browser-oriented runtime that can load a custom .slm model package, parse tokenizers, run quantized matrix-vector operations, apply validated adapter-delta packages, generate text, emit diagnostics, and run local eval cases.

Runtime concepts promoted into the public site

  • .slm model packages should expose header identity, tokenizer section identity, tensor directory identity, parameter count, quantization mode, and artifact checksum.
  • Adapter packages should not be treated as generic blobs. They should bind to an expected model identity, tensor layout checksum, tokenizer checksum, and parameter count.
  • A browser-local runtime can expose strict ABI functions for loading models, validating adapters, applying adapters, configuring sampling, generating text, and reading diagnostics.
  • Evaluation should produce sidecars that name the model, cases, quality boundary, evaluator, source kind, and pass/fail result.
  • Diagnostics should include model-loaded state, token counts, tokens per second, peak scratch usage, KV cache length, active quantization, applied adapter count, and assembly-state checksum.

Site content updated from this evidence

  • /architecture/tinyrustlm-runtime
  • /architecture/slm-model-package-abi
  • /blueprints/rust-browser-model-lab
  • /tools/release-packet-builder
  • /tools/lineage-dag-viewer