snalabothu/inference-token-buffer-judge-recipe
Untrained recipe for evaluating ready/valid RTL repairs against a written contract and independent native checks. No weights or serving endpoint.
What a referee scores: Whether closure is real: a clean run proves nothing if the stimulus never exercised the behavior, so the referee scores coverage of the required bins, not the absence of errors.
Card
Inference token buffer judge: recipe template
Use this recipe to prepare and evaluate a judge for bounded ready/valid RTL repairs. It contains no trained weights, serving endpoint or measured model accuracy.
The seed corpus is pinned to Dataset revision 1: a written contract, original MIT-licensed RTL, an independent native scoreboard and a measured regression with 34,909 checks across 4,111 cycles and zero errors. Executable checks and engineering review provide the proposed training labels.
Build on the seed
- Read the buffer contract and reproduce the native testbench in the dataset.
- Prepare independently reviewed correct and faulty implementations. Keep changes and their expected effects traceable.
- Choose a compatible base model and license.
- Separate held-out designs and mutations from the training examples.
- Specify the training configuration and evaluation plan before fitting a model.
The supplied recipe.json pins the starting evidence and records the remaining inputs. README.md explains the workflow. Success on this one buffer does not establish a learned judge’s generalization, physical signoff or complete accelerator performance.
Files
Revision 1 on main · 3 files · 3.3 KB
First revision on this branch — every file is new.
The manifest lists this revision's paths, sizes, recorded checksums and download links. Follow its next-page link for the complete file set. Recorded checksums do not establish model compatibility.
- LICENSE1.0 KB
- README.md1.3 KB
- recipe.json988 B
Discussions
No discussions yet.
Versions
- rev1 on main — Publish the untrained judge recipe pinned to measured simulation dataset rev13 files · 3.3 KB
