Glossary

The product, its documentation and its code use the same words on purpose. Two of them used to mean four things each, which cost us more time than any bug.

On the canvas

We sayWe never sayWhat it is
promptmodule, stepA node the optimizer rewrites. The program is made of prompts.
routerorchestrator, branchA prompt with more than one outgoing edge: the model returns next and picks the path. A router is still a prompt and is still optimized.
steptool, plugin, integrationA node that is not part of the program: an external call the optimizer never rewrites.
programpipeline, chain, graphThe prompts and edges together — what gets optimized.
evaluatescorer blockThe terminal block: scorers, objective, hold-out.
A program is made of prompts; steps fetch things from outside it. Prompts change during a run. Steps do not.

Running and shipping

We sayWe never sayWhat it is
runjob, experimentOne optimization: rounds of rewrite, gate, evaluate.
baseline runeval-only, dry runA run with zero rounds: evaluates the prompts as written and stops.
rounditeration, generationOne pass of the search loop.
gatefilterThe small-batch check a rewrite must pass before earning a full evaluation.
hold-outtest set, validation setRows the search never sees. The number that counts.
versiondeployment, releaseAn immutable published snapshot: prompts, models, steps, and the score it earned.
tracelog, recordOne served request and what it produced.
outcomefeedback, correctionWhat happened after the answer. A trace plus an outcome is a label.
templateexample, sample, demoA library entry you add to your projects. What you get is a project.

Data

We sayWe never sayWhat it is
datasettraining data, corpusRows with inputs and a label column.
labelanswer, target, ground truthThe right answer for a row.
freezecache, snapshot, syncRunning a step over every row once and writing its answers onto the dataset as columns. Evaluation reads the frozen columns; production calls the step live.
enrichmentaugmentationWhat freezing produces: the step's columns on the dataset.

Authorisation

Six things were all called “credentials”. “Credential” on its own is banned in our copy — say which: house key, endpoint, step key, connection, app credentials, API key. What each one is →

Things we deliberately do not have

Saying these would imply a promise we have not made: