Glossary

The harness engineering glossary

The vocabulary of the agent harness — the prompts, tools, skills, evals, and memory that wrap the model call — and of the work of improving it from production traces: from behavioral failure to continual learning. Written by the team building Moda.

TL;DR: when an agent misbehaves in production, the fix almost always lands in the harness layer, not the model weights. These 26 terms are the ones teams use while doing that work.

Updated

Jump to a letter

A

Agent harness

Also known as: Agent harness layer, Agent scaffolding

Everything that wraps the model call to produce agent behavior: system prompts, tool definitions and routing, workflow orchestration, retrieval, memory, evals, and guardrails.

The agent harness is the layer between the user and the model — what makes an agent an agent rather than a chat completion. It includes the system prompt that frames the agent, tool schemas and routing logic, multi-step workflow definitions, retrieval indices, memory state and how it is summoned per turn, evals that gate ships, and guardrails on input and output. Most production agent improvement happens on the harness layer, not on the model weights, because harness edits are fast to ship, easy to inspect, easy to reverse, and apply across whichever model you mount underneath. Moda is self-improvement for AI agents on the harness layer: every behavioral failure and frustration event is attributed to a specific harness component (prompt, tool, workflow, context, memory, eval, or model), and the resulting learnings live in a latent space outside the model weights so they apply across models and adapt per user.

RelatedContinual learning, Self-improving agent, Behavioral failure, Moda

Read the guide: What is an agent harness

Agent laziness

A behavioral failure where the agent declines, hedges, or gives a generic answer to a task it is capable of completing.

Agent laziness is a class of behavioral failure in AI agents where the model returns 'I cannot help with that', refuses an in-scope request, or substitutes a high-level non-answer when the user asked for specifics. It usually traces back to overly cautious system prompts, safety filters tuned too aggressively, or instruction-following regressions after a model upgrade. Moda detects laziness by comparing the user's stated goal to the agent's trajectory and flagging mismatches at the trace level — across the whole agent run, not inside any single call.

RelatedBehavioral failure, Goal drift, Frustration root cause

AI agent observability

Also known as: Agent observability, Agentic observability

In a harness engineering workflow, the input layer: the trace-level record of what production agents did, end to end. The record only pays off when it becomes a specific harness change.

Harness engineering treats AI agent observability as raw material, not a destination. The term covers recording and understanding what production agents are doing at the level of the whole trace — the full agent run: which intents users bring, where trajectories break, how users experience the agent — rather than only the span- or token-level view that traditional APM and per-call LLM tracing record. But watching that record does not fix an agent; the fix ships in the harness — a revised prompt, a tightened tool schema, a new skill, an updated eval, a memory change. Moda is not an observability platform: it consumes the traces this layer produces and turns them into verified harness improvements, each attributed to the harness component that caused the failure.

RelatedAgent harness, LLM observability, Behavioral failure, Intent discovery

B

Behavioral failure

A failure mode that occurs across the whole trace, not inside any single API call — invisible to per-call spans alone.

A behavioral failure is when an AI agent does the wrong thing while every individual API call returns 200 OK. Examples include calling the right tool with subtly wrong arguments (tool misuse), forgetting earlier turns (context loss), refusing in-scope tasks (agent laziness), fabricating facts (hallucinations), retrying the same failed action (reasoning loops), and silently abandoning the user's objective (goal drift). Detecting behavioral failures requires comparing trajectories and outcomes, not just status codes.

RelatedTool misuse, Context loss, Agent laziness, Hallucination, Reasoning loops, Goal drift

C

Cluster hierarchy

Also known as: Cluster Hierarchy V2, Hierarchical clustering

Three-level segment clustering — Category → Subcategory → Cluster — built from production trace segments with no manual tagging.

Moda's cluster hierarchy groups trace segments into a three-level taxonomy: broad categories, mid-level subcategories, and tight clusters. New segments are assigned into the existing hierarchy as they arrive, so the taxonomy stays current between full clustering runs, and every node carries a plain-language label so the map reads as user goals rather than cluster IDs.

RelatedIntent discovery, Segment, Trace analytics

Compaction

Also known as: Context compaction, Memory compaction, Context summarization

The harness step that summarizes older turns, completed workflow phases, and bulky tool outputs into a compact digest, so the context window carries decisions and constraints instead of raw transcript.

Compaction in an agent harness is the step that rewrites accumulated context — older turns, completed workflow phases, verbose tool outputs — into a shorter digest that preserves decisions, constraints, and open questions while dropping the raw transcript. Agents fill their own windows by construction, and model performance degrades as input grows (context rot), so long-running agents compact instead of appending forever. The compaction prompt is a harness artifact like any other: tuned well, it keeps a forty-turn session sharp; tuned badly, it silently summarizes away the constraint from turn three and produces context loss while every call still returns 200. Moda treats compaction as a first-class harness component — when it detects context loss across production traces, it attributes the failure to the component responsible, compaction prompt included, and verifies the candidate fix against replayed traffic before it ships.

RelatedAgent harness, Context loss, Context rot, Behavioral failure, Moda

Read the guide: Context rot

Context loss

A behavioral failure where the agent forgets earlier turns, contradicts itself, or asks the user to re-supply known information.

Context loss happens when an AI agent loses track of information from earlier in the trace — forgetting user preferences, repeating questions already answered, or contradicting prior statements. It is common in long sessions, multi-step workflows, and traces that exceed the model's effective attention window. Context loss is a behavioral failure: every individual call may succeed, but the trace as a whole degrades.

RelatedBehavioral failure, Frustration root cause, Context rot

Context rot

Also known as: LLM context rot, AI context rot

The degradation of an LLM's performance as its input context grows longer: recall, reasoning, and instruction-following decline unevenly as tokens accumulate, even well below the advertised window limit.

Context rot is the model-level mechanism named by Chroma's 2025 technical report — which measured it across 18 models — and adopted by Anthropic's engineering guidance: as the number of tokens in the context window increases, the model's ability to accurately recall information from that context decreases. It happens because transformer attention relates every token to every other token, so a growing window stretches the attention budget thin. In a production agent it surfaces as context loss — forgotten turns, dropped constraints, re-asked questions — and no model choice removes it, since every model tested shows the effect. Every mitigation that works is a change to the agent harness: compaction, trimmed tool outputs, explicit memory, load-bearing instructions positioned at the window edges, and regression evals on mid-context misses, each verified against production traces. Moda detects the symptom as context loss across every production trace, attributes each detection to the harness component responsible, and verifies each candidate fix against replayed traffic before it ships.

RelatedCompaction, Context loss, Agent harness, Behavioral failure

Read the guide: Context rot

Continual learning

Also known as: Continuous learning, Learning loop, Harness-layer learning

Harness-layer improvement from production signal: updating prompts, tools, workflows, retrieval, memory, and evals so the learnings live outside the model weights and apply across whichever model the harness mounts.

The agent harness is where continual learning (sometimes called continuous learning) actually happens in production: revised system prompts, retightened tool schemas, restructured workflows, expanded retrieval indices, new skills, updated eval sets, and per-user memory. The term describes closing the loop between what an agent does in production and how the agent is built. Model fine-tunes are an option but rarely the first step — they are heavier, harder to inspect, and bound to a specific model. Keeping learnings outside the model weights makes them portable across models, inspectable, reversible, per-user adaptable, and continuously updatable without retraining. Moda is not a continual learning system; it is a harness engineering platform that does the work this loop needs — turning production traces into verified improvements to the harness.

RelatedAgent harness, Self-improving agent, Intent discovery, Behavioral failure, Moda

Read the guide: Continual learning

F

Frustration root cause

Also known as: Frustration detection

For every detected frustration event, the trigger turn, leading trajectory, affected user goal, and counterfactual for what the agent should have done.

Frustration root cause goes beyond sentiment scoring. When Moda detects a frustration event in a trace, we attach four things: the trigger turn that flipped sentiment, the trajectory leading up to it, the user goal that was at risk, and a counterfactual — what the agent should have done instead. The counterfactual is derived from the full trace, not from a single turn. The result is a debuggable signal, not a number on a chart.

RelatedBehavioral failure, AI agent observability

G

Goal drift

A behavioral failure where the agent silently abandons the user's original objective and solves a different problem.

Goal drift is when an AI agent quietly changes the problem it is solving partway through a trace. The user asks for X, the agent helps with related-but-different Y, and the original objective is never met. Goal drift is detected by comparing initial user intent to final outcome across the whole trace — something per-call spans cannot see.

RelatedBehavioral failure, Intent discovery

H

Hallucination

When the agent fabricates facts, invents tool calls, or claims to have performed actions it did not perform.

In an AI agent context, a hallucination is any output that is presented as factual but is not grounded in real data, real tool calls, or the trace history. Common forms include inventing API parameters, citing non-existent tools, fabricating customer records, and claiming completion of actions the agent never took. Moda treats hallucinations as a category of behavioral failure and surfaces them when the agent's claimed actions diverge from its actual tool calls.

RelatedBehavioral failure, Tool misuse

I

Intent discovery

Also known as: Intent clustering, Intent taxonomy

Hierarchical clustering of production traces into a 3-level taxonomy with no manual tagging.

Intent discovery is the process of figuring out what users are actually trying to do with your agent, without anyone hand-labeling traces. Moda's intent discovery groups every production trace segment by meaning and labels each group in plain language. The output is a Category → Subcategory → Cluster taxonomy of real user goals.

RelatedCluster hierarchy, Segment, Trace analytics

L

LLM observability

Call- and span-level monitoring of LLM applications — prompts, completions, tokens, latency, errors. It sits upstream of the harness layer: it records what happened; harness engineering decides what to change.

In a harness engineering workflow, LLM observability is the layer that produces the raw record: prompts, completions, token usage, latency, retries, and errors for every call. Tools like LangSmith and Langfuse own this layer, and it is essential for debugging individual requests. A record is not an improvement, though — the fix lands in the harness: prompts, tool definitions, skills, evals, memory. Moda is not an LLM observability tool; it sits downstream, ingesting the spans this layer emits (or raw telemetry over OTLP), assembling them into whole traces, and converting them into verified harness changes. Teams typically keep their tracing tool and add Moda on top of the same telemetry stream.

RelatedAgent harness, AI agent observability, LLM tracing

LLM tracing

Recording the step-by-step execution of an LLM application — every prompt, tool call, and response — for debugging.

LLM tracing captures the chronological steps of a single LLM-powered request: the prompts sent, the tool calls made, the intermediate reasoning, and the final response. Per-call tracing tools are essential for debugging individual spans but only see one request at a time. To answer 'what are users doing across thousands of traces' or 'which behavioral failure is most common,' span data has to be assembled into whole traces, aggregated, and clustered — the job of agent analytics.

RelatedLLM observability, AI agent observability

M

MCP server

Also known as: Model Context Protocol server

A server that exposes tools and resources to AI coding assistants via the Model Context Protocol.

An MCP (Model Context Protocol) server is a process that exposes a set of tools and resources to an MCP-aware client like Claude Code, Cursor, or Windsurf. Moda ships an MCP server for AI agent debugging: from inside your IDE you can pull failing traces, inspect tool call failures, and ask Moda's data agent natural-language questions over your production trace data.

RelatedAI agent observability, Moda

Moda

Moda is a harness engineering platform for teams with an AI agent already in production. It turns production traces into verified improvements for the agent harness: prompts, tools, skills, evals, memory.

Moda is a harness engineering platform. Teams with an agent already in production stream telemetry in through an OpenTelemetry-native pipeline; Moda assembles it into whole traces — one per agent run — and clusters them into a hierarchy of user intents, detects behavioral failures — tool misuse, context loss, agent laziness, hallucinations, reasoning loops, goal drift — and attributes each one to the harness component responsible. The output is not a dashboard to watch: it is a verified change to a specific prompt, tool definition, skill, eval, or memory, and every frustration event ships with a root cause and an agent counterfactual. Moda is backed by Y Combinator and provider-agnostic across Anthropic, OpenAI, Google, OpenRouter, and any OTEL-compatible LLM stack.

RelatedAgent harness, Continual learning, Intent discovery, Behavioral failure

O

OpenLLMetry

An open-source SDK that emits OpenTelemetry-compatible traces for LLM and agent applications.

OpenLLMetry is an open-source instrumentation library that emits OpenTelemetry traces for LLM applications across major providers (OpenAI, Anthropic, Google, Cohere, Mistral, AWS Bedrock, Azure OpenAI) and agent frameworks (LangChain, LlamaIndex, Mastra). Moda ingests OpenLLMetry traces directly through its OTLP HTTP endpoint, so teams with existing instrumentation can keep their current telemetry path. New integrations can use the first-party Moda SDK instead.

RelatedOpenTelemetry, Zero-config ingest

OpenTelemetry

Also known as: OTEL, OTLP

The industry-standard open-source framework for emitting and collecting telemetry — traces, metrics, and logs.

OpenTelemetry (OTEL) is a CNCF project that defines a vendor-neutral wire format (OTLP) and SDKs for traces, metrics, and logs. Moda ingests AI agent telemetry via OTLP/HTTP, which means any application already instrumented with OpenTelemetry — directly or through OpenLLMetry — can stream production traces into Moda without bespoke integration work.

RelatedOpenLLMetry, Zero-config ingest

R

Reasoning loops

A behavioral failure where the agent retries the same failed action, oscillates between answers, or fails to converge.

Reasoning loops occur when an AI agent gets stuck — repeating the same tool call after it has already failed, flipping between two competing answers, or running a chain-of-thought that never terminates. The user experience is delay, wasted tokens, and eventual abandonment. Moda detects reasoning loops by analyzing per-turn action sequences and surfacing cycles.

RelatedBehavioral failure, Tool misuse

S

Segment

A topic-coherent slice of a trace — the span between one shift in the user's goal and the next.

A segment is the unit of clustering in Moda. Each trace is split where the topic shifts, so one agent run becomes a sequence of segments that each cover a single user goal. Clustering segments — instead of whole traces — keeps clusters topically tight and lets a single multi-topic trace contribute to multiple intent clusters.

RelatedCluster hierarchy, Intent discovery

Self-improving agent

Also known as: Self-improving AI agent

An AI agent that updates its harness — prompts, tools, workflows, context, memory, evals — from production signal, in a latent space outside the model weights so improvements apply across whichever model the harness mounts and can adapt to each user.

A self-improving agent does not stop changing after deployment. Each production interaction becomes data: which intents are underserved, which tools misfire, which prompts trigger frustration, which corrections the user actually accepts. That signal feeds back into the harness — prompts, tool definitions, workflows, retrieval, memory state, evals, and routing — so the next version of the agent is materially better than the last. Keeping the learnings outside the model weights makes them portable across models, inspectable, reversible, and per-user adaptable. Moda provides the discovery and debug half of the loop and attributes every signal to a specific harness component, so the team knows exactly what to change next.

RelatedAgent harness, Continual learning, Intent discovery, Behavioral failure, Moda

Read the guide: Self-improving agents

T

Tool call failure

An explicit failure of a tool call — timeout, error response, or invalid arguments — surfaced with error subtypes and trends.

A tool call failure is the surface-level cousin of tool misuse: the tool itself errored, timed out, or returned an invalid response. Moda automatically flags these across traces, groups them by error subtype, plots hit-rate trends, and lets you drill into the affected traces. Unlike tool misuse, tool call failures are visible in standard per-call spans — but they are not always visible across thousands of traces at once.

RelatedTool misuse, Behavioral failure

Tool misuse

A behavioral failure where the agent calls the right tool with wrong arguments — or the wrong tool — while still returning a plausible response.

Tool misuse covers all the ways an agent can break a workflow without anything raising an error: passing subtly wrong arguments, choosing the wrong tool from a similar set, or producing a confident response that is not actually grounded in the tool's output. Detecting tool misuse requires understanding tool semantics — what the tool was supposed to do — not just whether it returned 200.

RelatedBehavioral failure, Tool call failure, Hallucination

Trace analytics

Also known as: Conversation analytics, LLM conversation analytics, Conversation intelligence

Analytics that treat full agent traces — the whole run, not individual calls — as the unit of analysis.

Trace analytics for AI agents measures population-level behavior across every agent run: what users are trying to do, how often they succeed, where they get stuck, and which intents correlate with churn or escalation. Unlike per-call telemetry, trace analytics requires segmenting, clustering, and labeling natural-language interactions. Moda automates this with hierarchical clustering of trace segments.

RelatedIntent discovery, AI agent observability, Cluster hierarchy

Z

Zero-config ingest

Three lines of SDK code plus OpenTelemetry-native intake — works with any LLM provider, no lock-in.

Zero-config ingest is Moda's onboarding promise: run moda init, let your coding agent integrate the Moda SDK, add your API key, and ship. Traces stream into your workspace within seconds once telemetry is flowing. Existing OpenTelemetry or OpenLLMetry instrumentation can send OTLP trace data over HTTP, and custom harnesses can POST raw JSON to /v1/ingest or /v1/ingest/multi. Hierarchical intent maps are generated during the weekly clustering run after at least 50 trace segments have accumulated.

RelatedOpenTelemetry, OpenLLMetry

Put these terms to work on your harness.

Production traces in. Verified harness improvements out. If your agent is already in production, book a demo and we'll show you Moda on your own data within 60 minutes.