Reference

AI Agent Glossary

73 terms precisely defined for engineers building production AI systems. No marketing fluff—just engineering accuracy.

Core AI Agent Concepts

Architecture & Design Patterns

Directed Acyclic Graph

A graph structure where nodes represent agent steps and directed edges define execution order with no cycles.

State Machine

A computational model that defines an agent's possible states and the transitions between them, ensuring deterministic behavior.

Retrieval-Augmented Generation

An architecture that grounds LLM responses in retrieved source documents, reducing hallucination and improving accuracy.

Multi-Agent System

An architecture where multiple specialized agents collaborate, each handling a subset of a complex task.

Chain of Thought

A prompting technique that elicits step-by-step reasoning from an LLM before producing a final answer.

ReAct Pattern

A framework combining Reasoning and Acting: the LLM reasons about what to do, acts via tools, then observes results.

Human-in-the-Loop

A design pattern where human review and approval is required at designated checkpoints in an agent workflow.

Tool Calling

The mechanism by which an LLM selects and invokes external functions with structured arguments during inference.

Agentic RAG

An advanced RAG architecture where an AI agent orchestrates retrieval, can reformulate queries, retrieve from multiple sources, and iteratively refine results until the answer is complete.

AutoGen

Microsoft's open-source framework for building multi-agent systems where AI agents can converse with each other and humans to solve tasks collaboratively.

LangChain

A popular open-source framework for building applications with LLMs.

LangGraph

A framework by LangChain for building stateful, multi-actor applications with LLMs using a directed graph architecture that enables deterministic control flow.

LLM Technology

Large Language Model

A neural network trained on large text corpora to generate and understand natural language, serving as the core of AI agents.

Tokenization

The process of converting text into numerical tokens for LLM processing. Token count determines cost and context limits.

Context Window

The maximum number of tokens an LLM can process in a single inference call, defining the agent's working memory limit.

Temperature

A sampling parameter that controls output randomness. Temperature 0 produces deterministic outputs; higher values increase variability.

Inference

The process of running a trained model to generate predictions or outputs from new inputs. The production-time computation.

Fine-Tuning

Additional training of a pre-trained LLM on domain-specific data to improve performance on target tasks or adopt specific behaviors.

Prompt Engineering

The practice of designing and optimizing LLM input prompts to reliably elicit desired outputs and behaviors.

a Transformer

A neural network architecture introduced in 2017 that uses self-attention mechanisms to process sequences in parallel.

Few-Shot Learning

A prompting technique where you provide 2-5 examples of desired input-output pairs before your actual query.

Zero-Shot Learning

The ability of LLMs to perform tasks they weren't explicitly trained for, using only instructions without examples.

Grounding in AI

The practice of anchoring AI responses in verifiable source data rather than relying solely on the model's parametric knowledge.

Memory & Storage

Vector Database

A database optimized for storing and querying high-dimensional embedding vectors, enabling semantic similarity search.

Embedding

A dense numerical vector representation of text that captures semantic meaning, enabling similarity comparisons.

Semantic Search

Retrieval based on meaning and context rather than keyword matching, using embedding similarity to find relevant content.

Episodic Memory

An agent's stored record of past interactions and experiences, retrievable to inform future decisions.

Working Memory

The in-context information available to an agent during a single inference call, bounded by the context window.

Knowledge Graph

A structured representation of entities and their relationships, enabling precise fact retrieval and multi-hop reasoning.

Chunking

The process of splitting documents into smaller segments for indexing and retrieval in RAG systems.

Memory in AI Agents

The ability of AI agents to retain and recall information across interactions.

a Knowledge Base

A structured repository of information (documents, FAQs, policies) that AI agents query to ground their responses in factual, organization-specific data.

Hybrid Search

A retrieval strategy that combines keyword-based search (BM25) with semantic vector search, then fuses the results.

Reranking

A second-stage retrieval step that uses a more accurate (but slower) model to reorder the initial results, improving the relevance of documents passed to the LLM.

Similarity Score

A numerical measure (typically 0-1 or -1 to 1) indicating how semantically similar two text embeddings are.

Deployment & Infrastructure

Security & Compliance

Evaluation & Testing

Document Intelligence

Building a production AI system?

We engineer deterministic AI agents for enterprise teams. From architecture to deployment.

Start Assessment