AI Agent Glossary: Key Terms Explained Simply for Everyone
An AI agent glossary with over 40 key terms explained simply, from LLMs and tokens to tool use, MCP, agent skills, multi-agent teams, and human in the loop.
AI agent cost explained: what drives token usage, why agents spend more than chatbots, and practical ways to keep your AI spend predictable.
AI agents cost more than a chatbot because they take many steps per task, and every step sends text to a model and gets text back. Your bill depends on how much text moves (tokens), which model you use, how hard you ask it to think, and how many attempts a task takes.
The good news: almost every one of those drivers is something you can control. This guide explains where the money goes and the tactics that keep agent spending predictable.
There are two common ways to pay for the models behind AI agents.
A token is a small chunk of text, roughly a word fragment. Providers usually charge separately for input tokens (what you send) and output tokens (what the model writes), and output tokens usually cost more.
Either way, the same thing determines your spend: how many tokens your agents use and on which models.
A chat is one question and one answer. An agent works in a loop: read files, think, run a command, read the result, edit code, run tests, and repeat. If you are new to that loop, our explainer on agentic workflows shows how it works step by step.
Each turn of the loop sends the conversation so far back to the model. That means:
So one “small” task can involve dozens of model calls.
| Driver | Why it raises cost | How to control it |
|---|---|---|
| Model strength | Larger, smarter models cost more per token | Use strong models only where they matter |
| Reasoning effort | Higher effort means more “thinking” tokens | Lower effort for routine tasks |
| Context size | Long histories and big files are resent each step | Narrow scope, start fresh sessions |
| Number of steps | More loops mean more calls | Clear briefs, smaller tasks |
| Retries | Failed attempts repeat work | Tests and clear acceptance criteria |
| Team size | Parallel agents multiply usage | Add agents only when work is parallel |
| Coordination | Meetings and reviews cost tokens too | Keep them short and purposeful |
Let us go through the most important ones.
The biggest lever is which model does the work. Top models are excellent at planning and tricky code, but many tasks do not need them. Renaming variables, writing simple tests or updating documentation can often go to a smaller, cheaper model, or even a local one.
Many agent tools let you choose how much the model thinks before answering. Higher effort improves results on hard problems but produces more tokens. For straightforward edits, a lower setting is usually fine.
Vague goals make agents explore. They open more files, try more approaches and ask the model more questions. A clear brief with the goal, constraints and a definition of done cuts wasted steps. Our guide to writing better briefs for coding agents covers this in detail.
The most expensive token is the one spent redoing work. When an agent ships something broken and you only notice later, you pay to find the problem, explain it, and fix it. Catching problems early with automated checks is cheaper than debugging later.
Make a simple rule: strong models for planning, architecture and hard bugs; lighter models for routine edits, formatting and docs. If your tools allow per-role settings, give your planner the strongest model and your implementers something lighter.
Start tasks at a moderate effort level and only raise it when the agent struggles. Many tasks never need maximum thinking.
Small, well-defined tasks finish in fewer steps and keep context short. “Add a contact form with validation” is cheaper than “improve the website.”
Give agents a way to verify their own work, such as tests, a type checker or a linter. An agent that can run checks fixes problems in the same session, while context is fresh, instead of in an expensive follow-up. See AI code review and testing for how to set this up.
Open-weight models running on your own computer through Ollama have no per-token fees. They are slower and less capable, but fine for simple, low-risk tasks.
Running five agents in parallel can finish work faster, but it multiplies usage. Add teammates only when the work genuinely splits into independent pieces.
Tuning all of this by hand is tedious. One approach is to bundle the main cost drivers behind a single dial.
In BotQuarters, each company has a spending level from 1 to 10 that adjusts team size, model strength, how many meetings happen and how many review rounds work goes through. You can also choose the AI and effort level per role. A low level suits quick experiments; a higher level suits work where quality matters most. You still bring your own AI accounts, so model usage is billed by your providers as usual.
Agents complete tasks in many steps, and each step calls the model with the growing conversation. A single task can involve dozens of calls, while a chatbot answer is usually just one.
Use the lightest model that does the job well, keep tasks small and clearly defined, and let agents run tests so they do not need costly rework. Local models through Ollama can remove usage fees for simple tasks.
Subscriptions give predictable monthly costs but come with usage limits. API billing has no fixed cap and scales with usage, which suits occasional or carefully budgeted work. Many people start with a subscription and add API usage when they need more.
Set spending limits or alerts with your provider, break work into small tasks, and stop agents that loop on the same failure. Reviewing usage regularly helps you spot expensive patterns early.
An AI agent glossary with over 40 key terms explained simply, from LLMs and tokens to tool use, MCP, agent skills, multi-agent teams, and human in the loop.
AI agent security made practical: how permissions, sandboxes, version control and review keep coding agents useful without risking your machine or data.
AI for non programmers: how AI coding agents let you build real tools and apps without writing code, what to expect, and a step-by-step way to start.