Intro to Agents for the Generative AI Leader Exam

GCP Study Hub
Ben Makansi
September 30, 2025

The Generative AI Leader exam spends real time on agents, and the questions tend to hinge on whether you can tell an agent apart from a chatbot and whether you understand what an agent is actually capable of doing. I want to walk through the foundational ideas here so the rest of the agent material lands cleanly.

What an AI agent is

An AI agent is an AI system that can use different tools, make decisions, and complete tasks without constant human supervision. The key phrase is "without constant supervision." You set the goal and provide some capabilities, and the agent works through the problem on its own.

Many practitioners describe the agent as the next stage of the AI era. It moves from passive to active. You can program an agent to perform tasks automatically, like sending reports on a schedule, or you can position it as the primary interface for an end user of a specific tool or set of tools.

From rule-based to chatbot to agentic

It helps to see agents in the context of what came before. There are three eras worth knowing for the Generative AI Leader exam.

Rule-based systems are traditional software. Every action, every decision, every output is hardcoded by developers. These systems are predictable and reliable, but rigid. Everything has to be anticipated and programmed beforehand.

Generative AI represents the chatbot era. These systems understand natural language and generate responses, but they are fundamentally reactive. You ask them something, they respond. You ask them something else, they respond again. Each interaction is independent. There is no planning, no memory of the goal, no ability to take action without you asking for the next step.

AI agents are the agentic era. The system does not just respond to prompts. It takes goals, breaks them into steps, calls the tools it needs, evaluates the results, and adjusts course if necessary. It can send an email, query a database, process information, and make decisions in sequence, all toward completing a larger objective. You set the direction. The agent handles the execution.

That conceptual shift, from prompts and replies to autonomous multi-step workflows, is the evolution the exam wants you to recognize.

Agents are not the same as chatbots

The terms "AI agent" and "chatbot" get thrown around interchangeably, and the Generative AI Leader exam tests whether you can keep them separate.

A chatbot is a conversation engine. You ask it something, and it provides information or continues a dialogue. It responds to questions. It provides answers. The conversation is the main thing, and the workflow is fixed. You input, it responds, you input again. It is reactive by design.

An agent works differently. An agent takes actions. If you ask an agent to process a batch of customer orders and flag potential issues, the agent does not just describe what it would do. It actually does it. It uses tools and APIs to connect with real systems. It makes autonomous decisions along the way. If it hits an issue, it might change course without asking permission. It interacts with real world systems, not just the conversation window.

The two columns to remember:

  • Chatbot: responds to questions, provides information, conversation only, fixed workflow.
  • Agent: takes actions, uses tools and APIs, makes autonomous decisions, interacts with real world systems.

One way I think about it is that a chatbot is like an expert consultant you can ask for advice. An agent is more like an employee you hand a task to, who then goes and executes, using judgment to handle whatever comes up. One is advisory. One is operational.

If an exam scenario involves actually doing something in a system, taking actions, integrating with tools, making decisions autonomously, you are looking at an agent. If the scenario is primarily about answering questions or delivering information conversationally, that is a chatbot.

The four core capabilities of an AI agent

A generative AI agent is a piece of software that learns how to best achieve a goal based on inputs and tools available to it. There are four core capabilities that define what makes an agent an agent, and these are worth memorizing for the Generative AI Leader exam.

  • Tool Use. Agents can call APIs, query databases, search the web, run code, and interact with external systems to accomplish tasks.
  • Goal-directed behavior. Agents work toward achieving specific objectives rather than simply responding to prompts. Agents have tasks to complete.
  • Memory. Agents remember past interactions, maintain context across sessions, and build up knowledge about users and their preferences.
  • Planning. Agents break complex tasks into steps, determine the order of operations, and adapt plans based on intermediate results.

If a question describes a system that is doing all four of these things, that is an agent. If it is missing tool use or planning or goal-directed behavior, you are probably looking at a chatbot or a more traditional generative AI application.

My Generative AI Leader course covers the types of agents, agent architectures, and how Google Cloud positions its agent tooling alongside the rest of the foundational material you need for the exam.

arrow