What are AI Agents?
“From Passive Tools to Active Assistants: The Cognitive Revolution in Software.”
AI Agents
A comprehensive collection exploring AI agents—autonomous systems that perceive, reason, and act. From foundational concepts to production deployment, covering voice agents, vision agents, multi-agent systems, and cutting-edge research.
Each topic includes:
- Core concepts and architecture patterns
- Implementation approaches (tool-agnostic)
- Production engineering considerations
- Code examples and best practices
- Connections to LLMs, RAG, and multimodal AI
Browse by Topic
Foundations:
- What are AI Agents
- LLM Capabilities for Agents
- Prompt Engineering for Agents
- Tool Calling Fundamentals
- Memory Architectures
Voice Agents:
Vision Agents:
Multi-Agent Systems:
Advanced Topics:
Problem Index
Below you’ll find all AI Agents topics in chronological order:
Content created with the assistance of large language models and reviewed for technical accuracy.
LLM Capabilities for Agents
“The Engine of Autonomy: Understanding the Agentic ‘Brain’.”
Prompt Engineering for Agents
“Programming with English: The High-Level Language of 2024.”
Tool Calling Fundamentals
“Giving the Brain Hands to Act: The Interface Between Intelligence and Infrastructure.”
Memory Architectures
“The difference between a Chatbot and a Partner is Memory.”
Agent Frameworks Landscape
“To Framework or Not to Framework? Navigating the Agent Ecosystem.”
Building Your First Agent
“Hello World? No, Hello Agent.”
Agent Workflow Patterns
“Better workflows beat better models.” — Dr. Andrew Ng
Retrieval-Augmented Generation (RAG)
“Giving the Brain a Library: The Foundation of Knowledge-Intensive Agents.”
Document Processing for Agents
“Garbage In, Garbage Out. The Art of Reading Messy Data.”
Vector Search for Agents
“Finding a Needle in a High-Dimensional Haystack: The Mathematics of Recall.”
Context Window Management
“The Finite Canvas of Intelligence: Managing the Agent’s RAM.”
Multi-Step Reasoning
“Thinking Fast and Slow: How to make LLMs stop guessing and start solving.”
The ReAct Pattern Deep Dive
“Reason + Act: The Loop that Changed Everything.”
Planning and Decomposition
“If you fail to plan, you are planning to fail (and burn tokens).”
Real-Time Agent Pipelines
“Speed is not a feature. Speed is the product.”
Voice Agent Architecture
“Talking to machines: The end of the Keyboard.”
Voice Agent Frameworks: LiveKit & Pipecat
“Don’t build the phone network. Just build the app.”
Voice Activity Detection (VAD)
“The art of knowing when to shut up.”
Real-Time Speech-to-Speech Agents
“Removing the Text Bottleneck: The Omni Future.”
Vision Agent Fundamentals
“Giving eyes to the brain: How Agents see the world.”
Multimodal LLMs (GPT-4V, LLaVA)
“One model to rule them all: Unifying Text and Vision.”
Screen Agents (UI Navigation, OmniParser)
“The ultimate API: The User Interface.”
Object Detection & Segmentation (YOLO, SAM)
“Knowing WHAT is where, and precisely WHERE it acts.”
Video Analysis & Real-World Perception
“Time: The 4th Dimension of Vision.”