English | ไธญๆ | Espaรฑol | ๆฅๆฌ่ช | Deutsch | ะ ัััะบะธะน | Portuguรชs | Franรงais | ํ๊ตญ์ด
-
Lightweight: Just 100 lines. Zero bloat, zero dependencies, zero vendor lock-in.
-
Expressive: Everything you loveโ(Multi-)Agents, Workflow, RAG, and more.
-
Agentic Coding: Let AI Agents (e.g., Cursor AI) build Agentsโ10x productivity boost!
Get started with Pocket Flow:
- To install,
pip install pocketflowor just copy the source code (only 100 lines). - To learn more, check out the video tutorial and documentation
- ๐ Join our Discord to connect with other developers building with Pocket Flow!
- ๐ Pocket Flow now has Typescript, Java, C++, Go, Rust and PHP versions!
Current LLM frameworks are bloated... You only need 100 lines for LLM Framework!
| Abstraction | App-Specific Wrappers | Vendor-Specific Wrappers | Lines | Size | |
|---|---|---|---|---|---|
| LangChain | Agent, Chain | Many (e.g., QA, Summarization) |
Many (e.g., OpenAI, Pinecone, etc.) |
405K | +166MB |
| CrewAI | Agent, Chain | Many (e.g., FileReadTool, SerperDevTool) |
Many (e.g., OpenAI, Anthropic, Pinecone, etc.) |
18K | +173MB |
| SmolAgent | Agent | Some (e.g., CodeAgent, VisitWebTool) |
Some (e.g., DuckDuckGo, Hugging Face, etc.) |
8K | +198MB |
| LangGraph | Agent, Graph | Some (e.g., Semantic Search) |
Some (e.g., PostgresStore, SqliteSaver, etc.) |
37K | +51MB |
| AutoGen | Agent | Some (e.g., Tool Agent, Chat Agent) |
Many [Optional] (e.g., OpenAI, Pinecone, etc.) |
7K (core-only) |
+26MB (core-only) |
| PocketFlow | Graph | None | None | 100 | +56KB |
The 100 lines capture the core abstraction of LLM frameworks: Graph!
From there, it's easy to implement popular design patterns like (Multi-)Agents, Workflow, RAG, etc.
โจ Below are basic tutorials:
| Name | Difficulty | Description |
|---|---|---|
| Chat | โโโ Dummy | A basic chat bot with conversation history |
| Structured Output | โโโ Dummy | Extracting structured data from resumes by prompting |
| Workflow | โโโ Dummy | A writing workflow that outlines, writes content, and applies styling |
| Agent | โโโ Dummy | A research agent that can search the web and answer questions |
| RAG | โโโ Dummy | A simple Retrieval-augmented Generation process |
| Batch | โโโ Dummy | A batch processor that translates markdown into multiple languages |
| Streaming | โโโ Dummy | A real-time LLM streaming demo with user interrupt capability |
| Chat Guardrail | โโโ Dummy | A travel advisor chatbot that only processes travel-related queries |
| Majority Vote | โโโ Dummy | Improve reasoning accuracy by aggregating multiple solution attempts |
| Map-Reduce | โโโ Dummy | Batch resume qualification using map-reduce pattern |
| CLI HITL | โโโ Dummy | A command-line joke generator with human-in-the-loop feedback |
| Multi-Agent | โ โโ Beginner | A Taboo word game for async communication between 2 agents |
| Supervisor | โ โโ Beginner | Research agent is getting unreliable... Let's build a supervision process |
| Parallel | โ โโ Beginner | A parallel execution demo that shows 3x speedup |
| Parallel Flow | โ โโ Beginner | A parallel image processing showing 8x speedup |
| Thinking | โ โโ Beginner | Solve complex reasoning problems through Chain-of-Thought |
| Memory | โ โโ Beginner | A chat bot with short-term and long-term memory |
| Text2SQL | โ โโ Beginner | Convert natural language to SQL queries with an auto-debug loop |
| Code Generator | โ โโ Beginner | Generate test cases, implement solutions, and iteratively improve code |
| MCP | โ โโ Beginner | Agent using Model Context Protocol for numerical operations |
| Agent Skills | โ โโ Beginner | Route requests to reusable markdown skills and apply them in an agent flow |
| A2A | โ โโ Beginner | Agent wrapped with A2A protocol for inter-agent communication |
| Streamlit FSM | โ โโ Beginner | Streamlit app with finite state machine for HITL image generation |
| FastAPI WebSocket | โ โโ Beginner | Real-time chat interface with streaming LLM responses via WebSocket |
| FastAPI Background | โ โโ Beginner | FastAPI app with background jobs and real-time progress via SSE |
| Voice Chat | โ โโ Beginner | An interactive voice chat application with VAD, STT, LLM, and TTS. |
| Judge | โ โโ Beginner | LLM-as-Judge evaluator-optimizer loop for iterative content refinement |
| Debate | โ โโ Beginner | Adversarial reasoning with two advocates and an impartial judge |
| Agentic RAG | โ โโ Beginner | Agent-driven RAG that decides which documents to read |
| Self-Healing Mermaid | โ โโ Beginner | Generate Mermaid diagrams with automatic error recovery |
| Heartbeat | โ โโ Beginner | ClawBot-like always-on periodic monitoring with nested flows |
| Lead Generation | โ โ โ Intermediate | Sales pipeline: scrape, enrich, score, and personalize emails |
| Newsletter | โ โ โ Intermediate | AI newsletter curation: search, filter, summarize, and format |
| Invoice Processing | โ โ โ Intermediate | Extract and validate invoice data from PDFs using vision |
| NotebookLM | โ โ โ Intermediate | Turn documents into a podcast with two AI hosts |
| Deep Research | โ โ โ Intermediate | Recursive map-reduce research with iterative refinement |
| Coding Agent | โ โ โ Advanced | Production coding agent with 6 tools, memory, and patch-as-subflow |
๐ Want to see other tutorials for dummies? Create an issue!
๐ Through Agentic Codingโthe fastest LLM App development paradigm-where humans design and agents code!
โจ Below are examples of more complex LLM Apps:
| App Name | Difficulty | Topics | Human Design | Agent Code |
|---|---|---|---|---|
| Website Chatbot Turn your website into a 24/7 customer support genius |
โ
โ
โ Medium |
Agent RAG |
Design Doc | Flow Code |
| Danganronpa Simulator Forget the Turing test. Danganronpa, the ultimate AI experiment! |
โ
โ
โ
Advanced |
Workflow Agent |
Design Doc | Flow Code |
| Codebase Knowledge Builder Life's too short to stare at others' code in confusion |
โ
โ
โ Medium |
Workflow | Design Doc | Flow Code |
| Build Cursor with Cursor We'll reach the singularity soon ... |
โ
โ
โ
Advanced |
Agent | Design Doc | Flow Code |
| Ask AI Paul Graham Ask AI Paul Graham, in case you don't get in |
โ
โ
โ Medium |
RAG Map Reduce TTS |
Design Doc | Flow Code |
| Youtube Summarizer Explain YouTube Videos to you like you're 5 |
โ
โโ Beginner |
Map Reduce | Design Doc | Flow Code |
| Cold Opener Generator Instant icebreakers that turn cold leads hot |
โ
โโ Beginner |
Map Reduce Web Search |
Design Doc | Flow Code |
-
Want to learn Agentic Coding?
-
Check out my YouTube for video tutorial on how some apps above are made!
-
Want to build your own LLM App? Read this post! Start with this template!
-