LLMLetsPlay Pokémon agent and livestream overlay
  • Python 85.5%
  • HTML 6.2%
  • TypeScript 5.7%
  • Lua 1.6%
  • CSS 0.5%
  • Other 0.4%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
2026-01-02 20:18:31 -05:00
.claude Codebase audit: rename battle->analysis, fix token_coutner typo, fix vision_analysis NameError 2025-12-05 13:24:13 -05:00
.opencode/agent feat: Update chronicle UI, worker, core logic and zora gallery 2025-12-25 12:29:34 -05:00
apps update livestream submodule with goals widget type fix 2025-12-31 21:51:09 -05:00
assets Update UI: Fix icons, Tokenomics layout, inconsistent CA widgets, and Prompts page 2025-12-19 13:30:04 -05:00
core fix(cycle): reduce vision timeout, add action fallback, improve pumpfun stability 2026-01-02 20:18:31 -05:00
data feat: add robust mart navigation, persistence, and UI fixes 2025-12-31 21:07:28 -05:00
docs fix(cycle): reduce vision timeout, add action fallback, improve pumpfun stability 2026-01-02 20:18:31 -05:00
images Add Web UI Screenshot to README.md 2025-05-04 17:49:05 -07:00
pyAIAgent fix: Chat system overhaul - async processing, PumpFun stability, TTS fixes 2026-01-02 00:52:15 -05:00
roms feat: Multiple fixes - autosave, timer, prompts, UI 2025-12-10 12:39:16 -05:00
scripts fix(cycle): reduce vision timeout, add action fallback, improve pumpfun stability 2026-01-02 20:18:31 -05:00
services fix(cycle): reduce vision timeout, add action fallback, improve pumpfun stability 2026-01-02 20:18:31 -05:00
tests refactor: reorganize project structure with apps/ folder and consolidated tests 2025-12-19 21:54:11 -05:00
tools Fix Mart shelf walkability (blocked) and restore collision logic 2025-12-30 22:14:02 -05:00
trackers feat: add robust mart navigation, persistence, and UI fixes 2025-12-31 21:07:28 -05:00
workflows feat: Update chronicle UI, worker, core logic and zora gallery 2025-12-25 12:29:34 -05:00
.conda-env.yml Codebase audit: rename battle->analysis, fix token_coutner typo, fix vision_analysis NameError 2025-12-05 13:24:13 -05:00
.env.example fix(cycle): reduce vision timeout, add action fallback, improve pumpfun stability 2026-01-02 20:18:31 -05:00
.gitignore Fix invisible obstacle pathfinding prioritization and enhance navigation recovery 2025-12-31 13:13:27 -05:00
.gitmodules refactor: reorganize project structure with apps/ folder and consolidated tests 2025-12-19 21:54:11 -05:00
.pre-commit-config.yaml feat: implement terminal-themed documentation site with full frontend/backend automation 2025-12-23 18:47:29 -05:00
config.py Fix invisible obstacle pathfinding prioritization and enhance navigation recovery 2025-12-31 13:13:27 -05:00
CONTRIBUTING.md feat: implement terminal-themed documentation site with full frontend/backend automation 2025-12-23 18:47:29 -05:00
debug.png Fix invisible obstacle pathfinding prioritization and enhance navigation recovery 2025-12-31 13:13:27 -05:00
debug_mart_v4.png Fix navigation/exits, enhance commentary, enable pokemon center subgoals, and fix minimap target injection 2025-12-30 23:52:35 -05:00
interactive.py General linting and filebreakups 2025-07-21 23:55:56 -07:00
latest.png fix(cycle): reduce vision timeout, add action fallback, improve pumpfun stability 2026-01-02 20:18:31 -05:00
map.png feat: optimize vision pipeline, fix pathfinding collisions, and add pokeball subgoal 2025-12-31 18:44:06 -05:00
MCP_SETUP.md refactor: consolidate env config, cleanup chat providers, and secure .env.example 2025-12-22 21:57:20 -05:00
minimap.png fix(cycle): reduce vision timeout, add action fallback, improve pumpfun stability 2026-01-02 20:18:31 -05:00
minimap_overlay.png feat: add robust mart navigation, persistence, and UI fixes 2025-12-31 21:07:28 -05:00
mkdocs.yml feat: complete docs-as-code overhaul with pixel-art branding and automated pipelines 2025-12-23 20:00:04 -05:00
openapi.json feat: integrate opencode sdk and fix client connection 2025-12-18 09:50:37 -05:00
PLAN.md fix(vision): optimize ComfyUI integration, prevent 502 errors, and sync latest changes 2025-12-30 03:23:50 -05:00
ram_map.html fix: cycle counter sync on mGBA timeout + consecutive failure detection 2025-12-08 17:46:21 -05:00
README.md feat: implement terminal-themed documentation site with full frontend/backend automation 2025-12-23 18:47:29 -05:00
requirements.txt fix: Chat system overhaul - async processing, PumpFun stability, TTS fixes 2026-01-02 00:52:15 -05:00
run.py Fix invisible obstacle pathfinding prioritization and enhance navigation recovery 2025-12-31 13:13:27 -05:00
socketserver.lua fix(cycle): reduce vision timeout, add action fallback, improve pumpfun stability 2026-01-02 20:18:31 -05:00
start_agent.bat fix: audio playback bug - communicate() was killing process 2025-12-13 12:48:40 -05:00
start_agent.sh Fix invisible obstacle pathfinding prioritization and enhance navigation recovery 2025-12-31 13:13:27 -05:00
start_chronicle.sh fix: use correct LLM model for tweets and init chronicle db 2025-12-24 00:28:43 -05:00
test_minimap_sprites.png chore: update livestream submodule and add debug assets 2025-12-30 20:51:14 -05:00

🤖 Pokemon LLM Agent

Autonomous AI Agent that plays Pokemon Red/FireRed using LLMs.

Web UI

🌟 Key Features

  • Visual Gameplay: Uses Vision Models (GLM-4V, GPT-4o) to "see" the game screen.
  • Smart Navigation: A* Pathfinding with caching and cross-map routing.
  • Narrative Engine: Generates live commentary and TTS audio.
  • Chronicle Ecosystem: Mints achievements as Zora Coins on Base L2.
  • 24/7 Autonomy: Resilient loop with error recovery and state persistence.

📚 Documentation

The full technical documentation is available at docs.llmletsplay.com.

🚀 Getting Started

🧠 Architecture

🛠️ Guides


⚡ Quick Run

python run.py --mode ZAI --auto

🛠️ Development

Building Documentation

To build and serve the documentation site locally:

# Install dependencies
pip install -r requirements.txt

# Build and serve
python -m mkdocs serve

The site will be available at http://127.0.0.1:8000.