Prompt Learning Overview @arizeai
Prompt Learning Overview  @arizeai
Uploaded November 2025 | Updated November 2026, 3 hours ago
We optimized Claude Code's system prompt - just its prompt - and achieved +10% boost on SWE Bench. No architecture changes, tool improvements, or fine-tuning.

How? An approach called Prompt Learning. What is Prompt Learning? It’s an optimization algorithm for prompts. Inspired by RL, it follows an action β†’ evaluation β†’ improvement loop β€” but instead of gradients, it uses Meta Prompting: feeding a prompt into an LLM and asking it to make it better. We use LLM-generated feedback explaining why outputs were right or wrong, giving the optimizer richer signal to refine future prompts. πŸ“ˆ Result: measurable gains in accuracy, zero retraining. Use it in Arize AX or the Prompt Learning SDK.

How Prompt Learning differs from DSPy GEPA: arize.com/blog/gepa-vs-prompt-learning-benchmarking-different-prompt-optimization-approaches
More about prompt learning: arize.com/blog/prompt-learning-using-english-feedback-to-optimize-llm-systems
Optimizing Claude.md: arize.com/blog/claude-md-best-practices-learned-from-optimizing-claude-code-with-prompt-learning
Optimizing .clinerules: arize.com/blog/optimizing-coding-agent-rules-claude-md-agents-md-clinerules-cursor-rules-for-improved-accuracy

All rulesets, code, and SDKs are open source:
πŸ”— Generated Claude Code rulesets: github.com/Arize-ai/prompt-learning/tree/main/coding_agent_rules_optimization/claude_code/act_rulesets/claude-sonnet-4-5-20250929
πŸ”— Claude Code optimization code: github.com/Arize-ai/prompt-learning/tree/main/coding_agent_rules_optimization/claude_code
πŸ”— Prompt Learning SDK: github.com/Arize-ai/prompt-learning/tree/main/optimizer_sdk
πŸ”— Run Prompt Learning in the Arize UI (no-code): arize.com/docs/ax/prompts/prompt-optimization/prompt-learning
Prompt Learning OverviewHow to Run LLM Evals on Live Production Traffic with your Agents | Ep. 11How to Set Up LLM Tracing in Minutes with OpenTelemetry | Ep. 3How TripAdvisor Debugs AI Agents at ScaleThe 5 Metrics That Actually Define Better AIFrom User Feedback to Code Pull Requests: The AI FlywheelHow to Evaluate Images with LLM-as-a-Judge | Multimodal Evals in Arize AXWhat Happens When AI Agents Review Each Other’s Code?5 LLM and Agent Eval Mistakes That Turn Metrics Into Noise | Ep. 8Kubernetes Is Not Your Sandbox: Building Infrastructure for AI Agents | Daytona | Arize Observe 2026AI Agent Mastery Certification Course: Module 5 – RAG & Agentic RAGAI’s Next Wave: What VCs Are Betting On in 2026 | Jaya Gupta | Arize Observe 2026
Arize AI |

Prompt Learning Overview

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER