ChatGPT
— AI assistant for answers, writing, images, work, and codeAI assistant for answers, writing, images, work, and code
Promptfoo
Open-source CLI for testing prompts and LLM apps, plus red teaming for security vulnerabilities
Product badge
Share this product's name and rating in your README or on your website.
Updates may be delayed by image caching.
About Promptfoo
Promptfoo is an open-source tool for evaluating and red-teaming LLM applications.
What it does
- Define test cases and assertions in config, then compare prompts and models side by side
- Run evals locally or in CI to catch regressions
- Automated red teaming for prompt injection, jailbreaks, data leakage, and more
- Works with most model providers and custom app endpoints
Favored by developers who want evals that live in the repo next to their code.
No reviews yet
Used it? Write the first review.
Similar tools
Claude
— AI assistant for research, coding, writing, and everyday workAI assistant for research, coding, writing, and everyday work
Cursor
— AI coding agent for building softwareAI coding agent for building software
Claude Code
— An AI coding agent for terminal, IDE, web, and SlackAn AI coding agent for terminal, IDE, web, and Slack
GitHub Copilot
— AI coding assistance across editors, GitHub, and the CLIAI coding assistance across editors, GitHub, and the CLI
Grok
— AI assistant for chat, image creation, coding, and web answersAI assistant for chat, image creation, coding, and web answers