New Security Researchers Join 10.8K+ verified researchers — submit your profile for review Submit profile →
SecurityCipher
Home Blog Labs Checklists Writeups

Learn Roadmaps, courses & vulnerability guides

  • 🗺️ Penetration Testing Roadmap Structured offensive security path
  • 🎓 Free Security Courses Verified courses and coupon drops
  • 🎯 Penetration Testing Tricks Field notes & real bypasses
  • 📄 Secure Code Explain Vulnerable vs secure code comparison
  • 📖 Vulnerability Explain Root causes, PoCs, and remediation
  • 🚀 Start Here Beginner walkthrough of all resources

Practice Hands-on browser labs, games & SOC simulator

  • 🔬 Interactive Labs SQL injection, AI, AWS cloud review
  • 🎮 Security Games Phishing, JWT, WAF, and more
  • 🛡️ Shift Zero SOC desk: phish, OTP, malware, tickets
  • 🚗 On-Call Drive Neon-city arcade security missions
  • ❓ Application Security Quiz Web, secure coding, and cloud quizzes
  • ⚡ Threat Explorer Interactive AI & vuln attack flows

Checklists & Tools 1,760+ testing controls, utilities & standards

  • ✅ Security Checklists Hub Web, cloud, mobile, API, and infra
  • 🛠️ Security Tools Curated recon, SAST, and bounty tools
  • 📋 Writeup Checklists Methodologies derived from real writeups
  • 🤖 OWASP LLM Top 10 Interactive risk matrix for AI apps
  • 🔎 CVE Lookup Multi-source CVE search & threat intel
  • 📘 Payload Field Manual Safe-first probes, signals, and cheats

Career & Community Live scopes, verified researchers & jobs

  • 💰 Bug Bounty Programs Searchable directory of active scopes
  • 💼 Cybersecurity Jobs Verified roles from company career sites
  • 🧑‍💻 Security Researchers Community profiles and submissions
  • 🎤 Security Conferences Upcoming global infosec events
  • 🧮 CVSS Severity Calculator Accurate CVSS 3.1 & 4.0 calculator
  • 🧭 Career Roadmaps AppSec, Cloud, and SOC career paths
Browse All Resources 1,760+ Checklists • 18K+ Writeups • 15+ Interactive Labs Freelance Security →
About
Freelance SecurityFreelance
← Security Tools View on GitHub

promptfoo

CI-first tool to test and red-team LLM apps using declarative YAML, with 50+ attack plugins mapped to OWASP LLM Top 10 and NIST AI RMF.

Promptfoo: LLM evals & red teaming

npm npm GitHub Workflow Status MIT license Discord

promptfoo is a CLI and library for evaluating and red-teaming LLM-based apps. Stop using trial-and-error... start shipping secure, reliable agents

Website · Getting Started · Red Teaming · Documentation · Discord

Promptfoo is now part of OpenAI. Promptfoo remains open source and MIT licensed. Read the company update.

Quick Start

npm install -g promptfoo
promptfoo init --example getting-started

Also available via brew install promptfoo and pip install promptfoo. Or use npx promptfoo@latest to run any command without installing.

Most LLM providers require an API key. Set yours as an environment variable:

export OPENAI_API_KEY=sk-abc123

Run an eval and view results:

cd getting-started
promptfoo eval
promptfoo view

See Getting Started (evals) or Red Teaming (vulnerability scanning) for more!

What can you do with Promptfoo?

  • Test your prompts and models with automated evaluations
  • Secure your LLM apps with red teaming and vulnerability scanning
  • Compare models side-by-side (OpenAI, Anthropic, Azure, Bedrock, Ollama, and more)
  • Automate checks in CI/CD
  • Review pull requests for LLM-related security and compliance issues with code scanning
  • Share results with your team

Here's what it looks like in action:

prompt evaluation matrix - web viewer

It works on the command line too:

promptfoo command line

It also can generate security vulnerability reports:

gen ai red team

Why Promptfoo?

  • Developer-first: Fast, with features like live reload and caching
  • Private: LLM evals run 100% locally - your prompts never leave your machine
  • Flexible: Works with any LLM API or programming language
  • Battle-tested: Powers LLM apps serving 10M+ users in production
  • Data-driven: Make decisions based on metrics, not gut feel
  • Open source: MIT licensed, with an active community

Learn More

  • Getting Started
  • Full Documentation
  • Red Teaming Guide
  • CLI Usage
  • Node.js Package
  • Supported Models
  • Code Scanning Guide

Contributing

We welcome contributions! Check out our contributing guide to get started.

Join our Discord community for help and discussion.

promptfoo
Press Escape to close the search panel.

Donate

Buy me a Coffee

Penetration Testing Services

penetration Testing Services

Web Application Security Quiz

Web Application Security Quiz

Daily Bug Bounty Writeups - Twitter

Daily Bug Bounty Writeups

Download our Latest Android Application

Guide for Penetration Testing

Daily Bug Bounty Writeups - Telegram

Daily Bug Bounty Writeups

Author

Piyush
Senior Product Security Engineer

Ethical Hacker || Penetration Tester || Gamer || Blogger || Product Security Engineer || AI Security

READ ARTICLE

Donate

Buy me a Coffee

Recent Posts

  • Inside Java2Shell (CVE-2026-114938)
    Inside Java2Shell (CVE-2026-114938)
    November 18, 2026/
    0 Comments
  • Why GTA 5 Was a Hacker’s Playground — And The Exact Security Architecture GTA 6 Needs
    Why GTA 5 Was a Hacker’s Playground — And The Exact Security Architecture GTA 6 Needs
    November 18, 2026/
    0 Comments
  • Securing the AI Supply Chain: A Hands-On AI-BOM Playbook for Pickle RCE, Poisoned Datasets, and CI Gates
    Securing the AI Supply Chain: A Hands-On AI-BOM Playbook for Pickle RCE, Poisoned Datasets, and CI Gates
    November 17, 2026/
    0 Comments

Follow Us

SECURITY DISPATCH

Subscribe to SecurityCipher

Get the latest bug bounty writeups, offensive security tooling, and zero-day analyses delivered to your inbox.

Subscription Form

SecurityCipher

Practical security guides, vulnerability deep-dives, and hands-on resources for bug bounty hunters and penetration testers.

Useful Links

  • Security Checklists
  • Cybersecurity Jobs
  • Blogs
  • Docs
  • About
  • Contact

Free Resources

  • Interactive Security Labs
  • Security Tools Directory
  • Pentest Roadmap
  • OWASP LLM Top 10
  • Bug Bounty Writeups
  • Bug Bounty Programs
© 2026 Security Cipher. All rights reserved. Privacy Policy · Terms & Conditions · DMCA ·
PRIVACY & DATA CONTROLS

Privacy & Cookie Preferences

We use essential cookies to maintain secure sessions and analyze anonymized telemetry to optimize our research and interactive labs.

Manage anytime via our Privacy Policy or footer settings.

Security Researchers
Security Researchers
OPEN DIRECTORY Verified Network

Are you a security researcher or bug hunter?

Join our open directory of verified pentesters, showcase your achievements, and get recognized!

Submit Researcher Profile →