AI Atlasby Verbito
Explore › Build with AI

Test, monitor & secure AI

Test, monitor and secure AI apps. Every tool here is free and open source.

Free alternative to LangSmith, Arize, Weights & Biases, Lakera

182 tools

  1. Monitor your servers and apps with AI-powered alerts
    ★ 81.3kstars
    netdata by netdata
    Some setupSelf-hosted appHealthy
  2. Find security holes in your app with AI hackers
    ★ 73.6kstars
    strix by usestrix
    Some setupCommand-line toolHealthy
  3. Have an AI agent audit your code for security issues
    ★ 58.3kstars
    security-audit-skill by cloudflare
    Some setupAdd-on for Claude CodeFair
  4. Audit AI agents to check they can be trusted
    ★ 43.2kstars
    iFixAi by ifixai-ai
    Some setupCommand-line toolHealthy
  5. See and improve what your AI app is doing
    ★ 37kstars
    langfuse by langfuse · Free alternative to LangSmith
    Some setupSelf-hosted appHealthy
  6. Give AI agents expert cybersecurity skills
    ★ 35.5kstars
    Anthropic-Cybersecurity-Skills by mukul975
    Some setupAdd-on for Claude CodeFair
  7. Run automated penetration tests with AI agents
    ★ 33.2kstars
    pentagi by vxcontrol
    Some setupSelf-hosted appHealthy
  8. Control access to servers securely, with AI assistance
    ★ 31.9kstars
    jumpserver by jumpserver
    Some setupSelf-hosted appHealthy
  9. Find passwords and API keys accidentally left in code
    ★ 30.7kstars
    gitleaks by gitleaks
    Some setupCommand-line toolHealthy
  10. Keep passwords and API keys safe for apps and agents
    ★ 30.3kstars
    infisical by Infisical
    Some setupSelf-hosted appHealthy
  11. Track, evaluate and manage AI models and agents
    ★ 28.7kstars
    mlflow by mlflow
    Some setupSelf-hosted appHealthy
  12. Test your prompts and find security flaws in AI apps
    ★ 26.8kstars
    promptfoo by promptfoo · Free alternative to PromptLayer, LangSmith
    Some setupCommand-line toolHealthy
  13. Scan AI agent skills for security risks
    ★ 24.2kstars
    SkillSpector by NVIDIA
    Some setupCommand-line toolHealthy
  14. Debug and evaluate your AI app
    ★ 23.2kstars
    opik by comet-ml · Free alternative to Weights & Biases Weave
    Some setupSelf-hosted appHealthy
  15. Generate API tests automatically from real traffic
    ★ 19.3kstars
    keploy by keploy
    Some setupCommand-line toolHealthy
  16. Test the quality of your AI app's answers
    ★ 19.3kstars
    deepeval by confident-ai · Free alternative to LangSmith evaluations
    For developersCode libraryHealthy
  17. Run AI-assisted penetration testing
    ★ 16.3kstars
    PentestGPT by GreyDGL
    Some setupCommand-line toolHealthy
  18. Measure how well your AI app answers
    ★ 16.2kstars
    ragas by vibrantlabsai
    For developersCode libraryFair
  19. Monitor and evaluate AI agents
    ★ 16.2kstars
    RagaAI-Catalyst by raga-ai-hub
    For developersCode libraryFair
  20. Manage logins and permissions for apps and AI agents
    ★ 14.8kstars
    casdoor by casdoor
    Some setupSelf-hosted appHealthy
  21. Benchmark AI language models
    ★ 14.4kstars
    lm-evaluation-harness by EleutherAI
    For developersCode libraryHealthy
  22. Remove Copilot and Recall from Windows 11
    ★ 13.6kstars
    RemoveWindowsAI by zoicware
    Some setupCommand-line toolHealthy
  23. Monitor systems and get alerts, with an AI assistant
    ★ 13.4kstars
    nightingale by ccfos
    Some setupSelf-hosted appHealthy
  24. Let AI agents run security tools for authorized testing
    ★ 13.3kstars
    hexstrike-ai by 0x4m4
    Some setupSelf-hosted appHealthy
  25. Keep your build and deploy pipelines reliable with AI
    ★ 12.7kstars
    opensre by Tracer-Cloud
    Some setupCommand-line toolHealthy
  26. Trace and evaluate your AI app
    ★ 12.1kstars
    phoenix by Arize-ai · Free alternative to Arize, LangSmith
    Some setupSelf-hosted appHealthy
  27. Run, observe and improve your AI app in one platform
    ★ 11.7kstars
    tensorzero by tensorzero
    Some setupSelf-hosted appUse with careArchived
  28. Find and hide personal data in text and images
    ★ 11.7kstars
    presidio by data-privacy-stack
    For developersCode libraryHealthy
  29. Track experiments and models while training AI
    ★ 11.3kstars
    wandb by wandb
    For developersCode libraryHealthy
  30. Find and fix security flaws with OpenAI's Codex Security
    ★ 11.3kstars
    codex-security by openai
    Some setupCommand-line toolHealthy
  31. Scan AI chatbots for security weaknesses
    ★ 9.8kstars
    garak by NVIDIA · Free alternative to Lakera Red
    Some setupCommand-line toolHealthy
  32. Monitor uptime and run a status page
    ★ 9.2kstars
    openstatus by openstatusHQ
    Some setupSelf-hosted appHealthy
  33. Find open-source security tools, including for AI agents
    ★ 9.2kstars
    Scanners-Box by We5ter
    No codingGuide or readingFair
  34. Run untrusted AI-generated code in fast, safe micro-VMs
    ★ 8.9kstars
    microsandbox by superradcompany
    For developersCode libraryHealthy
  35. Run AI-driven security testing
    ★ 8.4kstars
    CyberStrikeAI by AIPentest
    Some setupSelf-hosted appHealthy
  36. Find and explain Kubernetes problems with AI
    ★ 8.3kstars
    k8sgpt by k8sgpt-ai
    Some setupCommand-line toolHealthy
  37. Monitor and test AI models
    ★ 8kstars
    evidently by evidentlyai
    For developersCode libraryHealthy
  38. Monitor apps and find root causes with AI
    ★ 8kstars
    coroot by coroot
    Some setupSelf-hosted appHealthy
  39. Give AI agents professional security-audit skills
    ★ 8kstars
    skills by trailofbits
    Some setupAdd-onFair
  40. Monitor and enforce rules on AI agents
    ★ 7.8kstars
    failproofai by FailproofAI
    Some setupSelf-hosted appFair

Showing 40 of 182. Search or open the full list for more.