Clear ×

Llm security

13 repositories found

ifixai-ai

ifixai-ai

iFixAi
Python Rising Star AI analysis

iFixAi is a specialized diagnostic tool that runs 45 automated inspections against AI agents and LLMs to detect operational misalignment—gaps between...

Production ready Beginner friendly Niche use case
agent-evaluation ai ai-alignment
1.3k
170
665/wk
active
8/10 AI & ML
usestrix

usestrix

strix
Python AI analysis

Strix is an open-source AI-powered penetration testing platform that autonomously identifies and validates vulnerabilities in applications through...

Production ready Niche use case
agents ai-hacking ai-penetration-testing
39.7k
4.1k
181
7.6k/wk +683 yesterday
active
8/10 Security
nolabs-ai

nolabs-ai

nono
Rust AI analysis

Nono is a zero-latency, zero-setup sandbox for running AI agents securely across macOS, Linux, and Windows. It enforces least-privilege isolation by...

Production ready Beginner friendly Niche use case
agent-sandbox agent-security ai-agent-sandbox
3k
204
141
56/wk
active
8/10 Security
Tencent

Tencent

AI-Infra-Guard
Python AI analysis

AI-Infra-Guard is a comprehensive red teaming platform by Tencent's Zhuque Lab designed to identify security vulnerabilities in AI systems through...

Production ready Niche use case
agent agent-security ai-infra
4.1k
394
18
54/wk
active
7/10 Security
NVIDIA

NVIDIA

garak
Python AI analysis

garak is an LLM vulnerability scanner that probes large language models for security weaknesses including hallucination, data leakage, prompt...

Production ready Niche use case
ai llm-evaluation llm-security
8.4k
1.1k
358
84/wk
active
8/10 Security
NVIDIA-NeMo

NVIDIA-NeMo

Guardrails
Python AI analysis

NeMo Guardrails is an open-source toolkit for adding programmable safety controls to LLM-based conversational applications, enabling developers to...

Production ready Niche use case
agents generative-ai guardrails
6.7k
757
171
61/wk
active
8/10 AI & ML
protectai

protectai

llm-guard
Python AI analysis

LLM Guard is a Python security toolkit for protecting Large Language Model interactions through input sanitization, harmful content detection, data...

Niche use case
adversarial-machine-learning chatgpt large-language-models
3.2k
418
40
23/wk
active
4/10 Security
beelzebub-labs

beelzebub-labs

beelzebub
Go AI analysis

Beelzebub is an open-source deception runtime framework that deploys LLM-powered decoy services across multiple protocols (SSH, HTTP, TCP, TELNET,...

Production ready Niche use case
acis agentic-ai-security cloudnative
2.1k
201
5
8/wk
active
8/10 Security
Giskard-AI

Giskard-AI

giskard-oss
Python AI analysis

Giskard is an open-source Python library for testing, evaluating, and red-teaming agentic AI systems. It specializes in dynamic multi-turn agent...

Production ready Niche use case
agent-evaluation ai-red-team ai-security
5.5k
484
71
19/wk
active
8/10 AI & ML
OWASP

OWASP

www-project-top-10-for-large-language-model-applications
Python AI analysis

The OWASP Top 10 for Large Language Model Applications is a security awareness framework that identifies and documents the ten most critical security...

Beginner friendly Niche use case
ai appsec llm
1.3k
332
75
7/wk
slow
7/10 Security
cyberark

cyberark

FuzzyAI
Jupyter Notebook AI analysis

FuzzyAI is a specialized security testing tool for identifying jailbreaks and vulnerabilities in LLM APIs through automated fuzzing. It targets...

Production ready Niche use case
ai ai-red-team fuzzing
1.5k
210
6
8/wk
slow
7/10 Security
msoedov

msoedov

agentic_security
Python AI analysis

Agentic Security is a specialized vulnerability scanner for LLM-based agent systems and large language models, designed to identify jailbreaks,...

Production ready Single maintainer Niche use case
agent-framework agent-security ai-red-team
1.9k
266
70
recent
7/10 Security
pathwaycom

pathwaycom

llm-app
Jupyter Notebook AI analysis

Pathway LLM App provides ready-to-deploy cloud templates for building RAG pipelines, AI enterprise search, and LLM-powered chatbots that stay...

Production ready Beginner friendly
chatbot hugging-face llm
59.1k
1.4k
10
active
8/10 AI & ML