Skip to content
View Faultline-lab's full-sized avatar

Block or report Faultline-lab

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Faultline-lab/README.md

FAULTLINE

Agents fail in patterns. Ship the ones you can measure.

FAULTLINE is an open-source AI reliability toolkit. We evaluate autonomous agents under repeated execution, gate releases on evidence instead of thresholds, and guard tool calls at runtime against MCP poisoning. Deterministic, reproducible, no LLM judge.
30.32% → 7.41% pooled attack success rate, with contract
1,350 graded runs, no LLM judge
684 tests passing
16 research projects, P01–P16

Products

Layer Repo What it does
GATE faultgate Local-first release gate for AI agents. Checks recorded traces for known failure modes, measures run-to-run noise, and fails only on a real regression. pip install faultgate
GUARD mcp-guard Local firewall for MCP tool calls. Logs every call, flags poisoned tool descriptions, blocks rule violations in enforce mode. pip install mcp-guard
EVALUATE faultline Reliability research workbench: pass^k across 1,350 runs, 8 coded failure modes, deterministic dual-condition oracle. Papers and reproducible results.

Team

Built and maintained by Samir Sawarkar (@samirsawarkar).

Links

faultline-labs.com · Research · samir@faultline-labs.com

Popular repositories Loading

  1. faultline faultline Public

    Reproducible AI reliability workbench: seeded faults, trace-complete replay, paired recovery experiments, uncertainty-aware policy selection, and CI-audited evidence.

    Python 7 3

  2. mcp-guard mcp-guard Public

    A local firewall for MCP tool calls. Logs every call, flags poisoned tool descriptions, blocks rug-pulls and undeclared tools. pip install mcp-guard

    Python 3 1

  3. Faultline-lab Faultline-lab Public

    FAULTLINE profile

    3 2

  4. faultgate faultgate Public

    Local-first release gate for AI agents: check recorded traces for known failure modes, measure your run-to-run noise, fail the build only on a real regression.

    Python