Skip to content
Tools · Open-source assurance stackApache 2.0 · github.com/hermes-labs-ai

The assurance stack, in working code.

Eighteen tools across audit, runtime, and evidence. Built from real failure investigations, used in live engagements. No subscriptions, no opt-in telemetry, no free-tier games. The engineering is integrating them into infrastructure you depend on — pay us for that.

Tool
Purpose
Install · Source
§ Audit & Linting06 tools
lintlang
Static linter for AI agent configs, tool descriptions, and system prompts. Zero LLM calls. Runs in CI.
pip install lintlang
github →
rule-audit
Static prompt audit CLI — contradictions, coverage gaps, priority ambiguities.
pip install rule-audit
github →
intent-verify
Repo intent verification and spec-drift checks against declared scope.
pip install intent-verify
github →
repo-audit
Fifteen-second launch-readiness punch-list for any public GitHub repo.
pip install repo-audit
github →
colony-probe
Defensive prompt-confidentiality audit via multi-turn probing.
pip install colony-probe
github →
scaffold-lint
Static linter for LLM prompt scaffolds.
pip install scaffold-lint
github →
§ Runtime03 tools
little-canary
Prompt-injection detection via sacrificial canary-model probes. The vulnerability is the signal.
pip install little-canary
github →
suy-sideguy
Runtime policy guard for autonomous agents — process, file, and network enforcement with forensic reports.
pip install suy-sideguy
github →
forgetted
Mid-conversation incognito mode — checkpoint, block writes, self-clean on exit.
pip install forgetted
github →
§ Memory & Routing02 tools
zer0dex
Dual-layer memory for AI agents — compressed index plus vector retrieval.
pip install zer0dex
github →
claude-router
Routes prompts to the right Claude tier via local embeddings.
pip install claude-router
github →
§ Evaluation02 tools
hermes-jailbench
Jailbreak regression benchmark for LLM endpoints.
pip install hermes-jailbench
github →
agent-convergence-scorer
Scores similarity across N agent outputs for the same task.
pip install agent-convergence-scorer
github →
§ Data quality & CI gates04 tools
quick-gate-js
JavaScript / TypeScript CI quality gate with bounded auto-repair.
npm install quick-gate
github →
quick-gate-python
Python CI quality gate: Ruff, Pyright, pytest.
pip install quick-gate-python
github →
csv-quality-gate
CSV preflight validation for pipeline inputs.
pip install csv-quality-gate
github →
zer0lint
Memory-extraction diagnostics for mem0 configs.
pip install zer0lint
github →
§ Research01 tool
langquant
LPCI reference implementation — stateless LLM via refreshing language scaffold.
pip install langquant
github →

18 tools total · Apache 2.0 · Full catalog on GitHub