Agent reliability

In LangChain, binding tools with a forced tool choice while extended thinking was enabled produced a request the Anthropic API rejected. The agent did not degrade; it failed with a 400 that pointed at the model rather than at the binding layer. The fix is merged.

In Microsoft Semantic Kernel, the chat-history truncation reducer removed the system prompt along with old turns once a conversation grew past its window. The agent kept answering, without the instructions it was built around. Nothing in the transcript recorded that the constraint had gone. The fix is merged.

In Semantic Kernel’s .NET schema handling, an existing null type could be duplicated because the check used reference equality. In DSPy, an empty evaluation dataset reached a division by zero instead of explaining the invalid input. Both fixes include regression tests in the merged upstream patches.

lintlang reads agent configuration statically. There is no model call in its analysis path, so its findings are reproducible and cost nothing to run on every commit.

H1.6 adds pairwise differentia analysis: it compares tool descriptions within one parsed input and reports when one or both lack distinguishing wording.

LintLang 0.6.0 includes deterministic SARIF 2.1.0 output and a GitHub Action path for GitHub Code Scanning, so findings can be uploaded for code review.

It reports deterministic findings separately from heuristic ones, which matters because the two carry different weight in a review. A deterministic finding is a fact about the file. A heuristic finding is a suggestion that a human still has to judge.

agent-gorgon observes file, network, and subprocess activity while an agent session runs, scores it against policy, and writes forensic records of what happened. The decisions it makes are deterministic, so the same observed behavior produces the same verdict.

The point is not prevention. It is that after an incident there is a record to read, instead of an argument about what the agent probably did.

little-canary uses a powerless sacrificial-model probe to make prompt injection observable before the primary model is allowed to act. Behavioral Canarying represents routing disposition separately from inspection coverage, so a route decision cannot be mistaken for evidence that inspection actually ran.

hermes-jailbench covers the adjacent question: whether a known attack pattern that used to fail against your endpoint still fails. It scores without an LLM in the scoring path, so a regression run is repeatable.

Silent Instruction Relaxation — an instruction quietly deprioritized when two cannot both be satisfied — is one of seven modes named in the taxonomy paper, derived from 1,461 controlled experiments conducted primarily on GPT-4o.

The Semantic Kernel defect produced the same operational failure shape — an instruction ceased to bind behavior without an adequate runtime signal — but by a different mechanism: the framework removed the instruction before generation.