Sign InOpen Brain
arXivPaperNeeds Review

SENTINEL-RL: Offloading Topological Reasoning from LLM Agents in the Security Operations Center

Sentinel-RL keeps topology outside the LLM: a graph encoder and constrained policy choose SOC actions, while the model writes critic-gated narratives for human approval.

arXiv · Sep 3, 2026
Open Source Open MarkdownOpen JSON
Source Summary

Sentinel-RL compresses an authentication graph with a graph-attention encoder, maps that state to constrained actions using PPO, and limits the LLM to recommendations and analyst-readable narratives. Its full human-approved loop had a **6.3 s median** runtime.

Practical Implication

For security agents operating over large structured state, keep graph validity and action choice in deterministic or constrained components. Use the LLM at the semantic boundary, then place a critic and explicit approval before containment.

Agent-Ready Context
Sentinel-RL compresses an authentication graph with a graph-attention encoder, maps that state to constrained actions using PPO, and limits the LLM to recommendations and analyst-readable narratives. Its full human-approved loop had a **6.3 s median** runtime.

For security agents operating over large structured state, keep graph validity and action choice in deterministic or constrained components. Use the LLM at the semantic boundary, then place a critic and explicit approval before containment.

The reported results come from the **LANL dataset** and Indiana University’s Quartz cluster. Precision of **0.91** and recall of **0.87** were measured on labeled red-team events, not a broad production SOC deployment.
Connected Context · Feed7 Judgment

This supplies a concrete security-domain implementation of the broader pattern that LLMs should interpret and explain while constrained components manage structured state and consequential actions. It adds graph compression, PPO action selection, a critic, and human approval, with encouraging measured results and latency, but narrows the evidence to labeled red-team events on LANL data rather than establishing production SOC reliability.

Semantic Blindness: 500,000 Sensors Confused an LLM - Raahul Singh & Vanč Levstik, PhaidraBoth move large structured-state resolution outside the LLM; Sentinel-RL extends that separation from entity lookup to graph encoding and constrained action selection.From coding to Knowledge work agents — Karan Vaidya, ComposioSentinel-RL implements the candidate’s externalized safety pattern with constrained actions, critic review, and explicit human approval before containment.How Kepler Built Verifiable AI for Financial Services — Vinoo GaneshBoth reserve semantic choices or narratives for the LLM while specialized components preserve domain validity; Sentinel-RL applies that boundary to authentication graphs and security actions rather than financial calculations.In Code They Act, In Proof We Trust — Erik Meijer, Leibniz LabsBoth separate LLM recommendations from side-effect execution, but Sentinel-RL uses learned constrained control plus critic and human approval rather than requiring machine-checkable proofs.
Context Map
agentsecuritydata#harness-engineering#tool-use#agent-reliability
Uncertainty
The reported results come from the **LANL dataset** and Indiana University’s Quartz cluster. Precision of **0.91** and recall of **0.87** were measured on labeled red-team events, not a broad production SOC deployment.