Video · Source Linked
MCP Apps: Extending the Frontier — Ido Salomon & Liad YosefMCP Apps let servers return sandboxed, interactive UI instead of text alone while the host retains control of prompts and tool calls—a useful pattern for agent workflows needing charts or controls.FEED7 SUMMARY
Video · Source Linked
MCP Tasks (async): Why Aren't Any Agents Supporting Them? — Cornelia Davis, TemporalMCP Tasks aim to make long-running tool calls durable across disconnects and crashes. The proposed V2 removes session-heavy state, but polling scale and implementation complexity remain unresolved.FEED7 SUMMARY
Video · Source Linked
When Will The Benchmaxxing Plague End? — Nick Heiner, Surge AINick Heiner argues that leaderboard gains can diverge from useful agent behavior through contamination, weak verifiers, reward hacking, and test conditions that users cannot inspect.FEED7 SUMMARY
benchmark#benchmark-integrity
Video · Source Linked
Teaching AI to Find Real Vulnerabilities — Prof. David Brumley, BugcrowdCybersecurity agents need deterministic exploit oracles and tasks that reward finding distinct vulnerabilities, not self-reported wins or one crash. A capability ladder makes partial progress measurable.FEED7 SUMMARY
Video · Source Linked
Rethinking Environments for Long-Horizon Work — Rayan Garg, Theta SoftwareHuman task duration is a weak proxy for agent difficulty when agents use different shortcuts and tools. Long-horizon evals need environment complexity, queryable trajectories, and judges that inspect final state.FEED7 SUMMARY
Video · Source Linked
What's Next After RLHF? — Diogo Almeida, TypeSafe AIRLHF can make agents persuasive assistants without making them dependable autonomous decision-makers. Builders should separate human-pleasing interaction from calibrated automation and keep stakes bounded.FEED7 SUMMARY
model#reasoning
Video · Source Linked
Data Quality Is the Compute Multiplier — Ari Morcos, DatologyAITraining-data curation can improve model quality and inference efficiency without simply adding compute. The practical work is decontamination, deduplication, balancing, task matching, and selective synthesis.FEED7 SUMMARY
model#model-selection
Video · Source Linked
Learning on the Job: The Future of Post-Training — Raymond Feng, Applied ComputeTraining on a production harness could adapt an agent to real workflows, but non-replayable interactions break common RL assumptions and make feedback harder to turn into updates.FEED7 SUMMARY
agent#harness-engineering
Video · Source Linked
Data and Environment Curation for Post-Training LLMs — Mahesh Sathiamoorthy, Bespoke LabsPost-training gains depend heavily on task selection, rollout quality, and environment design. For many enterprise agents, curated SFT may deliver most of the value before costly RL.FEED7 SUMMARY
agent#harness-engineering
Video · Source Linked
Scaling to Long Horizons — Ross Taylor & Chengxi Taylor, General ReasoningLong-running agents strain context, reward design, and GPU scheduling at once. Compaction and value models can help, but each introduces another optimization trade-off.FEED7 SUMMARY
agent#harness-engineering
Video · Source Linked
Emulated: The Data for Fully Autonomous Software Engineers and Companies — Joseph WangRepo-only tasks omit deployments, incidents, traffic, and distributed failures. Training infrastructure agents may require multi-node environments with real resources, despite much higher setup cost.FEED7 SUMMARY
Video · Source Linked
The Base Model Is Dead — Varun Singh, Arcee AIBase-model data is shifting from broad web imitation toward code, reasoning, and agent-task priors. The unresolved choice is how early to introduce synthetic and instruction-shaped data.FEED7 SUMMARY
model#reasoning
Video · Source Linked
Verifiable Environments for AI in Biology — Kenny Workman, LatchBioBiology agents need evaluators that verify analysis of large experimental datasets, not recall. LatchBio found human review essential because valid scientific paths can defeat brittle graders.FEED7 SUMMARY
Video · Source Linked
Ending AI Slop — Thais Castello Branco, Taste LabsFor subjective agent output, replace vague requests for quality with decomposed brand constraints, then reserve human preference data for style and creativity that resist deterministic checks.FEED7 SUMMARY
Video · Source Linked
Benchmarks: The Good, the Bad, and the Ugly — Ali Khial, G2iCoding benchmark scores can mislead when prompts leak implementation details or tests reject valid solutions. Inspect tasks and verifiers before using a leaderboard to choose an agent.FEED7 SUMMARY
benchmark#benchmark-integrity