Generative Media
Current Answer
No editorial synthesis yet — the evidence below is collected automatically from source labels. A current answer lands here once an editor approves one.
Evidence
MiniMax H3 brings short 2K video generation to Vercel AI Gateway, with text, keyframe, and multimodal reference inputs. Reference and keyframe modes cannot be combined.
Grok Voice Think Fast 2.0 brings speech-to-speech reasoning and earlier tool calls to Vercel’s realtime API, with server-minted tokens keeping gateway keys off clients.
ModernMOE applies efficient expert-routing patterns from LLMs to diffusion transformers, improving convergence and quality-cost balance without relying only on larger parameter counts.
Video evaluators can reward polish while missing frozen action, broken physics, or failed storytelling. Builders need time-aware criteria and human-calibrated data, not frame quality alone.
Uber’s image-editing agent uses routing, iterative QA, golden-set gates, and production feedback to avoid costly edits, hallucinated food, and quality regressions.
MedGame turns static clinical cases into executable decision stories with separate narrative and orchestration stages, a useful architecture pattern for case-grounded learning agents.
A frozen diffusion language model can transcribe speech by refining the full transcript in parallel. The prototype trains a small audio interface and reaches 6.6% WER in roughly eight steps.
Seedream 5.0 Pro adds image generation and editing to Vercel AI Gateway, targeting reliable text rendering and dense infographic layouts through the AI SDK.
E-VQA requires video answers to include tracked pixel-level evidence, revealing when good QA scores hide weak perception and supplying grounded training data.
SearchGen-Bench shows open image generators score 21–28/100 on long-tail entities, and naive search retrieval only adds noise; a teach-then-search co-training recipe learns when to retrieve versus rely on weights.
Meta's Tech Podcast covers AssetGen, its foundation model for generating 3D assets from text, and the path toward AI-generated worlds in Horizon Studio. A podcast episode, so light on specifics.
Two new Gemini API models: Nano Banana 2 Lite generates 1K images in ~4s at $0.034 each, and Omni Flash does video at $0.10/sec in public preview — cheap enough to wire asset generation into agent pipelines.
IAAN boosts selected audio-encoder neurons at inference, improving fine-grained speech perception across three models without retraining or labels.
Google's June roundup: Gemma 4 12B runs locally in 16GB of memory, Gemini 3.5 Flash adds computer use for desktop, mobile, and browser agents, and Nano Banana 2 Lite ships as a cheaper image model.