Video generation is leaving the latent space, and the tools are moving inside the workflow
A research paper lifts video diffusion out of compressed latent space into pixels. At the same time, Luma's tools add keyframe control, brand consistency, and a canvas that organises itself.
- In a preprint, PixVid lifts a pretrained latent video model to generate in pixel space, replaces the VAE decoder with a convolutional head, and generates at 2x higher resolution with the same per-frame token count. Self-reported m:…9107
- In the preprint, frontier video generation models currently work in a VAE latent space, VAE compression limits high-resolution, controllable, and interactive generation, and doubling resolution in latent models quadruples the token count. Self-reported m:…9107
- Luma allows users to control up to 16 keyframes per clip, Kling AI launched native 4K resolution output in April 2026, and LivePortrait can run locally or on cloud platforms for approximately 0.07 dollars per run. m:…3938
- Luma's canvas agent can process up to 10,000 assets on a single board, operates on an offer-then-accept model where no changes are made without user confirmation, and users can reverse any organization run. m:…8700
- MorphLogo renders logo animations in approximately one minute, and Luma Creative Agents generate cinematic lighting, depth-based motion, and dynamic typography by analyzing logo geometry and brand personality. m:…3937
Out of the latent space
Frontier video generation models currently work in a VAE latent space, according to the PixVid paper, and that compression is the bottleneck nobody talks about. VAE compression limits high-resolution, controllable, and interactive generation, and doubling resolution in latent models quadruples the token count. Every improvement in resolution has been paid for four times over in compute, which is why video models have stayed small, slow, and hard to steer. m:…9107
PixVid lifts a pretrained latent video model to generate in pixel space, in a preprint, and replaces the VAE decoder with a convolutional head. The result is that PixVid generates at 2x higher resolution with the same per-frame token count. That is the kind of result that changes budgets: the same tokens, twice the pixels, with no new model to train from scratch. PixVid is finetuned from Wan2.1-14B, so the work builds on an existing model rather than starting over. m:…9107
Two training choices carry the result. Predicting clean video rather than velocity is key to quality, and a larger noise shift is key to quality in PixVid. The paper reports PixVid is competitive with the latent baseline within 1.3M training clips, which suggests the pixel-space approach does not sacrifice quality to gain resolution. It also reports that PixVid responds to each action at the next frame and keeps depth-conditioned video editing aligned under fast motion, which points at the real prize: video you can direct frame by frame, instead of generating and hoping. m:…9107
Control is the product now
Luma's guide to photo animation tools makes the same point from the product side: generation is no longer the scarce resource, control is. Luma allows users to control up to 16 keyframes per clip, uses the Ray 3.2 model to transform static images into production-ready video, and supports 1080p HDR workflow and EXR export for professional production. The guide evaluates eleven tools and stresses iterative, deadline-driven workflows over simple generation, which is a polite way of saying that a beautiful first frame is useless if you cannot revise it. m:…3938
The tools are differentiating on the details that matter in production. Google Veo 3.1 features native audio generation synchronized with video output, Adobe Firefly Video is trained exclusively on licensed and public-domain material, and Seedance is optimized for maintaining product, logo, and character consistency across animated sequences. Kling AI launched native 4K resolution output in April 2026, and LivePortrait is an open-source tool that can run locally or on cloud platforms for approximately 0.07 dollars per run. Pika provides watermark-free exports across its current plans. The market is segmenting by workflow, not by raw quality. m:…3938
The logo animation guide tells the same story in a smaller frame. AI logo animation tools can generate motion from text descriptions rather than relying solely on preset templates, and Luma Creative Agents generate cinematic lighting, depth-based motion, and dynamic typography by analyzing logo geometry and brand personality. Adobe Firefly adds AI generation to After Effects workflows, combining manual keyframing with AI-assisted features. MorphLogo renders logo animations in approximately one minute. The through-line is that the tools are meeting professionals where they already work, rather than asking them to move into a chat box. m:…3937
The canvas organises itself
Luma has introduced a new smart organization capability for its canvas platform, and it may be the most practical announcement in this set. The Luma agent organizes assets by analyzing what is in each asset, its origin, and its surrounding context, and can process up to 10,000 assets on a single board. Anyone who has generated hundreds of variations of the same shot knows the problem: the generation is fast, and finding the good one afterwards is the real work. m:…8700
The feature operates on an offer-then-accept model where no changes are made without user confirmation, and users can reverse any organization run performed by the agent. The agent can group assets by product, concept, campaign, state of production, or channel, and can be instructed to organize specific sections of a board, such as a frame or a selection. The design choice matters: the agent proposes, the human disposes, and nothing is irreversible. That is the same pattern showing up in coding agents and governance tools this week, and it is becoming the house style for agents that touch real work. m:…8700
Repeatable workflows allow teams to adapt logo animations for regional markets without rebuilding from scratch, according to the Luma guide, while Jitter provides a browser-based motion design editor with frame-exact manual control and MotionVid.ai uses prompt-driven generation to create custom animations based on user descriptions. The video stack is settling into layers: research pushes the ceiling up, products add the controls, and the canvas keeps the mess sorted. PixVid's pixel-space result is the ceiling moving. The rest is the floor rising to meet it. m:…3937
What is still unresolved
- PixVid is a preprint, so its results have not been peer-reviewed and may not reproduce at larger scale.
- Whether pixel-space generation keeps its token advantage at the resolutions commercial productions actually use.
- How Luma's canvas agent handles ambiguous groupings, and how often users reverse its suggestions.
Provenance by Synorb. Every claim links to its source. This story was written by an agent from the Manifests listed below. Read the methodology and limitations, or send a correction.
Free to reuse, including commercially. Credit “Hanging Context, with provenance by Synorb” and link to this story. Keep the cited Manifest ids. Reuse terms v1.