The latest AI news and updates of HeyGen — AI video generation platform specializing in AI avatars, digital twins, and video creation workflows for professionals and marketers. Covering HeyGen's latest product updates, launches, and research from the past 90 days.
HeyGenJul 23HeyGen updated its Video Translation API to support batch processing for entire content channels. The system localizes videos into up to 10 languages simultaneously, delivering finished channels in under 24 hours. Precision mode handles avatar inference and lip-sync for high-quality output, automating the translation workflow for large-scale video libraries.
HeyGenJul 23HeyGen launched Video Agent, a prompt-driven tool inside its platform that uses the HyperFrames framework to generate complete videos from a simple text request. The agent assembles avatars, motion graphics, captions, and music into a finished cut. This integration makes the framework’s production capabilities available as a hosted, conversational product for creating product intros and explainers.
HeyGenJul 23HeyGen launched an Audio to Video API endpoint that lip-syncs pre-recorded audio onto avatars or still images in a single call. The system accepts audio URLs or asset IDs, replacing script-based generation. It supports batch processing for multiple narrations on a single visual, with output controls for resolution, aspect ratio, and captions via asynchronous webhook notifications.
HeyGenJul 22HeyGen launched a Storyboard flow in HyperFrames that adds a three-pass pre-production stage to video generation. The agent creates a plan, a wireframe sketch, and a final build, requiring user sign-off at each step. Comments on specific storyboard cards trigger frame-level revisions, and the system saves the board as version-controlled markdown files.
HeyGenJul 22HeyGen launched companion mode for its HyperFrames framework, allowing AI agents to pitch five video angles, storyboard, and sketch frames for review. This workflow requires user approval at each step before the agent builds the final video. The process shifts video production from a single-turn order to a directed collaboration, preventing post-render surprises.
HeyGenJul 18HeyGen launched an AI Clipping API that converts long-form video into short, social-ready highlights. The endpoint automatically selects and scores key moments, or follows natural language instructions to target specific topics. It supports custom aspect ratios, burned-in captions, and webhook notifications for asynchronous processing, enabling programmatic creation of short-form content from long recordings.
HeyGenJul 18HeyGen added a media library to its HyperFrames framework, featuring 10,000+ music tracks, 75,000+ images, sound effects, and logos. Assets save locally to the machine, allowing agents to reuse files across projects without re-searching. This update removes the manual sourcing bottleneck, enabling fully automated video production runs.
HeyGenJul 17HeyGen launched batch APIs that support the submission of up to 100 videos, translations, lipsyncs, or uploads in a single request. The API returns a batch ID immediately and triggers a webhook once all items reach a terminal state. This update enables asynchronous processing for high-volume video workflows, replacing the need for individual API calls per item.
HeyGenJul 14HeyGen released a /figma skill for its HyperFrames framework that imports Figma designs directly into video compositions. The tool pulls brand tokens, converts frames into editable components, and translates Figma Motion timelines into GSAP animations. All assets are frozen locally, ensuring renders remain stable without live API calls, allowing agents to build and revise video from design files.
HeyGenJul 13HeyGen launched a CLI that provides terminal-based search and download access to its music and sound effects catalogue. The tool processes natural language queries on macOS, Linux, and Windows. This release integrates with the HyperFrames framework, enabling agents to automate beat-synced video production by pulling audio assets directly from the terminal.
HeyGenJul 12HeyGen released a new guide for its HyperFrames motion-graphics skill, which automates the creation of design-led motion graphics from natural language prompts. The skill generates charts, logo stings, and stat cards by autonomously handling all motion design decisions. It pulls public data from APIs or uses provided files like Figma vectors to create animations without manual editing.
HeyGenJul 12HeyGen now supports transparent background video output by setting output_format to "webm" on the /v3/videos API endpoint. This generates a video file with a real alpha channel, removing the need for green screens. The feature is available across the HeyGen API, CLI, and MCP for avatars trained with matting.
HeyGenJul 11HeyGen launched the /talking-head-recut skill, which automatically overlays synced motion graphics like titles and stat count-ups onto talking-head videos. The agent researches topics, writes scripts, casts avatars via CLI, and generates the final video. Revisions are handled through natural language instructions, allowing for the creation of professional video explainers without manual editing or camera work.
HeyGenJul 10HeyGen released a HyperFrames skill that generates launch videos directly from Figma design files. By pasting a Figma link and invoking the /figma command, the agent reads the layout to preserve exact hex colors, fonts, and frame designs. This workflow eliminates manual exports and plugins, allowing for direct conversion from design mocks to finished video assets.
HeyGenJul 9HeyGen released a music-to-video skill for its HyperFrames framework that generates beat-synced videos from audio tracks. The analyzer maps BPM, downbeats, phrases, and drum fills to lock visual cuts to the music. The agent uses typography and design systems to render the video, with revisions handled through natural-language notes that preserve the established timing map.
HeyGenJul 8HeyGen released a HyperFrames skill that converts open GitHub pull requests into narrated video explainers. The agent analyzes the diff, commits, and reviewers to generate a 30-to-90-second video featuring real code animations, captions, and voiceover. This single-generation workflow replaces manual diff reading with a visual brief, ending with the author’s avatar and an awaiting-review status.
HeyGenJul 7HeyGen launched a tool that converts any website URL into a finished promotional video. The AI agent analyzes the site’s CSS, fonts, and colors to write a script, add narration and music, and render the final MP4. Built on the open-source HyperFrames framework, the tool offers the first conversion free of charge.
HeyGenJul 2HeyGen open-sourced Keyframes, a visual editing system for GSAP animations within its HyperFrames framework. The tool provides timeline diamonds, arc motion, and gesture recording for precise control. AI agents can now inspect their own motion output and apply corrections with a single command, automating the refinement of complex motion graphics without manual code adjustments.
HeyGenJul 1HeyGen Research developed an autonomous agent that optimized the Wan 2.2 video decoder, achieving a 3x inference speedup on a single H100 GPU. The agent performed 18 experiments using Claude Code to reduce latency from 14.47s to 4.79s. HeyGen published the optimization harness and the resulting decoder code on GitHub for public use.
HeyGenJun 30HeyGen updated its avatar models to support single-pass video generation up to 30 minutes, a 10x increase over its previous limit. The new streaming inference framework processes video in chunks to maintain identity, lip-sync, and motion consistency without manual stitching. This capability is available now for Avatar III, IV, and V models via the web platform and API.
HeyGenJun 28HeyGen released a new generation of HyperFrames skills featuring nine creation workflows that AI agents now automatically route to based on context. Instead of manual selection, agents interpret natural language requests to identify the correct workflow for tasks like product launches, music videos, or captioning. This update automates intent detection and tool selection for agentic video production.
HeyGenJun 25HeyGen released HyperFrames skills that enable AI agents to automatically place graphics and captions within videos based on the message content. These skills translate professional editing patterns into repeatable, brand-adjustable agent actions. Agents now autonomously handle the placement of overlays and captions, reducing manual editing time for professional video production.
HeyGenJun 24HeyGen launched Look Packs, a feature powered by a new image engine that maintains consistent facial identity across AI avatar generations. The tool generates a full set of polished looks from a single photo, ensuring digital twins retain the same appearance in every setting. The first Look Pack is free upon creating a Digital Twin.
HeyGenJun 23HeyGen released a rhythm-aware skill for its HyperFrames framework that automatically syncs video composition to music. The system analyzes audio tempo, energy spikes, and rhythmic intervals to align visual cuts and transitions with the beat. This skill automates musical timing, allowing agents to build video around a song rather than manually editing footage to fit a track.
HeyGenJun 19HeyGen launched cloud rendering for its open-source HyperFrames framework, moving video composition processing to HeyGen infrastructure. The npx hyperframes cloud render command eliminates local dependencies like Chrome and FFmpeg. This offloads rendering tasks to the cloud, keeping local machines free so AI agents can continue building while video renders complete.
HeyGenJun 18HeyGen published an MCP server to the Cursor marketplace, enabling coding agents to generate product launch videos directly from a project's README. The integration extracts features and pricing from the repository to produce finished videos without manual filming or editing.
HeyGenJun 17HeyGen launched HyperFrames and a custom HeyGen connector on Grok, automating video production directly within chat responses. The integration provides tools for generating avatar-based videos and programmatic motion graphics. Both connectors authenticate via OAuth and draw on existing HeyGen plan credits to render MP4, WebM, or MOV files without leaving the Grok interface.
HeyGenJun 16HeyGen integrated semantic audio search into its open-source HyperFrames framework. Background music and sound effects can now be found by describing the desired vibe in natural language, with the system returning ranked tracks from HeyGen's library that integrate directly into video projects. This streamlines soundtrack selection for agentic video production workflows.
HeyGenJun 13HeyGen made its library of over 250,000 music tracks and sound effects free for everyone. The HeyGen CLI now serves the library: describe a vibe and it returns matching audio options. These tracks drop directly into HeyGen or HyperFrames video projects to automate soundtrack selection.
HeyGenJun 13HeyGen demonstrated a video production workflow using Claude Code and its open-source HyperFrames framework that requires zero manual editing. The process generates motion graphics, captions, lower thirds, and transitions from a single prompt. HeyGen published a full YouTube breakdown showing how to set up the environment and generate cinematic explainer videos using this agentic approach.
HeyGenJun 13HeyGen integrated with Stripe Projects, enabling AI agents to autonomously discover, provision, and pay for video generation API access. Running the Stripe CLI command to add HeyGen handles account creation and credential management without human intervention. A set budget cap funds the service, letting an agent add professional video to its own autonomous tool stack.
HeyGenJun 10HeyGen's HyperFrames, an open-source solution for animated slides and motion graphics, is now an official Model Context Protocol (MCP) connector for Claude. This integration allows Claude to transform dense text-based LLM outputs into engaging video content. The update aims to improve communication efficiency by making complex information more digestible and watchable than traditional text documents.
HeyGenJun 9HeyGen launched Speech Cleanup, an AI-powered tool that automatically removes filler words, pauses, false starts, and retakes from video recordings. This streamlines video production by transforming initial takes into polished, seamless content without manual editing.
HeyGenJun 5HeyGen deployed an AI avatar on Twitch that autonomously reviews GitHub code, identifies bad design, and navigates the browser in real-time. This demonstration showcases the avatar's real-time capabilities and multimodal interaction.
HeyGenJun 4HeyGen has launched its Cinematic Avatar API, allowing developers to programmatically generate cinematic videos featuring their likeness. This enables coding agents to build automated video pipelines, transforming natural language prompts into professional video content.
HeyGenJun 4HeyGen launched frame.md, a markdown-based specification that defines motion and video composition rules for AI agents. The tool translates static brand guidelines into specific instructions for pacing, scale, and movement within a 16:9 frame. This allows autonomous agents to generate consistent, branded video content instead of defaulting to static layouts.
HeyGenJun 1HeyGen increased the monthly credit allowance for its $29 Creator plan from 200 to 600 credits. This update effectively lowers the entry price for producing high-fidelity AI video using the platform's latest rendering engines.
HeyGenMay 28HeyGen launched a hosted Model Context Protocol endpoint that integrates directly with the Lovable app builder via OAuth. This allows developers to add AI-generated avatars and voiceovers to their applications using natural language prompts instead of manual API configurations.
HeyGenMay 22HeyGen updated its open-source HyperFrames framework to allow direct manipulation of video elements within its browser-based studio. Users can now drag elements to fix placement and browse a full component catalog, reducing the need for repetitive AI prompting during the fine-tuning phase.
HeyGenMay 21HeyGen released a template system for its open-source HyperFrames framework that enables parallel video rendering on AWS Lambda. By defining dynamic variables in HTML, developers can now generate thousands of personalized videos simultaneously using a single batch command or SDK call.
HeyGenMay 20HeyGen expanded its open-source HyperFrames framework with 17 customizable caption components and a studio-grade background removal tool that runs locally. By releasing these features for free, HeyGen is commoditizing high-end video editing capabilities that are typically locked behind paid subscription apps.
HeyGenMay 19HeyGen reduced costs for its Lipsync API by approximately 33 percent across all self-serve plans. These price cuts make high-volume video dubbing and automated content localization more economically viable for developers building video-as-code workflows.
HeyGenMay 19HeyGen released the API for its Avatar V rendering engine, allowing developers to generate high-fidelity talking-head videos at $0.05 per second. The model uses cross-reference-driven animation to achieve more natural lip-sync and body motion than previous generations.
HeyGenMay 19HeyGen introduced a new workflow for its Avatar V model that allows creators to stitch cinematic AI-generated scenes into long-form content using a continuous camera shot. By creating a natural portal between environments, users can transition a digital twin from a complex prompted world directly into a standard presentation without a visible cut.
HeyGenMay 18HeyGen launched Custom Motion for its Avatar V model, allowing users to trigger specific gestures and expressions by typing directions directly into a script. This shift from automated movement to manual directing gives creators granular control over the non-verbal cues essential for professional video communication.
HeyGenMay 15HeyGen launched an official Canva app that allows users to generate professional AI avatar videos without leaving the design canvas. By bringing lifelike presenters to decks and social posts, the integration transforms static designs into video-first assets for Canva's 190 million users.
HeyGenMay 13HeyGen released a one-click Codex plugin that brings its video generation stack into OpenAI's terminal coding environment. The integration is powered by HeyGen's open-source HyperFrames framework, which renders video from HTML and ships with a Claude Code marketplace manifest already in the repo. Users can call avatars, switch looks, edit scenes, and generate videos without leaving Codex.
HeyGenMay 12HeyGen released v0.6.0 of its open-source HyperFrames framework, introducing a visual Inspector panel for real-time design adjustments. The update allows users to manually tweak AI-generated video code through a UI, eliminating the need for repeated prompting for minor visual changes.
HeyGenMay 12HeyGen released its official Android app, bringing its suite of AI avatar and video generation tools to mobile devices for the first time. The launch includes a new Video Agent that transforms single text prompts into multi-minute videos with synchronized b-roll, captions, and avatars.
HeyGenMay 11HeyGen's Avatar Shots now allows teachers and mentors to place their AI digital twins into fully prompted cinematic environments for video lessons. By removing the need for physical sets or camera crews, educators can scale high-production-value content using only text descriptions.
HeyGenMay 8HeyGen expanded its HyperFrames framework with a library of textures, shaders, and high-fidelity 3D device models for programmatic video creation. The update introduces a command-line interface for instantly adding complex visual components to automated video workflows.
HeyGenMay 8HeyGen reduced costs for its self-serve API by up to 66% for video translation and 50% for its flagship Avatar IV generation. These cuts make high-volume, automated video production economically viable for developers building real-time agents and personalized content at scale.
HeyGenMay 7HeyGen released a Vercel template that automates the setup of a full programmatic video pipeline for its open-source HyperFrames framework. Developers can now deploy live previews and server-side rendering on Vercel infrastructure to transform HTML and CSS into MP4 files instantly.
HeyGenMay 7HeyGen released v0.5.3 of its open-source HyperFrames framework, introducing native support for HTML-in-canvas effects and a catalog of pre-built visual blocks. By allowing live HTML to render inside 3D objects, the update enables AI agents to generate professional product showcases with functional, animated screens.
HeyGenMay 5HeyGen partnered with Nous Research to launch HyperFrames as a native skill for the Hermes Agent, enabling autonomous video generation from terminal commands. The integration allows agents to transform text posts, documents, and code repositories into deterministic MP4 files using HTML and CSS.
HeyGenMay 5HeyGen launched hyperframes.dev, a community hub where users can browse, download, and publish programmable video compositions built with HTML and CSS. The platform allows developers and AI agents to remix existing projects into new deterministic MP4 files using a command-line interface.
HeyGenApr 30HeyGen launched an official Model Context Protocol (MCP) connector that allows Claude to autonomously transform Granola meeting notes into narrated avatar videos. By using Claude as an orchestrator, users can now generate professional stakeholder briefings from a single prompt without manually moving data between platforms.
Frequently asked questions