New Microsoft Patent Allows AI to Modify Speech and Facial Expressions During Live Broadcasts
Microsoft has patented an artificial intelligence technology capable of modifying a speaker's words in real-time during live streams while synchronizing lip movements.
💡TechPhoto: МИГ
Key points
- Microsoft patented AI to alter words and lip movements in live broadcasts.
- The technology allows personalized streams for different viewers.
- Experts highlight serious ethical risks and the threat of deepfakes.
- EU AI Act regulations require mandatory labeling of altered content.
Technology companies continue to push the boundaries of artificial intelligence, yet new developments increasingly raise concerns among experts due to ethical risks. Microsoft has secured a patent for an innovative system capable of altering audio and video streams during live broadcasts with a minimal delay of just a few seconds. The algorithm not only replaces specific words based on predefined criteria but also completely redraws the speaker's facial expressions to achieve maximum realism.
How the Algorithm Works and Developer Goals
According to the patent documentation, specialized AI agents analyze the broadcast on the fly, identifying words that violate established rules and replacing or removing them. The generative model smooths frames and sound to make any edits invisible to the viewer. Additionally, the system can personalize content for individual users based on their location or age, meaning different people watching the same broadcast may hear different versions of a speech.
Developers position the technology as a tool for simultaneous translation from foreign languages, speech improvement, profanity removal, or even real-time fact-checking. However, experts point out numerous potential threats, including the risk of creating mass real-time deepfakes and the erosion of trust in live broadcasts, which have long been considered the most reliable source of information.
Implications for the Information Landscape
Such tools pose serious challenges for society by blurring the line between reality and digital manipulation. Legal experts note that implementing these systems will require strict regulation in compliance with modern standards, such as the European EU AI Act. The regulation mandates clear labeling of altered content, though technically executing this during individual adaptation of a live broadcast for every single viewer remains a significant hurdle.
Source МИГ — mig.com.ua/novyj-shi-patent-microsoft-styraie-mezhu-mizh-realnistiu-ta-… ↗
Read next
Power outage schedules for November 23: what to expect in Zaporizhzhia
On Monday, November 23, planned power outages will be in effect across Ukraine due to damage caused by enemy attacks on the energy grid.
🛡️SecurityZelenskyy reports new Russian tactic: targeting energy networks
The President of Ukraine announced that Russian forces have shifted their strategy to focus on destroying power grids and transmission lines.
The Consequences of Helicopter Parenting: How Overprotection Shapes Adulthood
Psychologists have identified six key personality traits that develop in children due to excessive parental control.
🛡️SecurityConsequences of large-scale strikes in Kyiv region and security situation across Ukraine
President Volodymyr Zelenskyy reported on the ongoing rescue operations in the Kyiv region following enemy drone attacks.
Fatal Border Crossing: Ukrainian Found Dead in Romanian Mountains, Two Rescued
A Ukrainian citizen was found dead in the Maramureș mountains of Romania during a search and rescue operation. Two other men were successfully rescued by local services.
🏙️CityZaporizhzhia prepares for first snow and frosts down to -3° in late November
The final week of November in Zaporizhzhia will bring a sharp cold snap, rain turning into wet snow, and nighttime frosts down to -3°C. Forecasters have also issued a win…