Google Chrome Rolls Out New Feature That Captions Audio and Video in Real-Time

Google Unveils New Pixel 4 Smart Phone
Drew Angerer/Getty Images

Google introduces a new Chrome accessibility feature that provides real-time captions for audio and video, even if the audio is turned off.

The feature, known as Live Caption, was first rolled out to Pixel phones in 2019, along with the Android 10 update.

It was then made available to many non-Pixel phones such as the OnePlus Nord, OnePlus 8 series, Galaxy S20 series.

How It Works

XDA was the first to test the Live Caption feature when it still exclusively available to Pixel owners as part of the Android 10 update.

The report XDA published explained that the feature utilizes machine learning to predict and create the captions.

One can enable the feature by going into Chrome's Advanced settings under the Accessibility and Captions settings. Chrome 89 users may need to restart the browser first to see the Live Caption toggle.

The accessibility feature will download speech recognition files if the feature is enabled for the first time.

The feature, which worked flawlessly when tested in YouTube and Disney+, will generate a small, moveable box in the bottom of the browser while watching or listening to content where people are talking.

It also works even with muted audio or if the volume is turned down and can be turned off without going back to the settings page.

The Verge reported that the feature also works on Twitch streams, SoundCloud, and podcast players.

Live Caption only works in English at the time of the release, but support for more languages will likely be added over time.

Zero-Day Bug

Google recently released an update for Chrome that fixes five security flaws, including "Zero-Day" - a vulnerability that allows a hacker to take control of an affected system.

An article released by WeLiveSecurity describes "Zero-Day" as a high-severity vulnerability in which a remote attacker tricks an unsuspecting victim into visiting a specially crafted website.

This is when the attacker could execute an arbitrary code or even cause a denial-of-service attack on the vulnerable system.

Other vulnerabilities fixed by the update include one that affects WebRTC, a Chrome component that allows audio and video communication to work on websites.

The United States' Cybersecurity and Infrastructure Security Agency (CISA) also issued a security advisory urging users to update their browsers.

Google did not provide further details about the security loopholes until the majority of the users have updated with the fix.

The decision comes as a means to mitigating the chance of the vulnerabilities being exploited by cybercriminals.

What is clear is that Chrome users are strongly advised to update the web browser to the latest version (89.0.4389.90) as soon as possible to eliminate the threat.

For those who have automatic updates enabled, it is expected that the browser managed to update to the newest version itself.

Besides, Google Chrome and Microsoft Edge will roll out new features to manage multiple browser windows easier at once.

ⓒ 2024 TECHTIMES.com All rights reserved. Do not reproduce without permission.
Join the Discussion
Real Time Analytics