Skip to main content

Here’s a first, real look at Android 10 Live Caption feature in action

Google I/O 2019 Live Caption

Live Caption is arguably the coolest Android 10 feature around, delivering captions for local and web videos thanks to on-device machine learning. Best of all, it doesn’t require an internet connection to work.

Android 10 is out already, but we haven’t seen Live Caption hit devices yet. Fortunately, XDA-Developers has obtained the Pixel 4’s “Device Personalization Services” app and tweaked things to get Live Caption running on the Pixel 2 XL.

A setup screen also gives us a better idea of how it works, revealing that the feature can censor profanity and can appear in the volume control section. Furthermore, you can hold on the caption to drag it around or double-tap the caption to expand it. The setup page also notes that songs aren’t fully supported — although this is an understandable move. We also get a screenshot of the feature’s toggle in the quick settings menu. Check out the screens below:

Android 10 Live Caption functionality. Android 10 Live Caption functionality. Android 10 Live Caption functionality.

XDA noted that they successfully tested Live Caption in YouTube, Amazon Prime Video, Google Photos (seen above), Google Podcasts, and Netflix. The feature also works in both portrait and landscape mode — check out Amazon Prime Video in landscape mode below.

Android 10 Live Caption functionality.XDA-Developers

The outlet added that it provided reasonably accurate results without needing to turn the volume up. Unfortunately, a Google API restriction reportedly means this feature won’t work in phone/VoIP/video calls, but hopefully this changes in the official release.

We’ve got to assume that the Pixel 4 series will be first to gain Live Caption, as Android 10 is already out for several devices but the feature isn’t present in these releases. Here’s hoping the likes of the OnePlus 7 series — which have already received Android 10 — get an update to enable this feature then.

It’s also pretty encouraging to see that the Pixel 2 XL is able to run Live Caption. The phone uses a flagship processor that’s almost three years old, and it still seems to have enough grunt to run the required on-device machine learning for the service. This bodes well for current mid-range phones, such as the Pixel 3a. Hopefully Google optimizes Live Caption to the point where even low-end devices are able to access it.

More posts about Android 10



from Android Authority https://ift.tt/2nnlEEb
via app promotion

Comments

Popular posts from this blog

This week in Android: It’s weird phone week

We got to play with a lot of cool tech at CES 2019 , but little was cooler than the Qualcomm Snapdragon 855 . Qualcomm had a reference device  sporting the new SoC and we were able to put it through its paces , including our very own Speed Test G . The results are impressive. In other big news this week, we found out  Motorola is planning on bringing back the Razr phone , made famous in the mid 2000s. We don’t know a lot about the phone itself, but we can make some guesses  based on a patent  from August of last year. Plus, we look ahead at the future of LG and OnePlus , including a new peculiar accessory for LG . Also, we have good news and bad news about Huawei’s security. Here are your top stories for the week 4:20 – Snapdragon 855 performance and benchmarking: Speed Test G, AnTuTu & Geekbench At CES, Gary Sims previewed the  Snapdragon 855 processor in reference hardware. He had some fun with it. 21:45 – You’ll flip for the foldable Motorol...

My product launch wishlist for Instagram, Twitter, Uber and more

‘Twas the night before Xmas, and all through the house, not a feature was stirring from the designer’s mouse . . . Not Twitter! Not Uber, Not Apple or Pinterest! On Facebook! On Snapchat! On Lyft or on Insta! . . . From the sidelines I ask you to flex your code’s might. Happy Xmas to all if you make these apps right. Instagram See More Like This – A button on feed posts that when tapped inserts a burst of similar posts before the timeline continues. Want to see more fashion, sunsets, selfies, food porn, pets, or Boomerangs? Instagram’s machine vision technology and metadata would gather them from people you follow and give you a dose. You shouldn’t have to work through search, hashtags, or the Explore page, nor permanently change your feed by following new accounts. Pinterest briefly had this feature (and should bring it back) but it’d work better on Insta. Web DMs  – Instagram’s messaging feature has become the defacto place for sharing memes and trash talk about peopl...

First ever drone-delivered kidney is no worse for wear

Drone delivery really only seems practical for two things: take-out and organ transplants. Both are relatively light and also extremely time sensitive. Well, experiments in flying a kidney around Baltimore in a refrigerated box have yielded positive results — which also seems promising for getting your pad thai to you in good kit. The test flights were conducted by researchers at the University of Maryland there, led by surgeon Joseph Scalea. He has been frustrated in the past with the inflexibility of air delivery systems, and felt that drones represent an obvious solution to the last-mile problem. Scalea and his colleagues modified a DJI M600 drone to carry a refrigerated box payload, and also designed a wireless biosensor for monitoring the organ while in flight. After months of waiting, their study was assigned a kidney that was healthy enough for testing but not good enough for transplant. Once it landed in Baltimore, the team loaded it into the container and had it travel 14 ...