Often, reports that the lab is turning into beer will suggest that it has failed and that its investigators are throwing the towel away. But in the case of Facebook Reality Labs Research, a lab dedicated (in part) to coming up with new ways to improve hearing to deaf members or the deaf community of hearing, it shows that your work pays off.
Facebook’s mission is to help people connect and communicate with each other. This is why, while it may seem like an off-duty task to tackle this task, it fits perfectly into the core values of the company.
The problem that Facebook is trying to tackle is how to handle audio streaming for individuals in noisy areas. Although many people with hearing loss, depending on their disability, find it possible to hear and interact in one-on-one situations in quiet, noisy environments such as bars or social programs you may be working on all very hard. With that in mind, Facebook is exploring how to integrate beamforming technology, in-depth learning, noise cancellation, and – perhaps most surprisingly – increased reality (AR) to improve this situation.
In a project, Facebook scientists are exploring how true glasses can help determine what kind of things people want to add by looking, well, where they are looking. By matching human focus, in terms of what they are watching, to sound inputs, AR glasses can detect what kind of things people want to hear and what they don’t – and then click up or down the corresponding sound channels. As part of its experiments in this area, Facebook changed the workplace where much of this research was carried out into a fake site to explore how it would work in a site with so many noisy inputs.
“Most people with hearing loss do not use hearing aids – in part – because they do not work well in everyday situations like a noisy restaurant, a conversation that affects a lot of people at a big party, or in a moving car,” he said. Thomas Lunner, lead researcher for Facebook’s listening lab, told Digital Designs. “In conducting an enhanced hearing test for AR glasses, we note that some of our findings may be relevant to this problem resolution. In [our new research], we show how increased reality can enhance hearing aids, through a system that understands what you want to listen to, isolates and enhances what you want to hear, and reduces background noise. By sending a signal of advanced AR progression to hearing aid, you also get an adjusted system for your unique hearing ability. ”
Playing to Facebook Search capabilities
Lunch is not a novice when it comes to this research area. He is a renowned scientist whose work laid the groundwork for what became the world’s first digital aid in 1995. This study, while in the early stages, entered a number of areas of research for Facebook, as an image identifier, making language a solution. , and all the more.
“The science of hearing is an area we are starting to explore, so this technology is not on any of our products, but we are very excited about the worlds with AR glasses,” Lunner continues. “We think they can one day help deliver all the improvements, including helping anyone with hearing loss or just having trouble understanding people at a conference.”
Michael Abrash, the first scientist at Facebook’s Light Industry, told Digital Designs that he believes increased size and virtual reality can have profound effects (and applications) in the search space.
“AR and VR have great potential to benefit everyone, but they have a very high potential for people with different physical abilities,” Abrash said. “For example, AR glasses may one day be able to improve performance to help people with poor vision to see better, and may be able to provide visual results about things. environmentally friendly and unobtrusive speech. As another example, we believe that VR – and finally AR – will one day have the opportunity to create virtual reality monitors and avatars that will enable those with travel challenges from the telephone to the office or to the mother’s room. -crow them. ”
Facebook is, of course, best known for its social network. But according to Google’s parent company Alphabet, which explores self-driving cars, mapping systems and drone deliveries alongside search, Facebook is interested in more than just newsletters and timelines. In the past, he has shown great interest in both VR and AR – including everything from his acquisition of Oculus to the creation of Spark AR Studio. Facebook is yet to show its hand when it comes to much of this technology. Still, if this project is anything to go by, it looks like Facebook could use its great potential for good when it comes to the future of connecting people.
A book describing the project, titled “The Power of Modern Virtual Platforms to Improve Individual Assistance Devices and to Support More Appropriate Research,” was recently published in the Journal of Hearing & Hearing.
Editors’ recommendations
