Columbia Technology Ventures

Speech separation system for enhancing auditory attention and hearing

This technology is a hearing aid system that improves hearing attention and spatial localization in particularly crowded and loud environments.

Unmet Need: Hearing aid system for isolating and enhancing speech and hearing attention

Current hearing aid devices are not able to isolate speech from a specific speaker in a noisy and fluid environment. The inability of hearing aid technologies to localize and amplify specific sounds increases the listening effort of hearing-impaired subjects. To improve hearing attention and speech separation, research efforts have largely relied on static or stationary background noise and talking streams, which are not reflective of most natural conversation environments.

The Technology: Hearing aid system that increases hearing efficiency in noisy environments

This technology consists of a hearing aid system comprised of a cognitively controlled hearing aid with automatic speech separation and an attention decoder algorithm. This system estimates the localization of overlapping speakers and suppresses background noise in sound space, then uses neural data and a decoding algorithm to predict and amplify the attended speaker. This approach allows a person to better identify, localize, and attend to a conversation, despite noisy environments.

This technology has been validated using a task in which patients are instructed to attend to one of two spatially segregated and moving speakers.

Applications:

  • Cognitively-controlled hearing-aid
  • Speech separation for telecommunication devices
  • Immersive auditory experiences
  • Software for isolating signal from noisy backgrounds
  • Research tool for hearing-impairment and attention

Advantages:

  • Spatially-sound attention decoding algorithm
  • Enhances speech of an attended speaker
  • Improves speech intelligibility and hearing efficiency
  • Preserves spatial cues of a conversation
  • Decreases listening effort of hearing-impaired users
  • Applicable to existing hearing aids and related listening technologies

Lead Inventor:

Nima Mesgarani, Ph.D.

Patent Information:

Patent Issued (11,961,533)

Patent Pending (US20240013800)

Tech Ventures Reference: