Columbia Technology Ventures

Spectrogram software for yielding high-definition timbre spectra

This technology is a software that generates reliable, high-definition timbre spectra for use in speech and voice technologies.

Unmet Need: Software that generates timbre spectra using pitch-synchronous segmentation

Current software for audio analysis generates timbre spectra using pitch asynchronous methods that fail to separate pitch and timbre completely. With these methods, voice recordings are segmented into frames of 10 to 50 milliseconds and Fourier transformed to yield a timbre spectrum for each frame. When frame size is shifted, timbre spectra become inconsistent because pitch and timbre are always mixed. There is currently no software that separates pitch and timbre completely to yield accurate timbre spectra.

The Technology: Software for generating reliable, high-definition timbre spectra

This technology is a software for generating reliable timbre spectra by separating pitch and timbre completely. This software can analyze a recorded signal of speech and generate segments based on whether the sections are voiced or unvoiced. It uses a method of pitch-synchronous segmentation by sensing glottal closing instants to generate pitch periods. Each pitch period is processed via the software’s algorithm and Fourier transformed, yielding accurate, high-definition pitch and timbre spectra.

Applications:

  • Generating high quality timbre spectra
  • Computation and display of power-decay pattern in each pitch period
  • Segmenting a vocal recording into pitch periods solely based on voice signals
  • Improving and inventing speech and voice technology

Advantages:

  • Complete separation of pitch and timbre
  • Generation of accurate timbre spectra
  • Easy to decipher formant frequencies and peak profiles
  • Easy to use interface, which displays power decay and timbre spectra with a click on spectrogram
  • Glottal closing instants as pitch period parameter (pitch synchronous segmentation)

Lead Inventor:

Julian Chengjun Chen, Ph.D.

Patent Information:

Patent Pending

Related Publications:

Tech Ventures Reference: