m
Line 177: Line 177:
 
</source>
 
</source>
  
 
+
<center>[[File:NoiseReductionSpeech.jpg|thumbnail|center|NoiseReductionSpeech before and After]]<\center>
 
+
 
+
 
+
 
+
 
+
 
+
 
+
 
+
 
+
 
+
 
+
 
+
 
+
 
+
 
+
  
 
[[ 2016 Fall ECE 438 Boutin|Back to 2016 Fall ECE 438 Boutin]]
 
[[ 2016 Fall ECE 438 Boutin|Back to 2016 Fall ECE 438 Boutin]]

Revision as of 18:55, 23 November 2016


Neil Armstrong Moon Landing Speech Analysis

Introduction

When Neil Armstrong landed on the moon, he said "That's one small step for (a) man; one giant leap for mankind." However,because all the noises (machine vibration,breathing and white noise in radio frequency), people cannot distinguish if he said "a man" or just "man". A lot of experts tried different methods but still could not extract the "a" from the background noise. Hence, the answer is still unknown.

This small project will focus on noise reduction techniques to increase the overall signal to noise ratio (SRN)
Two techniques will be introduced:

  • Bandpass Filter
  • Noise Gate

Original Speech Analysis

Speech in Time domian

The original speech file can be found from NASA page: July 20, 1969: One Giant Leap For Mankind
Play the audio
While playing the audio, we can hear a constant machine vibration and white noise in the background.

The whole audio can be divided to 5 parts:

Original Speech

We can use MATLAB load the audio file and then divide the audio to different parts.
Here,I divided the audio to five parts.

    [speech,f_sampling] = audioread('Original Speech.wav');
    noise1 = speech(1:3*f_sampling);
    speech1 = speech(round(3.652*f_sampling):round(5.682*f_sampling));
    noise2 = speech(round(5.694*f_sampling):round(15.388*f_sampling));
    One_Man = speech(round(15.337*f_sampling):round(18.584*f_sampling));
    One_Mankind = speech(round(20.633*f_sampling):floor(24.1*f_sampling));
    save noise.mat noise1 noise2
    save Main.mat speech1 One_Man One_Mankind
Speech in Frequency domian

Then we should look at the speech in frequency domain.
The analysis tool is Spectrogram, which is based on the codes from Lab 9a-Speech Processing I. Spectrogram is a three dimensional diagram,in which the x-axis represents time, y-axis represents frequency and z-axis represents the FFT (fast fourier transform) at each short period of time. It tells us what is the overall distribution of the audio frequency. Based on the diagram, we can determine how to design our bandpass filter.

Noise 1 Spectrogram
Noise 2 Spectrogram
OneSmallStep Spectrogram
OneGiantLeap Spectrogram
    CLEAR;
    FileCutting;
    delta_t = 40;
    overlap = 20;
    N = 512;
 
    F1 = figure(1);
    autoSpecgm(noise1,f_sampling,delta_t,overlap,N,F1);
    title('Noise1')
 
    F2 = figure(2);
    autoSpecgm(noise2,f_sampling,delta_t,overlap,N,F2);
    title('Noise2')
 
    F3 = figure(3);
    autoSpecgm(One_Man,f_sampling,delta_t,overlap,N,F3);
    title('One Man')
 
    F4 = figure(4);
    autoSpecgm(One_Mankind,f_sampling,delta_t,overlap,N,F4);
    title('One Mankind')
 
    function autoSpecgm(signal,fs,delta_t,overlap,N,PIC)
 
    SIGNAL = Specgm(signal,delta_t,overlap,N);
    SIGNAL = transpose(SIGNAL);
    t = 1:(delta_t-overlap):length(signal);
    f = 0:fs/2;
 
    figure(PIC)
    subplot(1,2,1)
    [row,col] = size(SIGNAL);
    imagesc(t,f,abs(SIGNAL(1:row/2,:)))
    axis xy
    subplot(1,2,2)
    mesh(abs(SIGNAL(1:row/2,:)))
    end
Noise Reduction in frequency domain using bandpass filter

From the Spectrogram, we know that the constant noise is concentrated on frequency spectrum from 1 to 300Hz, whereas the speech is concentrated on 250-2000Hz.
Therefore, we can design a bandpass filer in a range from 200 to 2000Hz. The frequencies that are out of this range will be attenuated.

    order    = 10;  
    fcutlow  = 200;  
    fcuthigh = 2000;
    [b,a]    = butter(order,[fcutlow,fcuthigh]/(f_sampling/2), 'bandpass');
    Filtered_speech = filter(b,a,speech);
BandPass Speech Before and After
BandPass Speech in Frequency Before and After

Clearly, after filtering,the part of the noises can be attenuated.However,the noises are still significant.

Noise Gate: a technique that can erase noises

After applying the bandpass filter, we can see the filter will never attenuate the noise without touching the signal's frequency.
Therefore, we need anohter technique to reduce noise.
Searching online, I found a technique that is used by some commercial softeware called Noise Gate.
Basically, we need a noise sample from the audio and calculate the average power of this sample. Usually for background noise, the average powers of the noise and signal are different. Signal is generally having higher average power. Based on this feature, we can implement an if-else statement to decide whether or not a given audio segment is signal or noise.
For more details, please look at this wiki page: Noise Gate

The Noise gate should be applied after frequency filtering. Because the frequency filter will attenuate the overall noise amplitude.The average power of noise will decrease, so that the noise gate can better erase the noise segments.

CLEAR;
FileCutting;
 
overlap = 20;
delta_t = 40;
N = 512;
 
order    = 10;  
fcutlow  = 170;  
fcuthigh = 1750 ;
[b,a]    = butter(order,[fcutlow,fcuthigh]/(f_sampling/2), 'bandpass');
Filtered_speech = filter(b,a,speech);
 
SpeechCutting(Filtered_speech)
 
load('noise.mat');
load('Main.mat');
 
ave_noise2 = ave_power(Fnoise2);
ave_noise = ave_noise2;
 
windowSize = 1000;
Len_speech = length(Filtered_speech);
steps = floor(Len_speech/windowSize);
NR_speech = Filtered_speech;
error_edge = 0.01;
error = zeros(1,steps);
 
for i = 0:steps-1
    current_speech = Filtered_speech(i*windowSize+1:(i+1)*windowSize);    
    current_power = ave_power(current_speech);
    error(i+1) = current_power - ave_noise;
    if error(i+1) > error_edge 
        NR_speech(i*windowSize+1:(i+1)*windowSize) = current_speech;
    elseif error(i+1) < error_edge & error(i+1)>0
        NR_speech(i*windowSize+1:(i+1)*windowSize) = 0.01* current_speech;
    elseif error(i+1) < error_edge & error(i+1)<0
        NR_speech(i*windowSize+1:(i+1)*windowSize) = 0 * current_speech;
    end
end
 
figure(1)
subplot(2,1,1)
plot(Filtered_speech)
subplot(2,1,2)
plot(NR_speech)
 
SpeechCutting(NR_speech)
load('Main.mat');
NoiseReductionSpeech before and After
<\center> Back to 2016 Fall ECE 438 Boutin

Alumni Liaison

Ph.D. 2007, working on developing cool imaging technologies for digital cameras, camera phones, and video surveillance cameras.

Buyue Zhang