#*: Masker Refinement through a general purpose process in which the best candidates are being selected while the worst are being discarded. This is achieved by varying one parameter at the time, and then moving to the next stage with the best candidate for that parameter, and moving another parameter. For the FM masker, the parameters where Center Band Frequency (3 bands), Band Amplitude, Modulation Rate (for each band), and Amplitude of the Modulation (for each band).

+

#* Experiment 03

+

#*: Efficiency, uses Santa Barbara corpus of conversation, in which for 1 masker (that is on throughout the whole experiment) random parts of the conversation are presented and asked if they are either heard or not. The RMS of the random part is recorded, as well as the answer of the subject.

+

#* Experiment 04

+

#*: Annoyance, in design process

+

#Spatialization study

+

#: Study of special variables in the direccionality of the masker. Generation of a “virtual impulse response” in which the sound (masker) comes from outside the room (where the intruding sound is located) but the filtering effect of the wall is removed.

−

The first listening tests will involve project staff members to check if things make sense. If it looks good we'll start working with non-project volunteers. ''Experiment 1'', in the the CCRMA "Pit," will take about 30 mins. and involve 30 trials. There will be 6 conditions of masking sound crossed with 5 conditions of speech sounds. The masker (FM noise) and the speech sounds will be presented as if the sources are outside the room. We'll use the measured room model from Tokyo and the exterior sound source position (hallway). The "as if" impression will be created by convolving with the measured impulse responses.

The first listening tests will involve project staff members to check if things make sense. If it looks good we'll start working with non-project volunteers. ''Experiment 1'', in the the CCRMA "Pit," will take about 30 mins. and involve 30 trials. There will be 6 conditions of masking sound crossed with 5 conditions of speech sounds. The masker (FM noise) and the speech sounds will be presented as if the sources are outside the room. We'll use the measured room model from Tokyo and the exterior sound source position (hallway). The "as if" impression will be created by convolving with the measured impulse responses.

−

==== Strategies to define conditions for FM masing noise ====

+

=== Strategies to define conditions for FM masing noise ===

To define the conditions of this first experiment, the approach will be to leave all the parameters fixed, except the modulation frequency.

To define the conditions of this first experiment, the approach will be to leave all the parameters fixed, except the modulation frequency.

Line 33:

Line 98:

*: For this experiment, 3 modulation rates are selected, 2, 5 and 7 Hz. The idea is to span some of the frequencies in the range of 2 to 7 Hz. Basically, all the combination of these 3 rates are used for each center frequency, plus a case with no modulation at all.

*: For this experiment, 3 modulation rates are selected, 2, 5 and 7 Hz. The idea is to span some of the frequencies in the range of 2 to 7 Hz. Basically, all the combination of these 3 rates are used for each center frequency, plus a case with no modulation at all.

+

=== Findings on the Beta Test ===

−

--[[User:Jcaceres|Jcaceres]] 17:09, 24 July 2006 (PDT)

+

# There is a low frequency of the voice that now is not beeing masked.

+

# We need to use a really long conversation, that does never repeat during the experiment.

+

# This corpus of conversations need to have "stationary" properties.

−

==== Beta test TODOs ====

+

== Experiment 02 - Masker Refinement==

+

=== Experiment design ===

+

* efficiency test

+

** Stimuli: speech is mixed at randomized places in a stream of masking noise

+

** Task: "hit the space key when you hear a speech"

+

** Speech: 5 numbers (one, two, three, four, eight) spoken by a male and a female of different accents. Numbers were chosen so that they cover five vowels.

+

** Masker: Genetic algorithm approach with human response. We vary one parameter first and then find one or two "sweet spots." Fix the parameter to those found values and vary the next parameter. Choose the best two - repeat this process.

+

** Analysis: Response rate (response rate is low when speech is masked, we expect.) Response time distribution (more response time when speech is better masked, we expect.) Both analyses can be done within-subject and across-subject. We can also observe what kind of speech is better masked with a particular masking noise.

−

The beta-test of the experiment tool took longer than anticipated. Some minor fixes remain. The ones I remember from yesterday (Friday, 28th) and the ToDo list for Monday ('''x''' = done):

+

=== Implementation ===

−

# '''(x)''' delete input slider from bottom of GUI (in Qt Designer), final product should look like the picture above

#: This worked out with setChecked(false) (inside a method, not in the connection)

+

−

# '''(x)''' comment out all the "cout" statements that are printing during trials, except for the one that says "behind"

+

−

# '''(x)''' find a sticky way to keep machine speed at max during trial (automatic energy saving may be the reason for the occasional stuttering)

+

−

#: Jason comments:

+

−

#: /usr/bin/cpufreq-selector -g performance

+

−

#: you will select the "performance" governor and the cpu speed should go to the max and stay there.

+

−

#: /usr/bin/cpufreq-selector -g userspace

+

−

#: will return the governor to the original "userspace" governor.

+

−

#: And:

+

−

#: /usr/bin/cpufreq-selector -f 1000000

+

−

#: will get the processor to the slow idle speed.

+

−

#: From there the speed should again be "on demand". Regretfully it looks like sometimes the background daemon ("cpuspeed") gets fooled by these changes and dies. At least you can control all of this manually.

#: I still need to add this, but I think after the first experiments, what we really need to do is make much longer files so they don't repeat, and the listener don't get a queu from that repetition.

+

−

# IF I've created a problem for disk files keeping up, you will see the message "behind" printed from FileWvIn and it will start stuttering, the next fix to try (and this might be important anyway for our sanity) is to go to quad files rather than 4 mono files for each layer.

+

−

#: This doesn't look easy, I think I have to modify the entire Jukebox.cpp class in order to get this working...

+

−

# '''(x)''' Add a dialog in case the user doesn't select an option.

+

−

# '''(x)''' Change the silence always on A. Modify also the "correctness" of the selection, now is always set to be in A.

+

−

# '''(x)''' Turn off Sounds (alternative A and B) when user goes to next case.

+

−

# '''(x)''' Program is crashing at the end (it's quiting badly). If you go until the end, is not writing anything to the ouput files. If you stop it in the middle, it works. I may be probably a problem with some destructor...

#: FOUND IT!!! It was a problem reading a vector in MainDialog::setTrial (int n)

+

+

*Verbal Instructions:

+

This is a test where there are only 2 buttons are required, spacebar and (enter)return. You are going to have 2 test runs where you are going to be presented with speech. When you hear any speech you are to press spacebar immediately after to signal us that you heared speech. At the end of each cycle a purple bar will light up to let you know the cycle is ready. You will then press (enter)return to begin the next cycle. The first 2 trials are to get you used to pushing the buttons in response to speech, data will be recorded at the beginning of the third trial testing if you heared speech.

+

*Speech used in the experiment where voices by Jason and Hiroko with the intent of neutral stress on vowels. The words chosen were one, two, three, four, eight which were convolved with impulse response from the tokyo conference room combined with recorded room noise.

−

_____________

+

=== Post Experiment Subject Interviews ===

−

there are probably more things I'm forgetting, but this is close <br/>

+

*Phase01:

−

GOOD LUCK!

+

This test had the most diversity in types of sounds. Since some maskers were not effiient, subjects learned about rhythem of speech presented. Subjects clearly described how some sounds worked better in masking then others since they had an idea of how many sounds were coming at what rate for each masker. Subjects enjoyed this test because differences in maskers were clear.

+

*Phase02:

+

Out of the bunch of 27 maskers we picked 2 candidates for our "golden masker." For this test we changed the amplitude of different center frequencies for these 2 maskers which gave very different sounds throughout the test. Some subjects found that sounds were noticably much harsher and annoying to listen to then others. Several subjects defined that for one masker, it worked really well in masking and sounded like being on an airplane. Subjects still enjoyed this test because differences in maskers were clear.

+

*Phase03

+

At this point we chose 1 masker and used different frequencies of modulation. Most subjects described the sound as droning meaning that it entranced or hypnotized them. This had an effect on most subjects who described the latter half of the test more difficult for them to concentrate. Some subjects claim to almost fall asleep making it difficult to give consistent answers. As I administered the test, I even noticed the sleepy feeling every single time so I started leaving the room during the test. Subjects said that they could hear the female voice very clearly when they would click spacebar (although they would miss more female speech overall). For the male voice that would come through, they would listen for the deep male voice that sounded like short spurts of "wha" and "woo." For the most part, subjects were hitting spacebar when there was speech and not hitting spacebar when they did not hear it as expected from the subjects that I did observe.

+

*Phase04

+

Most subjects described the sound as droning meaning that it entranced or hypnotized them as well. This made sense since we kept the same basic sounds but would change the frequency modulation amplitude. The main difference in this test as I would observe subjects is that they would push spacebar repeatedly when there would be no sound presented. This seem to be due to the fact that the 4 speakers above playing the masking sound is uncorrelated and getting random interference patterns. I assume that the sounds that were generated have a interference pattern that was comparable to the speech used ultimately confusing the listener. This effect played a role on all subjects that I observed and I let them continue pushing spacebar throughout the test. Some felt test was too long because they were falling asleep.

−

--[[User:Cc|Cc]] 09:42, 29 July 2006 (PDT)

+

== Experiment 03 - Efficiency ==

−

==== Findings on the Beta Test ====

+

=== Implementation ===

−

# There is a low frequency of the voice that now is not beeing masked.

+

I've programmed up experiment 3. This uses the Santa Barbara corpus clips in a design that produces a percentage measure of masker effectiveness. It's for one masker (the best one arrived at from experiment 2) at a fixed playback level.

−

# We need to use a really long conversation, that does never repeat during the experiment.

+

−

# This corpus of conversations need to have "stationary" properties.

+

+

Jason has convolved the first SB dialog file, so it plays from the "hallway."

−

==== Bottom lines ====

+

The subject hears a 2 second clip which the app selects randomly from the convolved file.

+

As it's playing the app records the maximum RMS of the first channel of the clip.

+

The subject responds with "yes" or "no" buttons according to whether they heard voices.

+

The app records the response and the maximum RMS played, and then loops, playing the next randomly chosen 2 second clip.

−

# We're going to use just one room (Tokyo Office)

+

This iterates a whole bunch of times over 5 minutes producing easily 50 trials per subject.

−

# We keep the 4CH setup.

+

The analysis plots the percentage of yes response vs. RMS. We should see a threshold RMS below which the clips were effectively masked.

−

# Spatialization ???

+

+

For the final "efficiency rating" we go back into the convolved dialog file and calculate the percentage of time the signal is below the threshold.

+

+

The dialog chosen and start times are as follows:

+

+

* Santa Barbara Corpus Clips Used

+

Each clip is 5 minutes long with the start time indicated below. The trackes were normalized then tuned to the appropriate dbFS level in relation to each other to be in the acceptable threshold level for experimentation.

** Each one goes on for 30 seconds (or any length) fading in and out for 5 seconds.

+

** Fade in the masking noise. Start with the word list, mental math, beep and repeat the word list. Fade out and fade in some enviromental noise (office, traffic, college cafeteria etc.), then next masking noise.

+

** Word list is presented to the subject from a loudspeaker in front at 60 dBA.

+

** Task: a word list is presented at the start. A subject does mental math for 30 seconds (6-10 questions.) After the beep, the subject has to recall the word list presented at the start. Masking noise switches with fade in/out with an environmental noise. Do the same task with the next masking noise.

+

+

* Final comparison

+

** For best 3 masking noises, mix in the typical conference noise (speech, paper shuffle, chair noise, typing sounds, and intruding noise) and ask the subjects which one sounds more "inviting."

+

=== Aparatus To DO list ===

+

+

*All randomized total 20 minutes

+

#Subject walks in with ambient noise

+

#List over speaker of approx 15 words (20sec)

+

#linear fade of masker during 15 word recital

+

#beep/flash to start mental math as long as possible (or 2.5 min) 3maskers

+

#flash to start recital and repeat as much of the list in microphone for as long as they need

+

#Subject chooses when to start next phase

+

#quick fade out of masker to next masker while new 15 words played through speaker.

+

+

*Data type

+

Solutions, time between answers, # of recall word list

+

+

== FM Masking Noises ==

+

+

Variables

+

*modulation width (critical band or speech sounds)

+

*modulation rate (0.01 - 0.1 fc)

+

*sinusoidal or stochastic modulation

+

+

Already fixed

+

*with broadband noise (what shape, and how loud? - according to the speech)

+

*band width of the noise (critical band)

+

*amplitude of each channel (speech sounds spectral distribution)

+

*number and frequency of center frequencies (3)

== Conference Call Meetings ==

== Conference Call Meetings ==

Line 132:

Line 242:

Tuesday 9:30AM '''Japan''' - Monday 5:30PM '''Stanford'''

Tuesday 9:30AM '''Japan''' - Monday 5:30PM '''Stanford'''

−

== Parameters for the Noise Generation ==

+

=== August 28, 2006 ===

+

Tuesday 9:30AM '''Japan''' - Monday 5:30PM '''Stanford'''

−

Variables

+

=== September 04, 2006 ===

−

*modulation width (critical band or speech sounds)

+

Tuesday 9:00AM '''Japan''' - Monday 5:00PM '''Stanford'''

−

*modulation rate (0.01 - 0.1 fc)

+

−

*sinusoidal or stochastic modulation

+

−

+

−

Already fixed

+

−

*with broadband noise (what shape, and how loud? - according to the speech)

+

−

*band width of the noise (critical band)

+

−

*amplitude of each channel (speech sounds spectral distribution)

+

−

*number and frequency of center frequencies (3)

+

−

+

−

+

−

--[[User:Hiroko|Hiroko]] 18:27, 31 July 2006 (PDT)

+

−

+

−

== Experiment design ==

+

−

* masking sounds with three variables

+

−

* one sec. noise+speech, noise only comparison

+

−

* all stimuli mixed and randomized

+

−

+

−

problem of the beta-test

+

−

* repeatable, long conversation -> Fixed length, no repeat

+

−

* either one of two stimuli is expected with speech

+

−

+

−

what experiment to do

+

−

* efficiency test

+

−

** Stimuli: speech is mixed at randomized places in a stream of masking noise

+

−

** Task: "hit the space key when you hear a speech"

+

−

** Speech: 5 numbers (one, two, three, four, eight) spoken by a male and a female of different accents. Numbers were chosen so that they cover five vowels.

+

−

** Masker: Genetic algorithm approach with human response. We vary one parameter first and then find one or two "sweet spots." Fix the parameter to those found values and vary the next parameter. Choose the best two - repeat this process.

** Each one goes on for 30 seconds (or any length) fading in and out for 5 seconds.

+

−

** Fade in the masking noise. Start with the word list, mental math, beep and repeat the word list. Fade out and fade in some enviromental noise (office, traffic, college cafeteria etc.), then next masking noise.

+

−

** Word list is presented to the subject from a loudspeaker in front at 60 dBA.

+

−

+

−

* Final comparison

+

−

** For best 3 masking noises, mix in the typical conference noise (speech, paper shuffle, chair noise, typing sounds, and intruding noise) and ask the subjects which one sounds more "inviting."

Masker Refinement through a general purpose process in which the best candidates are being selected while the worst are being discarded. This is achieved by varying one parameter at the time, and then moving to the next stage with the best candidate for that parameter, and moving another parameter. For the FM masker, the parameters where Center Band Frequency (3 bands), Band Amplitude, Modulation Rate (for each band), and Amplitude of the Modulation (for each band).

Experiment 03

Efficiency, uses Santa Barbara corpus of conversation, in which for 1 masker (that is on throughout the whole experiment) random parts of the conversation are presented and asked if they are either heard or not. The RMS of the random part is recorded, as well as the answer of the subject.

Experiment 04

Annoyance, in design process

Spatialization study

Study of special variables in the direccionality of the masker. Generation of a “virtual impulse response” in which the sound (masker) comes from outside the room (where the intruding sound is located) but the filtering effect of the wall is removed.

a.Click “ALT_ROUTING” and click “INPUT”
i.Set CH1 to adat-1, CH2 to adat-2, etc…
ii.If you want to set up a record line, do so setting CH9 to M/L 9
1.Set the top knob and switch to appropriate setting
2.Use CH9 fader to set input level to application
b.Click “ALT-ROUTING” and click “OUTPUT SLOT” for output cards
i.Slot A set Trk1-8 to BUSS 1-8 in sequential order (Horizontal)
ii.Slot B set Trk1-8 to BUSS 9-16 in sequential order (Vertical)

Software Config:

7)Setting up the software with hardware

a.Go to Application under Bash shell and type “m”, then “make”, then “go”
b.Play Voice recording and set levels to 25dbA at center
c.Play Masker noise and set levels to 45dBa at center

8)Go to “MAIN DIALOG” in software app to set ID & output dir then Repeat 6a

Experiment 01 - Beta Test

GUI Experiment 1

The first listening tests will involve project staff members to check if things make sense. If it looks good we'll start working with non-project volunteers. Experiment 1, in the the CCRMA "Pit," will take about 30 mins. and involve 30 trials. There will be 6 conditions of masking sound crossed with 5 conditions of speech sounds. The masker (FM noise) and the speech sounds will be presented as if the sources are outside the room. We'll use the measured room model from Tokyo and the exterior sound source position (hallway). The "as if" impression will be created by convolving with the measured impulse responses.

Strategies to define conditions for FM masing noise

To define the conditions of this first experiment, the approach will be to leave all the parameters fixed, except the modulation frequency.

Noise set Contains a complete technical documentation of the masking noise generation. It also contains the soundfiles.

The conditions of the masking FM noise will be defined by the following criteria:

3 bands of FM noise will be used (centered at 200 350 and 500 Hz):

This bands are selected based on an analysis of speech voice recorded in the Tokyo office. The motivation behind this decision is to identify the relevant parameters in the leaking voice. For example, we know that the wall is filtering much of the high frequency components, so that's relevant in the selection of the main frequencies.

The amplitude (volume) of each band will be fixed:

The amplitude was tuned in order to psychoacoustically balance the level of the three noise bands that will be used. This balance was done without modulation.

The amplitude of the modulation will be proportional to the modulation frequency:

The motivation behind this choice is to minimize the annoyance effect. When the modulation rate is low, higher amplitudes are more noticed and annoying.

The relation between of modulation frequency of the 3 bands is then the main factor to define the conditions:

For this experiment, 3 modulation rates are selected, 2, 5 and 7 Hz. The idea is to span some of the frequencies in the range of 2 to 7 Hz. Basically, all the combination of these 3 rates are used for each center frequency, plus a case with no modulation at all.

Findings on the Beta Test

There is a low frequency of the voice that now is not beeing masked.

We need to use a really long conversation, that does never repeat during the experiment.

This corpus of conversations need to have "stationary" properties.

Experiment 02 - Masker Refinement

Experiment design

efficiency test

Stimuli: speech is mixed at randomized places in a stream of masking noise

Task: "hit the space key when you hear a speech"

Speech: 5 numbers (one, two, three, four, eight) spoken by a male and a female of different accents. Numbers were chosen so that they cover five vowels.

Masker: Genetic algorithm approach with human response. We vary one parameter first and then find one or two "sweet spots." Fix the parameter to those found values and vary the next parameter. Choose the best two - repeat this process.

Analysis: Response rate (response rate is low when speech is masked, we expect.) Response time distribution (more response time when speech is better masked, we expect.) Both analyses can be done within-subject and across-subject. We can also observe what kind of speech is better masked with a particular masking noise.

Implementation

GUI Experiment 2

Verbal Instructions:

This is a test where there are only 2 buttons are required, spacebar and (enter)return. You are going to have 2 test runs where you are going to be presented with speech. When you hear any speech you are to press spacebar immediately after to signal us that you heared speech. At the end of each cycle a purple bar will light up to let you know the cycle is ready. You will then press (enter)return to begin the next cycle. The first 2 trials are to get you used to pushing the buttons in response to speech, data will be recorded at the beginning of the third trial testing if you heared speech.

Speech used in the experiment where voices by Jason and Hiroko with the intent of neutral stress on vowels. The words chosen were one, two, three, four, eight which were convolved with impulse response from the tokyo conference room combined with recorded room noise.

Post Experiment Subject Interviews

Phase01:

This test had the most diversity in types of sounds. Since some maskers were not effiient, subjects learned about rhythem of speech presented. Subjects clearly described how some sounds worked better in masking then others since they had an idea of how many sounds were coming at what rate for each masker. Subjects enjoyed this test because differences in maskers were clear.

Phase02:

Out of the bunch of 27 maskers we picked 2 candidates for our "golden masker." For this test we changed the amplitude of different center frequencies for these 2 maskers which gave very different sounds throughout the test. Some subjects found that sounds were noticably much harsher and annoying to listen to then others. Several subjects defined that for one masker, it worked really well in masking and sounded like being on an airplane. Subjects still enjoyed this test because differences in maskers were clear.

Phase03

At this point we chose 1 masker and used different frequencies of modulation. Most subjects described the sound as droning meaning that it entranced or hypnotized them. This had an effect on most subjects who described the latter half of the test more difficult for them to concentrate. Some subjects claim to almost fall asleep making it difficult to give consistent answers. As I administered the test, I even noticed the sleepy feeling every single time so I started leaving the room during the test. Subjects said that they could hear the female voice very clearly when they would click spacebar (although they would miss more female speech overall). For the male voice that would come through, they would listen for the deep male voice that sounded like short spurts of "wha" and "woo." For the most part, subjects were hitting spacebar when there was speech and not hitting spacebar when they did not hear it as expected from the subjects that I did observe.

Phase04

Most subjects described the sound as droning meaning that it entranced or hypnotized them as well. This made sense since we kept the same basic sounds but would change the frequency modulation amplitude. The main difference in this test as I would observe subjects is that they would push spacebar repeatedly when there would be no sound presented. This seem to be due to the fact that the 4 speakers above playing the masking sound is uncorrelated and getting random interference patterns. I assume that the sounds that were generated have a interference pattern that was comparable to the speech used ultimately confusing the listener. This effect played a role on all subjects that I observed and I let them continue pushing spacebar throughout the test. Some felt test was too long because they were falling asleep.

Experiment 03 - Efficiency

Implementation

I've programmed up experiment 3. This uses the Santa Barbara corpus clips in a design that produces a percentage measure of masker effectiveness. It's for one masker (the best one arrived at from experiment 2) at a fixed playback level.

Jason has convolved the first SB dialog file, so it plays from the "hallway."

The subject hears a 2 second clip which the app selects randomly from the convolved file.
As it's playing the app records the maximum RMS of the first channel of the clip.
The subject responds with "yes" or "no" buttons according to whether they heard voices.
The app records the response and the maximum RMS played, and then loops, playing the next randomly chosen 2 second clip.

This iterates a whole bunch of times over 5 minutes producing easily 50 trials per subject.
The analysis plots the percentage of yes response vs. RMS. We should see a threshold RMS below which the clips were effectively masked.

For the final "efficiency rating" we go back into the convolved dialog file and calculate the percentage of time the signal is below the threshold.

The dialog chosen and start times are as follows:

Santa Barbara Corpus Clips Used

Each clip is 5 minutes long with the start time indicated below. The trackes were normalized then tuned to the appropriate dbFS level in relation to each other to be in the acceptable threshold level for experimentation.

Experiment 04 - Annoyance

Experiment design

Each one goes on for 30 seconds (or any length) fading in and out for 5 seconds.

Fade in the masking noise. Start with the word list, mental math, beep and repeat the word list. Fade out and fade in some enviromental noise (office, traffic, college cafeteria etc.), then next masking noise.

Word list is presented to the subject from a loudspeaker in front at 60 dBA.

Task: a word list is presented at the start. A subject does mental math for 30 seconds (6-10 questions.) After the beep, the subject has to recall the word list presented at the start. Masking noise switches with fade in/out with an environmental noise. Do the same task with the next masking noise.

Final comparison

For best 3 masking noises, mix in the typical conference noise (speech, paper shuffle, chair noise, typing sounds, and intruding noise) and ask the subjects which one sounds more "inviting."

Aparatus To DO list

All randomized total 20 minutes

Subject walks in with ambient noise

List over speaker of approx 15 words (20sec)

linear fade of masker during 15 word recital

beep/flash to start mental math as long as possible (or 2.5 min) 3maskers

flash to start recital and repeat as much of the list in microphone for as long as they need

Subject chooses when to start next phase

quick fade out of masker to next masker while new 15 words played through speaker.

Data type

Solutions, time between answers, # of recall word list

FM Masking Noises

Variables

modulation width (critical band or speech sounds)

modulation rate (0.01 - 0.1 fc)

sinusoidal or stochastic modulation

Already fixed

with broadband noise (what shape, and how loud? - according to the speech)