The SUMS Corpus

 
  Photo: Laura Tiedtke.

The "SUMS" (Speech Under Multiple Stressors) corpus allows investigating the effects of multiple stressors to speech. This corpus addresses the questions on which basis and in which way all the different stress types shine through and combine in the acoustic speech signal. We used several stressors that form a taxonomy of stress factors according to Murray et al. (1996). Pink noise served as an external stressor. A further stress factor, cognitive load, was created by asking quiz questions. Physiological stressors were induced by training on an ergometer and the application of a respirator mask (full face mask). The speech signals produced by German native speakers while answering the quiz and further reference questions. The results of our acoustic analysis allow drawing conclusions on if and how stress factors can be distinguished from each other, interfere with each other, and/or add up in the speech signal. Furthermore, we touch upon the issue whether measurable stress can increase ad infinitum or whether there is an upper limit for the manifestation of stress in speech.

The corpus will be annotated on altogether 9 levels:

  • Level 1: Orthographic annotation on the sentence level
  • Level 2: ProsodyPro-label on the sentence level
  • Level 3: Classification in intonation phrases
  • Level 4: ProsodyPro-label of the target IP
  • Level 5: Target word
  • Level 6: ProsodyPro-label target word
  • Level 7: Target phon
  • Level 8: ProsodyPro-label target phon
  • Level 9: Discontinuities

 

35,10,0,50,1
25,600,60,2,3000,5000,25,800
90,150,1,50,12,30,50,1,70,12,1,50,1,1,1,5000
0,2,1,0,2,46,15,5,2,1,0,20,0,1
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus
SUMS corpus

Some impressions (by Laura Tiedtke)

 

To find out whether individual parameters behave differently, they were first fed alone. Subsequently, several were induced together until all of the parameters mentioned interacted. In order to avoid a serialization effect, if it were present, the recordings were made in two different versions.

Group 1   Explanation   Group 2
Condition 1   without sound, without physical exertion, without mask   Condition 8
Condition 2   with sound, without physical exertion, without mask   Condition 7
Condition 3   without sound, with physical exertion, without mask   Condition 6
Condition 4   with noise, with physical exertion, without mask   Condition 5
Condition 5   with noise, with physical exertion, with mask   Condition 4
Condition 6   without sound, with physical exertion, with mask   Condition 3
Condition 7   with sound, without physical exertion, with mask   Condition 2
Condition 8   without sound, without physical exertion, with mask   Condition 1

 

Key Features

The circumference of the corpus is approximately 30 minutes pure semi-spontaneous speech recordings of the subjects during the quiz paradigm. The individual durations vary depending on how long the question was and to what extent the test person has responded. In all, the corpus had 6 speakers of the standard German, of which one person is a woman. Five of the six speakers are North Germans, while one comes from the south of Germany. However, this speaker has been living in North Germany for many years. The age of the subjects was between 21 and 49 years. The average age was 35.14 years. Whereby the oldes participant had tob e taken out of the corpus due to technical problems. Thus the age oft he subjects was 21 to 42 years and the average age was 32.83 years.

 

State of the Corpus

You can find the current state of the corpus here.

 

Download

The corpus can be used for non-commercial research purposes. Details can be found here.

 

Examples

 
Example 1.   Example 2.

 

Creators of the Data Base

The data base was created as a joint work between Kiel University (CAU) and the University of Southern Denmark (SDU, Mads Clausen Institute). Involved researchers are:

  • Carina Marquard (CAU)
  • Oliver Niebuhr (SDU)
  • Gerhard Schmidt (CAU)

 

Corresponding Publications

   

C. Marquard, C. Baasch, M. Brodersen, O. Niebuhr, and G. Schmidt: Speech, Think, Act: A Phonetic Analysis of the Combinatorial Effects of Respiratory Mask, Physical and Cognitive Stress on Phonation and Articulation, Proc. DAGA, Kiel, Germany, 2017

Website News

20.10.2019: We had a very good retreat on the island of Sylt.

07.08.2019: Talk from Juan Rafael Orozco-Arroyave added.

11.07.2019: First free KiRAT version released - a game for Parkinson patients

25.06.2019: About 30 pupils from the Isarnwohld-Schule in Gettorf visited us.

02.05.2019: Christin Baasch finished sucessfully her defense on the evaluation of Parkinson speech.

30.11.2018: New student project on driver distraction added.

Recent Publications

   

J. Reermann, E. Elzenheimer and G. Schmidt: Real-time Biomagnetic Signal Processing for Uncooled Magnetometers in Cardiology, IEEE Sensors Journal, Volume 15, Number 10, Pages 4237-4249, June 2019, doi: 10.1109/JSEN.2019.2893236

Contact

Prof. Dr.-Ing. Gerhard Schmidt

E-Mail: gus@tf.uni-kiel.de

Christian-Albrechts-Universität zu Kiel
Faculty of Engineering
Institute for Electrical Engineering and Information Engineering
Digital Signal Processing and System Theory

Kaiserstr. 2
24143 Kiel, Germany

How to find us

Recent News

DSS-Retreat 2019

As in the last year we spent a couple of days (15.10.2019 till 18.10.2019) on the island Sylt to reflect our past, current, and future research work. Due to a "cold wave" we were a bit reduced this year, but anyhow, we had a very good (and producive) time on this beautiful island. Beside our research plans (reflecting the last year and planning of the next years), we also discussed teaching ...


Read more ...