Speaking – writing – visualizing. Forms, functions and disturbances of modality interdependencies and concept genesis’ in professional interactions

Professional verbal interaction settings (e.g. team meetings) are often characterized by modality interdependencies (MID) – the combination of modalities such as speaking, writing, visualizing. In the project, we investigate MID in professional cross-situational interaction settings with cooperative concept genesis (industrial process modelling). The research aim is the development of approaches, methods and tools for the systematic description and analysis of MID forms and functions. The tool development objective is an annotation tool that allows to annotate different data and file formats (audio, text, drawings; .txt, .jpg, .mpg) at various levels, to relate annotation levels and entries independent from the given file format, and to visualise patterns of relations.



  • Ullrich, Anna Valentine/Jakobs, Eva-Maria (2019): Funktionen von Modalitätsinterpendenzen in professionellen Interaktionen. In: Linguistik online 95 (2), 109–127. DOI:



  • Trevisan, Bianka/Reimer, Eva/Digmayer, Claas/Ullrich, Anna Valentine/Jakobs, Eva-Maria (2016): Digital Humanities und Linguistik. Herausforderungen und ihre Potentiale am Beispiel der Annotation multimodaler Daten. In: Konferenzabstracts der 3. Tagung des Verbands Digital Humanities im deutschsprachigen Raum e.V. 2016 (DHd). ISBN: 978-3-941379-05-3
  • Ullrich, Anna Valentine/Jakobs, Eva-Maria/Eraßme, Denise (2016): „ich schreib das mal hier rein ähm“. Modality-taking – Schreibhinweise in professionellen mündlichen Interaktionssituationen. In: Roelcke, Thorsten von/Kelih, Emmerich, Köhler, Reinhard (Hrsg.): Glottotheory - International Journal of Theoretical Linguistics, Bd. 7 (1), 67–88. DOI:


  • Eraßme, Denise/Trevisan, Bianka/Reimer, Eva/Jakobs, Eva-Maria (2015): Kooperative Konzeptgenese in professionellen Interaktionen. Posterbeitrag. Journal of Multimodal Communication Studies, 1-2, 2015 Poster: Abstract:
  • Reimer, Eva/Trevisan, Bianka/Eraßme, Denise/Schmidt, Thomas/Jakobs, Eva-Maria (2015): Annotating Modality Interdependencies. In: Proceedings of the International Conference of the German Society of Computational Linguistics and Language Technology, 30.09.-02.10.2015, Duisburg/Essen (DEU), 110–111. DOI:

Sponsored Volume: 352.584 Euro (Aachen)

Duration: 01.04.2014 - 13.02.2018


RWTH Aachen