IIT Madras · Computer Science

Multimodal Interaction

Dr.-Ing. Stefan Hillmann, Prof. Dr.-Ing.Sebastian Moller · 56 free video lectures

56 video lectures. Topics: Introduction; Medium vs. Modality; Multimedia and Multimodality; Modality Relations; Characteristics of Multimodal Systems; Introduction.; Speech Production; Hearing - Ear; Hearing - Perception; Introduction..; The Human Eye; Gestlat Perception; Resolution and…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Introduction
  2. Medium vs. Modality
  3. Multimedia and Multimodality
  4. Modality Relations
  5. Characteristics of Multimodal Systems
  6. Introduction.
  7. Speech Production
  8. Hearing - Ear
  9. Hearing - Perception
  10. Introduction..
  11. The Human Eye
  12. Gestlat Perception
  13. Resolution and Sensitivity
  14. Depth Perception
  15. Reading
  16. Introduction....
  17. Haptics
  18. Smell
  19. Taste
  20. Memory
  21. Motorsystem
  22. Introduction......
  23. Processing Multiple Signals
  24. Multimodal Dual-Tasks
  25. Effects of Discongurent Signals
  26. Relevance
  27. Introduction 1
  28. Introduction 2
  29. Gesture to Space
  30. Turn Taking
  31. Conclusion
  32. Introduction.......
  33. Overview
  34. Automatic Speech Recognition
  35. Emotion Recognition
  36. Text Recognition
  37. Introduction1
  38. Icons
  39. Text Generation
  40. Text to Speech
  41. Speech Generation
  42. Introduction .
  43. Multimodal Interactive Systems Development
  44. Introduction . .
  45. Virtual Reality
  46. Introduction to Audio for Virtual Reality
  47. Spatial Hearing
  48. Dummy Heads
  49. Individuality of HRTFs
  50. Sterophony
  51. Crosstalk Cancelation
  52. Ambisonics
  53. Sound Field Synthesis
  54. Challenges with Projection-based Systems
  55. Capturing of Sound Scenes
  56. Closing Remarks

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Madras.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights