Real Time Signal Processing - 5PMSTST5

Goal(s)

• Understand the concept of a "real-time system" (RT), which is a system whose execution must meet a temporal constraint (deadline).
• Know different theoretical models for designing an RT system.
• Be aware of the various choices to be made for the design of an RT system (hardware, OS, API, multithreading, etc.).
• Understand the fundamentals of audio processing on a PC and know some best practices for implementing a real-time audio application on a standard (i.e., non-real-time) OS.
• Know different principles and techniques used for real-time signal processing (frame processing, overlap-add, circular buffer, etc.).
• Implement a real-time audio application in practice.

Content(s)

• Lecture:
  • Definition(s) of a "real-time system", classification of RT systems (hard/soft, safe-critical, etc.).
  • Theoretical models: synchronous/scheduled, time-triggered/event-based model
  • Hardware aspects (DSP, GPU, etc.)
  • Operating systems (Real-time OS temps-réel vs. Standard OS, etc.)
  • Common implementation issues in real-time audio programming on standard OS - (preemption, scheduling strategies, context switching, priority inversion, memory allocation, etc.)
  • Specific aspects of real-time signal processing (circular buffering, overlap-add, etc.)

• Lab work: Implementation of a real-time autotune effect (and other audio effects)

Signal processing, operating systems (basic knowledges), C/Python