|
COPYRIGHT NOTICE
This material is presented to ensure timely dissemination of scholarly
and technical work. Copyright and all rights therein are retained
by authors or by other copyright holders. All persons copying
this information are expected to adhere to the terms and constraints
invoked by each author's copyright. These works may not be reposted
without the explicit permission of the copyright holder. |
|
|
Special Topics on Digital Signal Processing |
Master
level |
No.
of credits: 7 |
Textbooks: |
Sayed, A.H., Fundamentals of Adaptive Filtering, Wiley, 2003
Haykin, S., Adaptive
Filter Theory, 4/E, Prentice-Hall, 2001
J.C. Principe et al., Neural
and Adaptive Systems, Wiley, 2000 |
|
Tutorials: |
Linear adaptive filtering (Chapter 3 from
my DSP book, in Romanian)
Introduction
to Artificial Neural Networks (Chapter 1 from
my ANN book, in Romanian) |
|
|
General
description |
The main themes of the course are related
to linear and nonlinear adaptive filtering, multirate analysis using wavelet transforms, and compression algorithms. Applications include pattern recognition, data transmission channel equalization and analog
decoding, biomedical signals analysis and compression, biometrics.
Special focus is placed on implementation aspects, including quantization effects, floating-point to fixed-point conversion, and algorithmic transformations (pipeline, retiming). Software support is provided by MATLAB/Simulink and NeuroSolutions neural
networks simulator. |
Course outline |
Lecture 1:
More info: 1
Lab 1 |
General introduction
to adaptive linear filtering
Optimal
filtering problem and Wiener solution. Definition and characterization
of random processes
Classification criteria of adaptive
algorithms. Cost functions.
Applications of linear adaptive filters. |
Lecture 2:
Lab 2  |
First order
adaptive algorithms: gradient descent, Newton algorithm.
Case studies: linear prediction, system identification. |
Lecture 3:
More info: 1, 2, 3
Lab 3   |
LMS algorithm and its variants.
Adaptive
filtering in the frequency domain.
Case studies: channel equalization, linear prediction, noise cancellation. |
Homework 1 |
Adaptive channel equalization using the LMS algorithm.
theoretical background | homework | M_files |
|
Least-Squares (LS) algorithm. Recurrent Least-Squares (RLS) algorithm.
General introduction to Kalman filters. |
Lecture 5:  |
General introduction
to Artificial Neural Networks (ANN's).
Motivations for studying ANN's. Definition and classification criteria
for ANN's.
Applications of ANN's. |
Lecture 6:  |
Multilayer perceptron
(MLP).
Standard backpropagation training
algorithm.
Variants of backpropagation algorithm. |
Lecture 7:
More info: 1, 2 |
Multirate signal processing: Interpolation and decimation.
Continuous and discrete wavelet transform.
Case study: ECG signal analysis - QRS complex detection.
|
Lectures 8-9:
More info: 1 |
Data compression algorithms.
General introduction to compressed sensing.
Case study: ECG signal compression. |
Homework 2 : |
Face recognition using PCA algorithm.
theoretical background | homework | M_files |
Lectures 10-11: |
Implementation of DSP algorithms: finite precision effects, floating to fixed-point conversion.
Algorithmic transformations: pipeline, retiming.
|
Lectures 12-13:  |
Applications of artificial neural networks: pattern recognition, channel equalization, digital filter design.
General introduction to biometrics and face recognition. |
Lecture 14: |
Course review. Q&A. |
|