SignalProcessingAndInformationTheory
This is a class for the Bachelor of Science in Bioinformatics. The course is in English, so this page is in that language
Schedule, location and links
 Tuesday and Friday from 11:00 until 13:00 (or 14:00 on Friday)
 Classroom Psicologia II, Fisiologia Generale e Antropologia Farmacia e Medicina (CU026, E01PS1L084)
 Zoom link for remote access to the lessons
 https://uniroma1.zoom.us/j/7116614527?pwd=b0VNQ0FyZVNCK29vSGRCdjh6VFZYUT09 (or as otherwise advertized)
 Google classroom link, to be used as a communication and storage tool
 code esr6xyn  please subscribe with this code
 link https://classroom.google.com/c/NDc1NzU1NDMyMTk5?cjc=esr6xyn
 there you can find the full course description, the program, the bibliography, and the link to the ongoing translation of the reference book
End of course summary
We spent three months deepening the subject of study, and the available contents are summarized below
Topics  slide  video 
Course Overview  link  1 

Signals and Systems  link  1 
Fourier series and signals space  link  1, 2 
Fourier transform and convolution  link  1, 2, 3, 4 
Sampling and digital signal processing  link  1, 2, 3 
Analog and numeric filters  chapter  1, 2 
Random signals, correlation, Wiener's theorem and signal statistics  chapter  2 
Information Theory  chapter  2 
Signal Processing over Graphs  link  1, 2, 3, 4 
Intermediate tests  1st, 2nd, 3rd 
Progress of individual lessons
 tue 8/3, fry 11/3  Course Overview: After the illustration of the telematic tools of reference for the course, we introduce ourselves to each other. This is followed by a brief introduction on the nature of signals and their processing, in order to provide an overview of the objects we will deal with. In accordance with what I had proposed to myself, some applicative aspects of signal processing and information theory to biological, medical, genetic, microscopic and structural contexts are then outlined, up to mentioning the most recent applications. But, really, don't be afraid of this, I just wanted to arouse the curiosity to study signal processing, at least to understand everything you can't understand about more advanced topics yet!
 link to the 1^{st} slide set Course Overview
 link to the video registration  Sorry, only the first part of 11/3 was recorded  and my English is orrible!
 fry 11/3, tue 15/3, fry 18/3  Signals and Systems: This series of slides covers the contents of chapter 1 in the Signal Basics book (but ask me for the access credentials). After a brief introduction on signals (co)domains, on the Fourier analysis family and on the relationships between impulse response, convolution, frequency response and filtering, different classes of signals are defined, on the basis of their behaviour over time and asymptotic, and some notes are given on common operations performed on signals, their combination, and graphics. The exposition continues by illustrating the more commonly used signals, followed by a review of complex algebra, and the role of complex exponential in frequency analysis. Since signal processing is typically implemented as the transit of the signal itself through a linear operator, the characteristics of the latter are exposed, in contrast to those of nonlinear processing units.
 link to the 2^{nd} slide set Signals and Systems
 link to the video registration  I changed settings, now video is better, but audio worse

 fry 18/3  Fourier series and signals space  1^{st} part: After an introduction to phasors notation, the representation of periodic signals as an ordered set of Fourier coefficients is given, together with their reconstruction formula known as Fourier series. Then the alternative representations for real signals are given.
 link to the 3^{rd} slide set Fourier series and signals space
 link to the video registration  Finally a good audio and video, we also have the blackboard!
 tue 22/3  Fourier series and signals space  2^{nd} part: Exposition continues with the effects of using only a limited set of coefficients. This section closes with the proof of the Parseval’s theorem which gives a typical effect of the exponentials orthogonality property. The second part of this series of slides deals with the concepts of vector algebra when applied to signal spaces and, with the excuses of motivating the expression of the Fourier series, we take a guided tour through notions as the basis of representation of a vector space, the norm of a vector.
 link to the video registration  Audio had a whistle and the classroom camera refused to work, so there is no blackboard visible. In the middle the classroom computer has hang, I had to reboot it. Next time I will bring a spare webcam from home, or maybe a tablet.
 fry 25/3  end of Signals space. Fourier transform and convolution begins, 1^{st} part. After introduction to inner product spaces and Schwartz inequality, its application to the spaces of periodic, energy and power signals are shown by definition of the inner product formula for these spaces. The properties of signals are put in relation with definitions for metric spaces. Furthermore, its shown how any linear transformation is the result of an inner product, and that many signal processing results fall into this case. Finally, the concept of vector space is applied to linear operators, thus arriving to the notion of dual space. The extension of Fourier series analysis to nonperiodic signals is then introduced, the Fourier transform defined as well as the antitransform, and the relationship in between Fourier series and the transform of a period. Concepts of Cross energy, Orthogonality and Schwartz inequality are given, as well Parseval’s theorem for energy signals
 link to the 4^{th} slide set: Fourier transform and convolution
 link to the video registration  It was me who last time has failed to make the classroom cam to work, today it worked fine. The lesson is in Italian, as foreigners are no more following the course. Next lessons will be in Italian too.
 tue 29/3  Fourier transform and convolution  2^{nd} part: After the definition of Energy density, a first list of properties for the Fourier transform are proved, namely linearity and conjugate symmetry, duality, initial (or in the origin) value and area, time and frequency shift, conjugation and change of scale. Then the Dirac impulse is defined, along with the transform of a constant, and of periodic signals.
 link to the video registration  Today you can finally ear the superb audio quality obtained by using my new radio microphone, I must remember to select it in the Zoom's settings, otherwise it uses the one from the pc. Oh well, the quality of a video, it's more than 50% the quality of its audio!
 fry 1/4/  Fourier transform and convolution  3^{rd} part: Sampling and sifting properties of the Dirac impulse, definition of Impulse response and of Convolution. Its commutative property, graphical construction and memory function. Convolution with a translated impulse. How convolution and multiplication are related. Frequency multiplication or filtering, Frequency response and its measure, Linear phase and delay, Cascaded systems, Transform of a triangle.
 link to the video registration  Today I forgot my USB Webcam, so the one of my laptop was used, with a little worse image quality and worse screen perspective
 tue 5/4  First intermediate evaluation test  This should be done in presence, but we have been advised that the classroom will not be usable due to an antifire refurbishment.
 fri 8/4  Fourier transform and convolution  4^{th} part: Example of relationship between frequency and impulse response with the help of dfilter, intro to decibel (in the video), frequency convolution i.e. modulation and windowing. Spectral resolution and leakage. Short time frequency analysis. Fourier transform of derivated and integrated signals. Definition of a pulse train and its Fourier transform. Periodic signal transform, revisited.
 link to the video registration  The last half an hour is missing, but for the rest quality is great, with a lot of practical examples
 link to Octave code with which examples of execution are implemented as computer proof of the topic dealt with in theory. For details, read the Esercitazioni.pdf file. If someone can verify its compatibility with Matlab (TM) it will be fantastic, maybe it can be a means to make up for the lack of participation in the first evaluation test
 tue 12/4  Sampling and digital signal processing 1^{st} part: We have shown how a limited bandwidth signal can be fully described by knowing only its samples, if taken at a sufficiently high rate. Insights were given on the consequences of noncompliance with the requirements, as well as how to guarantee them. At last, implementation aspects such as A/D were addressed
 link to the 5^{th} slide set: Sampling and digital signal processing
 link to the video registration  Today I found the cells of my radiomicrophone discharged, maybe I left it "on" last time? Hoping that after Easter we will be more numerous, today we was only two. I think that the possibility for you to pose questions is important!
 fry 22/4  Sampling and digital signal processing 2^{nd} part: We have discussed the different types of Fourier analysis for the digital domain, such as DTFT for indefinite sequences, or DTF and its inverse in the temporally limited (or periodic) case. The description of the DTFT as calculated on a unitary circle opens the door to the definition of the zeta transform. Finally, a brief excursus on the topic of genomic signal processing has been started.
 link to the video registration
 Additional material on Genomic Signal Processing
 P. Ramachandran, A. Antoniou, Genomic Digital Signal Processing (slides)
 D. Anastassiou, Genomic Signal Processing (2001)
 A collection of papers with wide coverage Genomic Signal Processing (2004)
 tue 26/5  Sampling and digital signal processing 3^{rd} part: we completed the discussion on the applications of DFT to genome and protein sequences, including how to interpret the DFT as a filter bank. Then, we begin to tackle the implementation of digital filters, starting with batch processing performed as a product in frequency, and highlighting the details on discrete and circular convolution, and the convolution between infinite sequences and a numerical impulse response
 link to the video registration
 at the end we run two Octave scripts, filtra_audio2.m e filtra_audio2_conv.m from directory https://teoriadeisegnali.it/story/pub/stud/script/test/, or better download this zip file for the audio files too
 fry 29/4  Analog and numeric filters 1^{st} part: After having talked a lot about filters, some words about them! Characterization and types of analog filters, linear phase, digital filters, transversal filter or FIR, Analysis, Synthesis and Approximation. Numerical realization of the transversal filter. Moving average, Highpass or bandpass, First order FIR filter, Differentiator, Comb. First order (IIR) filter, Applications, EMA.
 OPIS survey  Please fill it as described here (Italian) or there (English) and when (if) prompted enter the code XEZW9RBR
 link to the Analog and numeric filters chapter  I no longer have time to prepare a set of slides, so from now on I will use the pages of the translated book directly
 link to the video registration
 we also ran the distfase.m Octave script, for the analysis of phase distortion
 link to some video about spectroscopy (1) (2) (3) which is a form of first order FIR filter; see again pages 3234 of the first slide set on Fourier Transform Infrared (FTIR) spectroscopy
 tue 3/5  Second intermediate evaluation test  This has been done in presence.
 fry 6/5  Analog and numeric filters  2^{nd} part: Numeric filters, FIR synthesis starting from the continuous time description, Zeta transform and filtering, Filters with finite and infinite impulse response, Architecture with a direct and canonical form. Random signals, correlation, Wiener's theorem and signal statistics  1^{st} part: Random variables, Probability density, Histogram, Expected value, moment and central moment, Multivariate random variable
 link to the Random signals (...etc) chapter
 link to the video registration
 rewiew of FTIR spectroscopy and of Genomic Signal Processing by filtering. We played a bit with the poles and zeros positions of numerical filters with the aid of Falstad's tool.
 Some additional material: poles and zeros position, a 4 hundred page book about signal processing
 10/5  Random signals, correlation, Wiener's theorem and signal statistics  2^{nd} part: Stationary and ergodic processes, Correlation, covariance and autocorrelation, Correlation of an ergodic stationary process, Autocorrelation and intercorrelation of deterministic signals, Properties, Wiener’s theorem
 Sorry, there is no video recording this time, simply I forgot to start it
 Additional material about the use of signal correlation in biology
 13/5  Random signals, correlation, Wiener's theorem and signal statistics, 3^{rd} part: Autocorrelation function for a Periodic signal and a Bandlimited white Gaussian process, Multidimensional Gaussian, Statistical independence for uncorrelated Gaussians r.v., Gaussian process. Spectral estimation, Periodogram and Autoregressive spectral estimate (hints). Pearson correlation coefficient. Information Theory, 1^{st} part: Sorgente discreta senza memoria e sua entropia, sorgente binaria ed Laria, Sorgente discreta con memoria e Markoviana, Entropia differenziale di sorgente continua e di sorgente gaussiana.
 link to the Information Theory chapter  At the moment I haven't translated it yet, I will
 Link to the video registration  Damn, after about two hours the cells of the wireless microphone are exhausted, so the last 1/3 (on information theory) is silent
 passages of the demonstration that an incorrelated multidimensional Gaussian p.d.f. has statistically independent marginal r.v.
 we also ran the filtra_gauss.m Octave script, showing that a filter witha gaussian input process has an output process which is gaussian too
 17/5  Information Theory, 2^{nd} part: Misure di informazione per una coppia di v.a.: Entropia congiunta e condizionata, Informazione mutua media. Equivocazione e noise entropy. Capacità di canale discreto. Application of information theory to biochemical signaling systems.
 Link to the video registration  Damn, the audio is perfect this time, but I forgot to point the second cam at the blackboard. If only there was someone remotely following, this wouldn't happen!
 Additional material about the use of information theory in biology (more here)
 The application of information theory to biochemical signaling systems (2012) <== strongly recommended reading
 Analysis of cellular signal transduction from an information theoretic approach (2016
 Information theory and signal transduction systems: From molecular information processing to network inference (2014)
 Accurate information transmission through dynamic biochemical signaling networks (2014)
 Concepts and Applications of Information Theory to ImmunoOncology (2021)
 A table of the codon's probability (also on Wikipedia)
 Alternatives for DNA coding region detections, including mutual information
 20/5  Signal Processing over Graphs, 1^{st} part: these last lessons are held by Prof Stefania Sardellitti. Introduction to Graph Signal Processing (GSP), Basic tools from Graph Theory, Laplacian, eigenvalues, quadratic form.
 Link to the video registration  This time I forgot the radio microphone closed until 31:33, before there was only the poor fixed microphone. But I managed to follow the teacher with the cam
 Link to the slides
 24/5  Signal Processing over Graphs, 2^{nd} part (Prof. Sardellitti): Constant eingenvector for the null eingenvalue, multiplicity of the latter and connected graph components. Graph Signals: gene expression level, vehicular traffic intensity, electrocorticography signals. Graph signals on time and space domains. Spectral Graph Theory. Graphshift operator, Graph Fourier Transform, a cyclic graph gives a DFT, Parseval equality, graph frequency domain. Graph Total Variation, eigenvalues as frequencies. Smooth signals defined on a graph are said to be bandlimited, i.e. when its GFT ŝ is sparse.
 Link to the video registration  This time I outdid myself, I forgot to start recording up to the last 10 minutes of two hours of invaluable teaching!
 Possible reads about GSP applications
 Web tools to explore MetaboAnalyst and OmicsNet
 W. Wang et al, Gene selection for cancer detection using graph signal processing, Informatics in Medicine Unlocked, Vol 25, 2021
 27/5  Signal Processing over Graphs, 3^{rd} part (Prof. Sardellitti): Graph Fourier basis for directed graphs, Graph Sampling Theory for bandlimited signals: vertexlimiting and bandlimiting operators, Perfect localization conditions, recovery of a graph signal from a subset of verticies. Topology inference from data, application to Electrocorticography signals.
 Link to the video registration  Today everything worked perfectly!
 Repositories about biological interaction dataset: BioGrid (paper), National Center for Biotechnology Information or NCBI, Pathway Commons, wikipedia category for Biological databases
 31/5  Signal Processing over Graphs, 4^{th} part (Prof. Sardellitti): Graph Signal Filtering, FIR graph filter, Frequency response of FIR filters. Cancer subtype classification, Distinguishing power. Topological signal processing: simplicial complexes, cell complexes
 Link to the video registration  Today everything worked perfectly!
 3/6  Third intermediate evaluation test
 test trace and solutions