Linear Systems: Basic Definitions
Direct Proportionality As Example
Special Cases Of Linear Systems
Eigenvectors And Eigenvalues
The Spectral Theorem And Finding A Basis Of Eigenvectors
Matrix Multiplication = Only Example Of Finite Dimensional Linear Systems
Integration Against A Kernel Generalizing Matrix Multiplication
Example: The Fourier Transform
Osgood, Brad G
Osgood is a mathematician by training and applies techniques from analysis and geometry to various engineering problems. He is interested in problems in imaging, pattern recognition, and signal processing.
Some homework problem may require the Sinesum2 Matlab Software, see Software below.
Assignment | Questions | Solutions | Due Date | Additional Files |
---|---|---|---|---|
Problem Set 1 | Questions | Solutions | Lecture 5 | |
Problem Set 2 | Questions | Solutions | Lecture 8 | |
Problem Set 3 | Questions | Solutions | Lecture 11 | |
Problem Set 4 | Questions | Solutions | Lecture 14 | scramble.wav sound file |
Problem Set 5 | Questions | Solutions | Lecture 17 | identme.txt Matlab file transferfcn_m.txt file |
Problem Set 6 | Questions | Solutions | Lecture 20 | man.gif |
Problem Set 7 | Questions | Solutions | Lecture 23 | anti-aliasing.zip |
Problem Set 8 | Questions | Solutions | Lecture 26 | |
Problem Set 9 | Questions | Solutions | Lecture 29 | dog.jpg LP Filter |
Practice Midterm | Questions and Solutions |
Midterm | Questions and Solutions |
Final | Questions and Solutions |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 52 min | |
Topics: Previous Knowledge Recommended (Matlab), The Fourier Series, Analysis V. Synthesis, Periodic Phenomena And The Fourier Series -Periodicity In Time And Space -Reciprocal Relationship Between Domains, The Reciprocal Relationship Between Frequency And Wavelength |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 53 min | |
Topics: Periodicity; How Sine And Cosine Can Be Used To Model More Complex Functions, Example Of Periodizing A Signal, Discussion Of How To Model Signals With Sinusoids, "One Period, Many Frequencies" Idea In Modeling Signals, Modeling A Signal As The Sum Of Modified Sinusoids (Formula), Complex Exponential Notation, Symmetry Property Of The Complex Coefficients In The Fourier Series, Discussion Of The Generality Of The Fourier Series Representation For Modeling A Periodic Function |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 51 min | |
Topics: Summary Of Previous Lecture (Analyzing General Periodic Phenomena As A Sum Of Simple Periodic Phenomena), Fourier Coefficients; Discussion Of How General The Fourier Series Can Be (Examples Of Discontinuous Signals), Discontinuity And Its Impact On The Generality Of The Fourier Series, Infinite Sums To Represent More General Periodic Signals, Summary Of Convergence Issues, Convergence: Continuous Case, Smooth Case (Fourier Series Converges To The Signal), Convergence: Jump Discontinuity, Convergence: General Case (Convergence On Average/ In Mean/ In Energy) |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 52 min | |
Topics: Wrapping Up Fourier Series; Making Sense Of Infinite Sums And Convergence, Integrability Of A Function (Implies Existence Of Fourier Coefficients, Convergence), Orthogonality Of Complex Exponentials (Review), The Inner Product, Norm Of F Related To The Inner Product (+ Pythagorean Theorem), Complex Exponentials As Orthonormal Functions, Fourier Coefficients As Projections Onto Complex Exponentials, Rayleigh's Identity, Application Of Fourier Series To Heat Flow |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 52 min | |
Topics: Continued Discussion Of Fourier Series And The Heat Equation, Transition From Fourier Series To Fourier Transforms (Periodic To Nonperiodic Phenomena), Fourier Series Analysis And Synthesis; Relation To Fourier Transform And Inverse Fourier Transform, Fourier Series/ Coefficients With Period T, Spectrum Picture For Fourier Series With Period T, Effects Of A Change In T, The Complications Of Finding The Fourier Transform By Letting T Go To Infinity (Fourier Coefficients Go To 0) |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 48 min | |
Topics: Correction To Heat Equation Discussion, Setup For Fourier Transform Derivation From Fourier Series, Results Of The Derivation: Fourier Transform And Inverse Fourier Transform, Definition Of The Fourier Transform (Analysis), Definition Of Fourier Inversion (Synthesis), Major Secret Of The Universe: Every Signal Has A Spectrum, Which Determines The Signal, Fourier Notation, Example: Rect Function, Example: Triangle Function |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 48 min | |
Topics: Review Of Fourier Transform (And Inverse) Definitions, Notation, Review Of Rect And Triangle Transforms, Example: Fourier Transform Of A Gaussian, The Duality Property Of The Fourier Transform, Example Of An Application Of The Duality Property |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 51 min | |
Topics: Effect On Fourier Transform Of Shifting A Signal, Resulting Delay Formula (Shift Theorem), Effect Of Scaling The Time Signal, Stretch Theorem Formula/ Interpretation, Convolution In Context Of Fourier Transforms; Multiplying Two Signals In Frequency, Resulting Convolution Formula |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 54 min | |
Topics: Continuing Convolution: Review Of The Formula, Situiation In Which It Arose, Example Of Convolution: Filtering, The Ideas Behind Filtering, Terminology, Interpreting Convolution In The Time Domain, General Properties Of Convolution In The Time Domain, Derivative Theorem For Fourier Transforms, Heat Equation On An Infinite Rod |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 55 min | |
Topics: Central Limit Theorem And Convolution; Main Idea, Introduction, Normalization Of The Gaussian, The Gaussian In Probability; Pictorial Demonstration With Convolution, The Setup For The CLT, Key Result: Distribution Of Sums And Convolution (With Proof), Other Assumptions Needed To Set Up CLT, Statement Of The Central Limit Theorem, Using The Fourier Transform To Prove The CLT |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 51 min | |
Topics: Correction To The End Of The CLT Proof, Discussion Of The Convergence Of Integrals; Approaches To Making A More Robust Definition Of The Fourier Transform, Examples Of Problematic Signals, How To Approach Solving The Problem; Choosing Basic Phenomena To Use To Explain Others, Identifying The Best Class Of Signals For Fourier Transforms; + Their Properties, The Definition Of The Class Of Rapidly Decreasing Functions, Rationale For Why These Properties Are Used (Derivative Theorem, Parseval's) |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 53 min | |
Topics: Cop Story, Review Of Rapidly Decreasing Functions, Generalized Functions (Distributions) (Delta Function, Etc.), Viewing Delta As A Limit V. Operationally, Definition Of A Distribution, Delta As A Distribution, Discussion Of How To Consider Ordinary Functions In This Space; Pairing Through Integration |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 49 min | |
Topics: Setting Up The Fourier Transform Of A Distribution, Example Of Delta As A Distribution, Distributions Induced By Functions (Includes Many Functions), The Fourier Transform Of A Distribution, The Class Of Tempered Distributions, FT Of A Tempered Distribution, Definition Of The Fourier Transform (By How It Operates On A Test Function), The Inverse Fourier Transform (Proof), Calculations Of Fourier Transforms Using This Definition (Distributions) |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 54 min | |
Topics: Derivative Of A Distribution, Example: Derivative Of A Unit Step, Example: Derivative Of Sgn(X), Applications To The Fourier Transform (Using The Derivative Theorem), Caveat To Distributions: Multiplying Distributions, Distributions*Functions, Special Case: The Delta Function And Sampling, Convolution In Distributions, Special Case: Convolution When T = Delta, The Scaling Property Of Delta |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 52 min | |
Topics: Application Of The Fourier Transform: Diffraction: Setup, Representation Of Electric Field, Approach Using Huyghens' Principle, Discussion Of The Phase Change Associated With Different Paths, Use Of The Fraunhofer Approximation, Aperture Function, Result; In General And For Single/ Double Slits |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 50 min | |
Topics: More On Results From Last Lecture (Diffraction Patterns And The Fourier Transforms), Setup For Crystallography Discussion (History, Concepts), 1-Dimensional Version, The Fourier Transform Of The Shah Function, Trick: Poisson Summation Formula, Proof Of The Poisson Summation Formula, Fourier Transform Of The Shah Function: Result, Fourier Transform Of The Shah Function With Spacing P, Application To Crystals |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 41 min | |
Topics: Review Of Main Properties Of The Shah Function, Setup For The Interpolation Problem, Bandwidth Assumption, Solving For Exact Interpolation For Bandlimited Signals, Periodizing The Signal By Convolution With The Shah Function, Solution Of The Interpolation Problem |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 51 min | |
Topics: Review Of Sampling And Interpolation Results, Terminology: Sampling Rate, Nyquist Rate, Issues With The Interpolation Formula In Practical Applications, Aliasing And Interpolation, Main Argument In Aliasing, Example Of Aliasing: Cosine |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 52 min | |
Topics: Aliasing Demonstration With Music, Transition To Discrete! The DFT, The Plan For Transitioning To Discrete Time, Creating A Discrete Signal From F(T) Creating A Discrete Version Of The Fourier Transform Of The Sampled Version Of F(T), Summary Of What We Just Did, Summary Of Results (Formulas), Moving From Continuous To Discrete Variables, Final Result: The DFT |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 53 min | |
Topics: Review: Definition Of The DFT, Sample Points, Relationship Between N And Spacing In Time/Frequency, Complex Exponentials In The Discrete DFT, DFT Written With Discrete Complex Exponential Vector, Periodicity Of Inputs And Outputs In The DFT (More On This In Next Lecture), Orthogonality Of The Vector Of Discrete Complex Exponentials, Note On Orthonormality Of Discrete Complex Exponential Vector (Or Lack Thereof), Consequence Of Orthogonality: Inverse DFT |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 53 min | |
Topics: Review Of Basic DFT Definitions, Special Case: Value Of The DFT At 0, Two Special Signals: One Vector, Delta Vector, DFT Of Deltas, Complex Exponentials, DFT As Nxn Matrix Multiplication, Periodicity Of Input/Output Signals In The DFT, Result Of Periodicity: Indexing, Result Of Periodicity: Duality |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 51 min | |
Topics: FFT Algorithm: Setup: DFT Matrix Notation, One Intuition Behind FFT: Factoring Matrix, Our Approach: Split Order N Into Two Order N/2, Iterate, Notation (To Keep Track Of Powers Of Complex Exponentials), Plugging New Notation Into DFT; Split Into Even And Odd Indices, Result For Indices 0 To N/2-1, Result For Indices N/2 To N-1, Summary Of Results (DFT As Combination Of 2 Half Order Dfts) |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 57 min | |
Topics: Review Of Last Lecture: Discrete V. Continuous Linear Systems, Cascading Linear Systems, Derivation Of The Impulse Response, Schwarz Kernel Theorem, Example: Impulse Response For Fourier Transform, Example: Switch, Special Case: Convolution, Time Invariance, Result: If A System Is Given By Convolution, It Is Time Invariant; Converse True As Well, Two Main Ideas Sumarized (Linear->Integration Against Kernel, Time Invariant If Given By Convolution) |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 53 min | |
Topics: Review Of Last Lecture: LTI Systems And Convolution, Comment On Time Invariant Discrete Systems, The Fourier Transform For LTI Systems; Complex Exponentials As Eigenfunctions, Discussion Of Sine And Cosine V. Complex Exponentials As Eigenfunctions (Generally They Are Not), Discrete Version (Discrete Complex Exponentials Are Eigenvectors), Discrete Results From A Matrix Perspective |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 54 min | |
Topics: Approaching The Higher Dimensional Fourier Transform, Notation: Thinking In Terms Of Vectors, Definition Of The Higher Dimensional Fourier Transform, Inverse Fourier Transform, Reciprocal Relationship Between Spatial And Frequency Domain, One Dimensional Case: Reciprocal Relationship, 2-D Case: Visualizing Higher Dimensional Complex Exponentials, Results: Visualizing 2-D Complex Exponentials |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 50 min | |
Topics: Higher Dimensional Fourier Transforms- Review, Fourier Transforms Of Seperable Functions (Ex: 2-D Rect), Result: Formula For Fourier Transform Of A Seperable Function, Example: 2-D Gaussian, Radial Functions, Proof That The Fourier Transform Of A Radial Function Is Also Radial, Convolution In Higher Dimensions |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 49 min | |
Topics: Shift Theorem In Higher Dimensions, Shift Theorem: Result, Stretch Theorem Derivation, Stretch Theorem Result, Special Case: Scaling, Special Case: Rotation, What Reciprocal Means In Higher Dimensions (Inverse Transpose), Deltas In Higher Dimensions (Basic Properties, Scaling) |
Watch Online: |
Download:
Right Click, and Save As
|
Duration: | |
Watch Now | Download | 50 min | |
Topics: Shahs, Lattices, And Crystallography, 2-D Shah, Crystals As Lattices, The Fourier Transform Of The Shah Function Of An Oblique Lattice, Relation To Crystals; Notation, Concepts, And Results, Application To Medical Imaging: Tomography |