Introduction to Deep Learning

Learn how deep learning algorithms can be used to solve important engineering problems.

There is one session available:

After a course session ends, it will be archived.
Estimated 16 weeks
6–9 hours per week
Instructor-led on a course schedule

About this course

Skip About this course

This 3-credit-hour, 16-week course covers the fundamentals of deep learning. Students will gain a principled understanding of the motivation, justification, and design considerations of the deep neural network approach to machine learning and will complete hands-on projects using TensorFlow and Keras.

At a glance

  • Institution: PurdueX
  • Subject: Engineering
  • Level: Advanced
  • Prerequisites:

    Knowledge of probabilistic methods in electrical and computer engineering (ECE 302 at Purdue) and undergraduate linear algebra.

  • Language: English

What you'll learn

Skip What you'll learn
  • Justify the development state-of-the-art deep learning algorithms.
  • Make design choices regarding the construction of deep learning algorithms.
  • Implement, optimize and tune state-of-the-art deep neural network architectures.
  • Identify and address the security aspects of state-of-the-art deep learning algorithms.
  • Examine open research problems in deep learning and propose approaches in the literature to tackle them.

Module 1: Introduction to Deep Feedforward Networks

    • Gradient-based learning
    • Sigmoidal output units
    • Back propagation

Module 2: Regularization for Deep Learning

    • Regularization strategies
    • Noise injection
    • Ensemble methods
    • Dropout

Module 3: Optimization for Training Deep Models

    • Optimization algorithms: Gradient, Hessian-Free, Newton
    • Momentum
    • Batch normalization

Module 4: Convolutional Neural Networks

    • Convolutional kernels
    • Downsampled convolution
    • Zero padding
    • Backpropagating convolution

Module 5: Recurrent Neural Networks

    • Recurrence relationship & recurrent networks
    • Long short-term memory (LSTM)
    • Back propagation through time (BPTT)
    • Gated and simple recurrent units
    • Neural Turing machine (NTM)

About the instructors

Who can take this course?

Unfortunately, learners from one or more of the following countries or regions will not be able to register for this course: Iran, Cuba and the Crimea region of Ukraine. While edX has sought licenses from the U.S. Office of Foreign Assets Control (OFAC) to offer our courses to learners in these countries and regions, the licenses we have received are not broad enough to allow us to offer this course in all locations. edX truly regrets that U.S. sanctions prevent us from offering all of our courses to everyone, no matter where they live.