Skip to main content

DelftX: AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning

Learn the fundamentals and principal AI concepts about clustering, dimensionality reduction, reinforcement learning and deep learning to solve real-life problems.

AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning
6 weeks
4–6 hours per week
Self-paced
Progress at your own speed
Free
Optional upgrade available

There is one session available:

After a course session ends, it will be archivedOpens in a new tab.
Starts Feb 26
Ends Mar 26

About this course

Skip About this course

In this course you will learn the basics of several machine learning topics to help you solve real life challenges. Unsupervised learning techniques such as clustering and dimensionality reduction are useful to make sense of large and/or high dimensional datasets that are not annotated. Deep learning is a supervised learning technique that is useful to train neural networks to solve more complicated classification and regression tasks. Finally, reinforcement learning techniques can be used to train AI agents that interact with an environment.

Using hands-on and interactive exercises you will get insight into the fundamental algorithms and basic concepts of:

Clustering is used to identify similar data/objects and patterns from your engineering datasets. It is a technique that is especially useful if you don’t have labeled or annotated data. We explain various approaches to clustering and cover how similarity and dissimilarity measures are used.

Dimensionality reduction techniques are used to reduce the number of features representing a given dataset, while retaining the structure of the dataset. We discuss feature selection and feature extraction techniques such as Principal Component Analysis (PCA), and how and when to apply it.

Deep Learning is a family of machine learning methods based on artificial neural networks. You will learn how to build and train deep neural networks consisting of fully connected neural networks of multiple hidden layers.

Reinforcement learning teaches an AI to interact with an environment. We cover basic reinforcement learning concepts and techniques, such as how to model the system using a Markov Decision Process, and how to train an optimal policy using tabular Q-learning using the Bellman equation.

This course is designed by a team of TU Delft machine learning experts from various backgrounds, highlighting the various topics from their individual perspectives.

At a glance

  • Institution: DelftX
  • Subject: Computer Science
  • Level: Intermediate
  • Prerequisites:
    • Basic linear algebra
    • Basic Python programming skills
  • Language: English
  • Video Transcripts: اَلْعَرَبِيَّةُ, Deutsch, English, Español, Français, हिन्दी, Bahasa Indonesia, Português, Kiswahili, తెలుగు, Türkçe, 中文
  • Associated programs:

What you'll learn

Skip What you'll learn
  • Describe the main classes of clustering techniques
  • Implement k-means and hierarchical clustering
  • Motivate the need and choice of dimensionality reduction techniques
  • Implement Principal Component Analysis (PCA) for feature extraction
  • Explain how deep neural networks work and their advantages
  • Train deep neural networks for classification and regression task
  • Explain the basic concepts and techniques of reinforcement learning
  • Describe how reinforcement learning could be applied in real world applications

Topic 1: Introduction

This is an introduction to the course with an overview of the topics.

Topic 2: Clustering

Clustering techniques are used to identify similar data/objects and patterns from your engineering datasets.

You will learn about the problem of clustering, the main classes of clustering techniques and how we can implement k-means and hierarchical clustering.

• Introduction to clustering

• Formalizing the problem of clustering

• Similarity and dissimilarity measures

• k-means clustering

• Hierarchical clustering

Topic 3: Dimensionality Reduction

Dimensionality reduction techniques are used to reduce the number of features representing a given dataset, while retaining the structure of the dataset as much as possible.

You will learn what dimensionality reduction is, why it is needed and how to use it. You will learn about Principal Component Analysis dimensionality reduction technique and how and when to apply it.

• What is dimensionality reduction?

• Why dimensionality reduction techniques are used

• Feature selection vs. feature extraction techniques

• Principal component analysis feature-extraction technique

Topic 4: Introduction to Deep Learning

Deep learning is a broader family of machine learning methods based on artificial neural networks.

You will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about fully connected neural networks, some theoretical aspects of deep learning, the back-propagation algorithm, Adam, and much more.

• What neural networks are

• Architecture of fully connected neural networks

• Capabilities of neural networks

• The benefits of deep architectures

• Training deep neural networks with stochastic gradient descent and Adam

Topic 5: Introduction to Reinforcement Learning

Reinforcement learning teaches an AI to interact with an environment.

You will be introduced to basic reinforcement learning concepts and techniques, and how they could be applied in real world applications.

• How an AI interacts with the environmen

• The formalization of this as a Markov Decision Process

• An agent’s behavior as a policy

• The optimal policy found using tabular Q-learning

• Why tabular reinforcement learning does not scale well

• Neural networks for deep reinforcement learning to scale up to interesting applications

Who can take this course?

Unfortunately, learners residing in one or more of the following countries or regions will not be able to register for this course: Iran, Cuba and the Crimea region of Ukraine. While edX has sought licenses from the U.S. Office of Foreign Assets Control (OFAC) to offer our courses to learners in these countries and regions, the licenses we have received are not broad enough to allow us to offer this course in all locations. edX truly regrets that U.S. sanctions prevent us from offering all of our courses to everyone, no matter where they live.

This course is part ofAI Skills: Basic and Advanced Techniques in Machine Learning Professional Certificate Program

Learn more 
Expert instruction
2 skill-building courses
Self-paced
Progress at your own speed
3 months
5 - 7 hours per week

Interested in this course for your business or team?

Train your employees in the most in-demand topics, with edX For Business.