Skip to main content

DelftX: AI skills for Engineers: Supervised Machine Learning

Learn the fundamentals of machine learning to help you correctly apply various classification and regression machine learning algorithms to real-life problems using the Python toolbox scikit-learn.

AI skills for Engineers: Supervised Machine Learning
6 weeks
6–8 hours per week
Self-paced
Progress at your own speed
This course is archived
AI skills for Engineers: Supervised Machine Learning

About this course

Skip About this course

Machine learning classification and regression techniques have potential uses in various engineering disciplines. These machine learning models allow you to make predictions for a category (classification) or for a number (regression) given sensor data, and can be used in, for example, predicting properties of objects (such as their weight or shape).

Using hands-on and interactive exercises you will get insight into:

Machine learning and its variants, such as supervised learning, semi-supervised learning, unsupervised learning and reinforcement learning.

Regression techniques such as linear regression, K-nearest neighbor regression, how to deal with outliers and evaluation metrics such as the mean squared error (MSE) and mean absolute error (MAE).

Classification techniques such as the histogram method, the nearest mean (or nearest medoid) method and the nearest neighbor classifier. We cover the classification setting and important concepts such as the Bayes classifier and the Bayes error, the optimal classifier in theory.

Training models using (stochastic) gradient descent and its variants, we learn how to tune this optimizer, and how to use it to construct a logistic regression classification model.

Overfitting means a classifier works well on a training set but not on unseen test data. We discuss how to build complex non-linear models, and we analyze how we can understand overfitting using the bias-variance decomposition and the curse of dimensionality. Finally, we discuss how to evaluate fairly and tune machine learning models and estimate how much data they need for an sufficient performance.

Regularization methods can help to mitigate overfitting. We discuss two regularization techniques for estimating the linear regression coefficients: ridge regression and LASSO. The latter can also be used for variable selection.

Classifier evaluation metrics such as the ROC curve and confusion matrix can give more insight into the performance of classifiers. We also discuss what constitutes a “good” accuracy; this is given by so-called dummy-classifiers which are naïve baselines.

Support Vector Machines (SVMs) are more advanced classification models that can provide good performance even in high-dimensional spaces and with little data. We discuss their different variants such as the soft-margin SVM, the hard-margin SVM and the nonlinear kernel SVM.

Decision Trees are simple models that can easily be understood by lay people. They are easy to use and visualize, and instead of a black box they can be easily understood as an interpretable white box model, making them suitable for various applications.

The lectures feature a unique combination of videos mixed with hands-on interaction with machine learning algorithms to stimulate a deeper understanding. In the exercises you apply the algorithms in Python using scikit-learn and in the final project you will further deepen your understanding of the various concepts by building and tuning a machine learning pipeline from start to finish.

At a glance

  • Institution: DelftX
  • Subject: Computer Science
  • Level: Intermediate
  • Prerequisites:
    • Basic linear algebra
    • Basic Python programming skills
    • Basic probability & statistics
  • Language: English
  • Video Transcripts: اَلْعَرَبِيَّةُ, Deutsch, English, Español, Français, हिन्दी, Bahasa Indonesia, Português, Kiswahili, తెలుగు, Türkçe, 中文
  • Associated programs:

What you'll learn

Skip What you'll learn
  • Apply common operations (pre-processing, plotting, etc.) to datasets using Python.
  • Explain the concept of supervised, semi-supervised, unsupervised machine learning and reinforcement learning.
  • Explain how various supervised learning models work and recognize their limitations.
  • Analyze which factors impact the performance of learning algorithms.
  • Apply learning algorithms to datasets using Python and Scikit-learn and evaluate their performance.
  • Optimize a machine learning pipeline using Python and Scikit-learn.

Syllabus

Skip Syllabus

Topic 1: Introduction

This is an introduction to the course with an overview of the topics. We give a brief introduction to machine learning and its different variants.

• Why use machine learning?

• Machine learning basics and terminology

• The biggest challenge in machine learning

• Machine learning frameworks: supervised, semi-supervised, unsupervised and reinforcement learning

Topic 2: Regression

We will make a gentle start with regression. In the regression setting, a machine learning model will need to predict a number.

• The regression setting and its assumptions

• The mean squared error (MSE) and mean absolute error (MAE)

• Outliers in regression

• Linear regression and K-nearest neighbour regression

Topic 3: Classification

In classification, a machine learning model will need to predict a category or class.

• Terminology and basics of classification

• Building classifiers using histograms, nearest mean (nearest medoid) classifier, K-nearest neighbour (KNN) classifier

• The Bayes classifier and the Bayes error

• How to use the KNN classifier in practice

Topic 4: Training Models

Gradient descent is an iterative procedure to train models, such as logistic regression and neural networks.

• The basics of gradient descent

• The three variants of gradient descent: batch, mini-batch and stochastic gradient descent (SGD)

• How to tune gradient descent

• The basics of logistic regression

Topic 5: Overfitting

Overfitting is the problem where a machine learning algorithm performs well on the training set but does not perform well on new and unseen data.

• How to use linear models for nonlinear tasks?

• The bias-variance trade-off and the curse of dimensionality

• How to use learning curves to estimate the amount of data needed

Topic 6: Cross Validation & Regularization

To get a good estimate of the performance of machine learning models, cross validation is an essential technique. This is also important to tune hyperparameters of models. Finally, we discuss regularization, a technique that aims to avoid overfitting.

• Cross validation, model selection and hyperparameter tuning

• Ridge regression

• LASSO regularization and how it’s used for variable selection

Topic 7: Classifier Evaluation

Classifier evaluation delves deeper into the various evaluation metrics for classifiers.

• What a “good” accuracy means (e.g., naïve baselines/dummy classifiers)

• The confusion matrix (false positive, false negative, costs)

• ROC-curves

Topic 8: Support Vector Machines

The support vector machine is a well-known more advanced classification model.

• Basics of the SVM, the margin and the hard-margin SVM

• The soft-margin SVM

• Kernels

Topic 9: Decision Trees

Decision trees are simple and interpretable models that are very user-friendly.

• Basics of decision trees and their terminology

• How to train decision trees with CART

• Overfitting and other pros and cons of decision trees

Topic 10: Final Project

The final project will involve building a machine learning pipeline, including hyperparameter tuning and a careful and fair evaluation, to solve a small practical application, that is the recognition of handwritten digits (MNIST).

Learner testimonials

Skip Learner testimonials

"I enrolled in this course to challenge myself and expand my horizons. It's a step towards fulfilling my aspirations.

The course was a transformative experience that reshaped my career trajectory. It not only deepened my expertise but also broadened my professional network. Learning online was a incredibly flexible and convenient. The ability to access a wealth of resources and interact with peers globally, from the comfort of my home, was truly remarkable"

- Cheerla Balaji Srinivasu, Student from India

Who can take this course?

Unfortunately, learners residing in one or more of the following countries or regions will not be able to register for this course: Iran, Cuba and the Crimea region of Ukraine. While edX has sought licenses from the U.S. Office of Foreign Assets Control (OFAC) to offer our courses to learners in these countries and regions, the licenses we have received are not broad enough to allow us to offer this course in all locations. edX truly regrets that U.S. sanctions prevent us from offering all of our courses to everyone, no matter where they live.

This course is part of AI Skills: Basic and Advanced Techniques in Machine Learning Professional Certificate Program

Learn more 
Expert instruction
2 skill-building courses
Self-paced
Progress at your own speed
3 months
5 - 7 hours per week

Ways to take this course

Choose your path when you enroll.

Certificate

Free

Price

$149 USD

-

Access to course materials

Unlimited

Limited

World-class institutions and universities

edX support

Shareable certificate upon completion

Graded assignments and exams

Read our FAQsin a new tab about frequently asked questions on these tracks.

Interested in this course for your business or team?

Train your employees in the most in-demand topics, with edX For Business.
Purchase nowRequest information