Skip to main content

DelftX: AI Skills for Engineers: Data Engineering and Data Pipelines

Good data is central to effective AI applications. This course teaches the basics of data for AI, covering what data is needed, how to extract data from existing databases and basic data skills including setup of a Python notebook environment, basic data exploration and simple data visualizations.

AI Skills for Engineers: Data Engineering and Data Pipelines
6 weeks
5–7 hours per week
Self-paced
Progress at your own speed
This course is archived
AI Skills for Engineers: Data Engineering and Data Pipelines

About this course

Skip About this course

Artificial Intelligence and Machine Learning have become central techniques for most services and products, ranging from web-based systems to medical procedures, self-driving cars – even intelligent coffee makers.

Alongside algorithms, data is central to AI applications. Without solid data management, AI projects typically underperform or even fail. Unfortunately, the relevance and complexity of handling data is frequently underestimated.

That’s why we developed this course which covers foundational questions like “Why is data important to AI?” and “What data does AI need?” and covers more application-oriented topics and skills like how to extract, load and query data using an SQL pipeline.

In the second part of the course, you will learn basic data engineering skills, including how to setup your Python notebook environment, explore data with advanced pandas functions, and create simple and clear data visualizations.

This introductory course is targeted at learners with little experience in data management or Python-based data management who want to develop Python-based AI applications in the future. The course covers a brief introduction into data management for AI, relational data management (e.g., SQL), and practical data handling skills in Python, pandas, and Jupyter.

This allows you to build a foundation to prepare for future AI and Machine Learning development with Python.

At a glance

  • Language: English
  • Video Transcript: English
  • Associated skills: Jupyter, Relational Databases, Management, Data Management, Artificial Intelligence, Medical Practices And Procedures, Applications Of Artificial Intelligence, SQL (Programming Language), Pandas (Python Package), Machine Learning, Python (Programming Language), Data Engineering, Algorithms

What you'll learn

Skip What you'll learn
  • Why Data Management is central to AI applications
  • What kind of data these applications need
  • How to obtain data for AI applications
  • How to extract and query data from existing databases using SQL
  • How to setup your Python notebooks
  • How to use the pandas library to work with tabular data
  • How to visualize data using the Seaborn library

Syllabus

Skip Syllabus

Week 1:

  • We ask why we should care about data management for Artificial Intelligence and Machine Learning (ML) systems.
  • We examine which data are needed in the ML lifecycle and what properties that data should have.
  • We discuss the effort and time needed for data management activities, and look at possible data sources.

Week 2:

  • The basic key concepts of data management, such as databases, data models and data schemas are all introduced.
  • The Relational Data Model is explained and contrasted with the Single-Table Model (like CSV and Excel) and Document Models.

Week 3:

  • We show how to extract data from existing relational databases using SQL queries and converting the query results into CSV files for further processing using pandas in Python notebooks.

Week 4:

  • The different ways setoff setting up and running Python notebooks are covered, including cloud-based notebooks and local notebooks.
  • We will take you step by step through the process of setting up your conda environment and installing Jupyter and pandas libraries.
  • You will learn how to run notebooks in VS code.

Week 5:

  • Become a pandas expert.
  • Explore the essential functionalities of pandas and, most importantly, write elegant and efficient Python pandas code to process and engineer tabular data.

Week 6:

  • You will learn how to make simple and clear scientific figures in Python using the Seaborn library.
  • Use the core functions provided by Seaborn to make beautiful statistical plots.

Who can take this course?

Unfortunately, learners residing in one or more of the following countries or regions will not be able to register for this course: Iran, Cuba and the Crimea region of Ukraine. While edX has sought licenses from the U.S. Office of Foreign Assets Control (OFAC) to offer our courses to learners in these countries and regions, the licenses we have received are not broad enough to allow us to offer this course in all locations. edX truly regrets that U.S. sanctions prevent us from offering all of our courses to everyone, no matter where they live.

This course is part of Data Skills for Artificial Intelligence Professional Certificate Program

Learn more 
Expert instruction
2 skill-building courses
Self-paced
Progress at your own speed
3 months
5 - 6 hours per week

Ways to take this course

Choose your path when you enroll.

Verified Track

Audit Track

Price

$149 USD

Free

Access to course materials

Unlimited

Limited

World class institutions and universities

edX support

Shareable certificate upon completion

Graded assignments and exams

Read our FAQsin a new tab about frequently asked questions on these tracks.

Interested in this course for your business or team?

Train your employees in the most in-demand topics, with edX For Business.
Purchase nowRequest information