Skip to main content

Successfully Evaluating Predictive Modelling

Gain an in-depth understanding of evaluation and sampling approaches for effective predictive modelling using Python.

Successfully Evaluating Predictive Modelling

There is one session available:

After a course session ends, it will be archived.
Starts Oct 26
Ends Dec 20
Estimated 6 weeks
8–10 hours per week
Instructor-paced
Instructor-led on a course schedule
Free
Optional upgrade available

About this course

Skip About this course

A predictive exercise is not finished when a model is built. This course will equip you with essential skills for understanding performance evaluation metrics, using Python, to determine whether a model is performing adequately.

Specifically, you will learn:

  • Appropriate measures that are used to evaluate predictive models
  • Procedures that are used to ensure that models do not cheat through, for example, overfitting or predicting incorrect distributions
  • The ways that different model evaluation criteria illustrate how one model excels over another and how to identify when to use certain criteria

This is the foundation of optimising successful predictive models. The concepts will be brought together in a comprehensive case study that deals with customer churn. You will be tasked with selecting suitable variables to predict whether a customer will leave a telecommunications provider by looking into their behaviour, creating various models, and benchmarking them by using the appropriate evaluation criteria.

At a glance

  • Institution: EdinburghX
  • Subject: Data Analysis & Statistics
  • Level: Advanced
  • Prerequisites:

    You should be familiar with an undergraduate level, or have a background, in mathematics and statistics. Previous experience with a procedural programming language is beneficial (e.g. Python, C, Java, Visual Basic).

    Learners pursuing the MicroMasters programme are strongly recommended to complete PA1.1x Introduction to Predictive Analytics using Python on the verified track prior to undertaking this course.

What you'll learn

Skip What you'll learn

In this course, you will:

  • Analyse the accuracy and quality of a predictive model
  • Implement effective measures and strategies to measure models
  • Evaluate datasets to determine appropriateness and strength of techniques
  • Understand the techniques used in recommender systems

Week 1: Evaluation Metrics and Feature Selection
Week 2: Feature Selection and Correlation Analysis
Week 3: Feature Selection with Decomposition Techniques
Week 4: Sampling Techniques
Week 5: Resampling Techniques
Week 6: Case Study

About the instructors

Frequently Asked Questions

Skip Frequently Asked Questions

What type of activities will I complete on the course?
This course foregrounds self-directed and active ways of learning: reading, coding in Python, knowledge check quizzes and peer discussion. In addition, the course features videos that demonstrate relevant predictive analysis techniques and concepts.

What software will I be required to use?
All coding activities on this course will be hosted on Vocareum. You will be able to access this free software directly within the edX platform. There is no requirement to purchase further software in order to complete this course.

What do I need to complete the course?
For successful completion of this course, you will need access to a computer or mobile device and a reliable internet connection.

What is the University of Edinburgh Accessibility Guidance?

The University of Edinburgh is committed to providing online information and services accessible to all. Edx provide an accessibility statement which is available via the footer of all edx.org pages and includes an 'Accessibility Feedback' form which allows Learners to register feedback directly with the edx. Courses created by the University of Edinburgh contain an Accessibility Statement which addresses equality of access to information and servicesandis available via the 'Support' page.

Who can take this course?

Unfortunately, learners residing in one or more of the following countries or regions will not be able to register for this course: Iran, Cuba and the Crimea region of Ukraine. While edX has sought licenses from the U.S. Office of Foreign Assets Control (OFAC) to offer our courses to learners in these countries and regions, the licenses we have received are not broad enough to allow us to offer this course in all locations. edX truly regrets that U.S. sanctions prevent us from offering all of our courses to everyone, no matter where they live.

Interested in this course for your business or team?

Train your employees in the most in-demand topics, with edX for Business.