High-Dimensional Data Analysis
About this courseSkip About this course
If you’re interested in data analysis and interpretation, then this is the data science course for you. We start by learning the mathematical definition of distance and use this to motivate the use of the singular value decomposition (SVD) for dimension reduction of high-dimensional data sets, and multi-dimensional scaling and its connection to principle component analysis. We will learn about the batch effect, the most challenging data analytical problem in genomics today, and describe how the techniques can be used to detect and adjust for batch effects. Specifically, we will describe the principal component analysis and factor analysis and demonstrate how these concepts are applied to data visualization and data analysis of high-throughput experimental data.
Finally, we give a brief introduction to machine learning and apply it to high-throughput, large-scale data. We describe the general idea behind clustering analysis and descript K-means and hierarchical clustering and demonstrate how these are used in genomics and describe prediction algorithms such as k-nearest neighbors along with the concepts of training sets, test sets, error rates and cross-validation.
Given the diversity in educational background of our students we have divided the series into seven parts. You can take the entire series or individual courses that interest you. If you are a statistician you should consider skipping the first two or three courses, similarly, if you are biologists you should consider skipping some of the introductory biology lectures. Note that the statistics and programming aspects of the class ramp up in difficulty relatively quickly across the first three courses. By the third course will be teaching advanced statistical concepts such as hierarchical models and by the fourth advanced software engineering skills, such as parallel computing and reproducible research concepts.
These courses make up two Professional Certificates and are self-paced:
Data Analysis for Life Sciences:
- PH525.1x: Statistics and R for the Life Sciences
- PH525.2x: Introduction to Linear Models and Matrix Algebra
- PH525.3x: Statistical Inference and Modeling for High-throughput Experiments
- PH525.4x: High-Dimensional Data Analysis
Genomics Data Analysis:
- PH525.5x: Introduction to Bioconductor
- PH525.6x: Case Studies in Functional Genomics
- PH525.7x: Advanced Bioconductor
This class was supported in part by NIH grant R25GM114818.
At a glance
- Language: English
- Video Transcript: English
- Associated skills: Matrix Algebra, Functional Genomics, Genomics, Statistics, Principal Component Analysis, Data Analysis, Statistical Inference, K-Means Clustering, R (Programming Language), Machine Learning, Forecasting, Multidimensional Scaling, Software Engineering, Dimensionality Reduction, Factor Analysis, Algorithms, Biology, Linear Model, Data Warehousing, Data Visualization, Hierarchical Clustering, Prediction, Data Science, Bioconductor (Bioinformatics Software), Life Sciences
What you'll learnSkip What you'll learn
- Mathematical Distance
- Dimension Reduction
- Singular Value Decomposition and Principal Component Analysis
- Multiple Dimensional Scaling Plots
- Factor Analysis
- Dealing with Batch Effects
- Basic Machine Learning Concepts
More about this courseSkip More about this course
HarvardX Honor Code
HarvardX requires individuals who enroll in its courses on edX to abide by the terms of the edX honor code. HarvardX will take appropriate corrective action in response to violations of the edX honor code, which may include dismissal from the HarvardX course; revocation of any certificates received for the HarvardX course; or other remedies as circumstances warrant. No refunds will be issued in the case of corrective action for such violations. Enrollees who are taking HarvardX courses as part of another program will also be governed by the academic policies of those programs.
HarvardX Nondiscrimination/Anti-Harassment Statement
Harvard University and HarvardX are committed to maintaining a safe and healthy educational and work environment in which no member of the community is excluded from participation in, denied the benefits of, or subjected to discrimination or harassment in our program. All members of the HarvardX community are expected to abide by Harvard policies on nondiscrimination, including sexual harassment, and the edX Terms of Service. If you have any questions or concerns, please contact firstname.lastname@example.org and/or report your experience through the edX contact form.
HarvardX Research Statement
HarvardX pursues the science of learning. By registering as an online learner in an HX course, you will also participate in research about learning. Read our research statement to learn more.