Missed TensorFlow World? Check out the recap. Learn more

Theoretical and advanced machine learning with TensorFlow

Before starting on the learning materials below, be sure to:

  1. Complete our curriculum Basics of machine learning with TensorFlow, or have equivalent knowledge

  2. Have software development experience, particularly in Python

This curriculum is a starting point for people who would like to:

  1. Improve their understanding of ML

  2. Begin understanding and implementing papers with TensorFlow

You should already have background knowledge of how ML works or completed the learning materials in the beginner curriculum Basics of machine learning with TensorFlow before continuing with this additional content. The below content is intended to guide learners to more theoretical and advanced machine learning content. You will see that many of the resources use TensorFlow, however, the knowledge is transferable to other ML frameworks.

To further your understanding of ML, you should have Python programming experience as well as a background in calculus, linear algebra, probability, and statistics. To help you deepen your ML knowledge, we have listed a number of recommended resources and courses from universities, as well as a couple of textbooks.

Step 1: Refresh your understanding of math concepts

ML is a math heavy discipline. If you plan to modify ML models, or build new ones from scratch, familiarity with the underlying math concepts is important. You don't have to learn all the math upfront, but instead you can look up concepts you are unfamiliar with as you come across them. If it’s been a while since you’ve taken a math course, try watching the Essence of linear algebra and the Essence of calculus playlists from 3blue1brown for a refresher. We recommend that you continue by taking a class from a university, or watching open access lectures from MIT, such as Linear Algebra or Single Variable Calculus.

Math concepts
Essence of Linear Algebra by 3blue1brown

A series of short, visual videos from 3blue1brown that explain the geometric understanding of matrices, determinants, eigen-stuffs, and more.

Math concepts
Essence of Calculus by 3blue1brown

A series of short, visual videos from 3blue1brown that explain the fundamentals of calculus with an emphasis on fundamental theorems.

Math concepts
MIT course18.06: Linear Algebra

This introductory course from MIT covers matrix theory and linear algebra.

Math concepts
MIT course 18.01: Single Variable Calculus

This introductory calculus course from MIT covers differentiation and integration of functions of one variable, with applications.

Step 2: Deepen your understanding of deep learning with these courses and books

There is no single course that will teach you everything you need to know about deep learning. One approach that may be helpful is to take a few courses at the same time. Although there will be overlap in the material, having multiple instructors explain concepts in different ways can be helpful, especially for complex topics. Below are several courses we recommend to help get you started. You can explore each of them together, or just choose the ones that feel the most relevant to you.

Remember, the more you learn, and reinforce these concepts through practice, the more adept you will be at building and evaluating your own ML models.

Take these courses:

CS231n: Convolutional Neural Networks for Visual Recognition is a collection of lecture videos and slides from Stanford on the details of deep learning architectures, with a focus on learning end-to-end models for computer vision tasks. This is an excellent course and a great place to begin. The MIT course 6.S191: Introduction to Deep Learning is a shorter introductory course on Deep Learning with TensorFlow from MIT and also a wonderful resource. You can also try the MIT Deep Learning collection of courses and lectures on deep learning, deep reinforcement learning, autonomous vehicles, and artificial intelligence, taught by Lex Fridman."

Finally, Andrew Ng’s seminal Deep Learning Specialization at Coursera has five courses in which you learn the foundations of deep learning, including Convolutional networks, RNNS, LSTMs, and more. This specialization is designed to help you apply deep learning in your work, and to build a career in AI.

Intermediate online courses
CS231n: Convolutional Neural Networks for Visual Recognition

This course is a deep dive into the details of deep learning architectures, with a focus on learning end-to-end models for computer vision tasks, particularly image classification. Explore lecture videos, slides, and past syllabus notes from previous iterations of the course.

Intermediate online courses
MIT course 6.S191: Introduction to Deep Learning

In this course from MIT, you will gain foundational knowledge of deep learning algorithms, and get practical experience in building neural networks in TensorFlow.

Intermediate online courses
MIT Deep Learning

A collection of MIT courses and lectures on deep learning, deep reinforcement learning, autonomous vehicles, and artificial intelligence taught by Lex Fridman.

Intermediate online courses
Coursera: Deep Learning Specialization

In five courses, you will learn the foundations of Deep Learning, and how to build neural networks.

⬆ And ⬇

Read these books:

To complement what you learn in the courses listed above, we recommend that you dive deeper by reading the books below. Each book is available online, and offers supplementary materials to help you practice.

You can start by reading Deep Learning: An MIT Press Book by Ian Goodfellow, Yoshua Bengio, and Aaron Courville. The Deep Learning textbook is an advanced resource intended to help students deepen their understanding. The book is accompanied by a website, which provides a variety of supplementary materials, including exercises, lecture slides, corrections of mistakes, and other resources to give you hands on practice with the concepts.

You can also explore Michael Nielsen’s online book Neural Networks and Deep Learning. This book provides a theoretical background on neural networks. It does not use TensorFlow, but is a great reference for students interested in learning more.

Books
Deep Learning: An MIT Press Book, by Ian Goodfellow, Yoshua Bengio, and Aaron Courville

This Deep Learning textbook is a resource intended to help students and practitioners enter the field of machine learning, with an emphasis on deep learning.

Books
Neural Networks and Deep Learning, by Michael Nielsen

This book provides a theoretical background on neural networks. It does not use TensorFlow, but is a great reference.

Step 3: Read and implement papers with TensorFlow

At this point, we recommend reading papers and trying the advanced tutorials on our website, which contain implementations of a few well known publications. The best way to learn an advanced application, machine translation, or image captioning, is to read the paper linked from the tutorial. As you work through it, find the relevant sections of the code, and use them to help solidify your understanding.