arrow-left

All pages
gitbookPowered by GitBook
1 of 14

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Machine Learning with TensorFlow

Requirements for a Certificate of Achievement or ECTS

The conditions to be met in order to receive a Certificate of Achievement (and ECTS) are:

hashtag
Online Attendance:

If you attend via Zoom, please make sure to use your full name, which should be the same that you used to register at edu.opencampus.sh. Otherwise your attendance will not be recorded!

circle-info

Further: Online attendance is only accredited if you have the camera on, are participating with a laptop or desktop computer, and are in a sufficiently quite location to participate in the group discussions.

hashtag
Projects:

Check the Projects section to learn more about the projects.

Week 1 - General Introduction

hashtag
This week you will...

  • get a basic introduction to neural nets in order to get a first intuition in the underlying mechanisms

  • get a first idea about possible projects you might want to work on throughout the course

hashtag
Learning Resources

  • Video (12 minutes)

  • from Kaggle

  • on Medium

hashtag
Until next week you should...

  • Watch the following videos:

    • (Fireship, 2:30 min)

    • (IBM Technology, 10 min)

Backpropagation, intuitively | Deep Learning Chapter 3arrow-up-right (3Blue1Brown, 13 min)
  • Parameters vs Hyperparametersarrow-up-right (Pankaj Kumar Porwal, 5:40 min)

  • Validation data: How it works and why you need itarrow-up-right (Galaxy Inferno Codes, 5:40 min)

  • TensorFlow Tutorial 3 - Neural Networks with Sequential and Functional APIarrow-up-right (Aladdin Persson, 21 min)

  • TensorFlow Tutorial 14 - Callbacks with Keras and Writing Custom Callbacksarrow-up-right (Aladdin Persson, 11 min)

  • Think about project ideas to present in class next week (post your ideas in the chat during the week)

  • Complete the two assignments given in the following notebooks:

    • Assignment Notebook 1arrow-up-right

    • Assignment Notebook 2arrow-up-right

  • file-pdf
    7MB
    251023_General Introduction.pdf
    PDF
    arrow-up-right-from-squareOpen
    file-download
    44KB
    Guidlines for Presenting Assignments.pptx
    arrow-up-right-from-squareOpen
    Neural Networks Explainedarrow-up-right
    Introductory course on Pythonarrow-up-right
    Tutorial on Colabarrow-up-right
    Machine Learning Explained in 100 Secondsarrow-up-right
    What is a Loss Function? Understanding How AI Models Learnarrow-up-right

    Week 3 - Introduction to TensorFlow,Part II

    hashtag
    This week you will...

    • see how to improve the basic neural network for computer vision you learned last week.

    • learn about what happens if your data is more complex; if the images are larger, or if the features are not always in the same place, and how to handle such issues.

    hashtag
    Learning Resources

    • (StatQuest Video, 6 min)

    • (StatQuest, 7 min)

    • (StatQuest, 7 min)

    hashtag
    Until next week you should...

    • Watch the following videos:

      • Theory:

        • (StatQuest with Josh Starmer, 15 min)

    Callback Functions in TensorFlowarrow-up-right (DigitalSreeni, 10 min)

    C4W1L04 Paddingarrow-up-right (DeepLearningAI, 9:50 min)

  • C4W2L10 Data Augmentationarrow-up-right (DeepLearningAI, 9:30 min)

  • Practice:

    • TensorFlow Tutorial 4 - Convolutional Neural Networks with Sequential and Functional APIarrow-up-right (Aladdin Persson, first 10 min)

      • Note: After the first 10 min, the functional API is covered, which you likely will not need for your projects. Of course, you are free to optionally also watch the rest of the video.

    • (Aladdin Persson, first 7 min)

      • Note: The second method presented in the video (minutes 8 through 14) is deprecated and should no longer be used. The methods presented in the remainder of the video are not relevant to this week's assignment but may be interesting if you're doing a computer-vision project.

    • (Kody Simpson, 23 min)

      • Note: Don't be confused by the alternative approach to do data augmentation that is shown first in the video. The presentation of the method relevant for this week's assignment starts at around timestamp 9:30.

  • Set up a repository for your project following the instructions given herearrow-up-right

  • Conduct a literature review according to the instructions given herearrow-up-right

  • Document your findings on the literature review according to the instructions of above

  • Complete the assignment in the following notebook:

    • Assignment Notebookarrow-up-right

  • Optional:

    • To get a better theoretical understanding of Convolutional Neural Networks, the playlistarrow-up-right from DeepLearningAI from which some of the videos for this week were taken is generally a good source. In particular, you may find the videos (11 min) and C4W1L11 Why Convolutionsarrow-up-right (9:40 min) interesting. Naturally, you are free to watch more videos.

  • file-pdf
    656KB
    250508_Introduction-to-TensorFlow-Part-II.pdf
    PDF
    arrow-up-right-from-squareOpen
    Cross Validationarrow-up-right
    Bias and Variance (Overfitting)arrow-up-right
    Model Evaluation (Confusion Matrix)arrow-up-right
    Neural Networks Part 8: Image Classification with Convolutional Neural Networks (CNNs) arrow-up-right
    TensorFlow Tutorial 18 - Custom Dataset for Imagesarrow-up-right
    Data Augmentation - Deep Learning with Tensorflow | Ep. 19arrow-up-right

    Week9 - Project Feedback Session

    hashtag
    This week you will...

    • get individual feedback on your project idea from one of the instructors

    circle-exclamation

    Make sure you complete the first milestone, that is the literature review and descriptive statistics, on the Sunday before the feedback session! Follow the instructions given in the template repository and share the link to your project repository in the Google Sheet including the current list of projects, so we can review you completions there.

    hashtag
    We will then assign your project team a time slot within the regular course time with one of the instructors.

    hashtag
    Until next week you should...

    • complete week 1, 2, and 3 of the course from DeepLearning.AI

    • complete the tasks in to learn about data preparation for time series predictions

    • If you want you additionally complete the tasks in this to do a time series prediction of the above prepared dataset.

    Week 2 - Introduction to TensorFlow,Part I

    hashtag
    This week you will...

    • get a soft introduction to what Machine Learning and Deep Learning are, and how they offer you a new programming paradigm, giving you a new set of tools to open previously unexplored scenarios. All you need to know is some very basic programming skills, and you'll pick the rest up as you go along.

    Week 7 - Natural Language Processing, Part I

    hashtag
    This week you will...

    • get an understanding for the importance of tokenization of a text when training a neural network for texts, for example, to do a sentiment analysis. Tokenization is the process of converting the text into numeric values, with a number representing a word or a character.

    Preparation

    hashtag
    Before the first class you should ...

    • register with to get a corresponding account.

    Week 4 - Convolutional Neural Networks, Part I

    hashtag
    This week you will...

    • go deeper into using ConvNets with real-world data and a much larger dataset than those you've been using thus far.

    Sequences, Time Series and Predictionarrow-up-right
    this notebookarrow-up-right
    notebookarrow-up-right
    watch the videos Neural Networks from the Ground Uparrow-up-right (19 minutes) and Gradient Descent - How Neural Networks Learnarrow-up-right (21 minutes) It will help you getting familiar with the vocabulary and basic concepts in machine learning and get a first intuition for their meaning. Don't worry if you do not understand everything viewing it the first time, and maybe you want to watch the videos again at a later point in the course to understand more details.
  • do the introductory course on the basics of Python if you do not have any experience in Python yet: https://www.kaggle.com/learn/pythonarrow-up-right

  • Googlearrow-up-right

    Week 8 - Natural Language Processing, Part II

    hashtag
    This week you will...

    • start digging into a variety of model formats that are used in training models to understand context in sequence. In the last couple of weeks you looked first at Tokenizing words to get numeric values from them, and then using Embeddings to group words of similar meaning depending on how they were labelled. This gave you a good, but rough, sentiment analysis -- words such as 'fun' and 'entertaining' might show up in a positive movie review, and 'boring' and 'dull' might show up in a negative one. But sentiment can also be determined by the sequence in which words appear. For example, you could have 'not fun', which of course is the opposite of 'fun'.

    • learn about using natural language processing (NLP) models for predictions. Given a body of words, you could conceivably predict the word most likely to follow a given word or phrase, and once you've done that, to do it again, and again. With that in mind, you'll build a text generator. It's trained with texts that mimic the style of master Yoda from Star Wars and can be used to produce sentences that sound similar those of Yoda.

    hashtag
    Learning Resources

    • Will be provided here soon.

    hashtag
    Until next week you should...

    • prepare questions for the instructor team on problems you have in your project or potential improvement ideas you are thinking of.

    circle-exclamation

    complete the second milestone, that is the definition of an evaluation metric and the estimation of a baseline model, on Sunday before the feedback session next week! Follow the instructions given in the template repository. We will review your completions via the link to your repository provided in the Google Sheet including the current list of projects.

    take the just learned new programming paradigm used in machine learning to the next level by beginning to solve problems of computer vision with just a few lines of code!

    hashtag
    Learning Resources

    • Machine Learning Explained in 100 Secondsarrow-up-right (Fireship, 2:30 min)

    • What is a Loss Function? Understanding How AI Models Learnarrow-up-right (IBM Technology, 10 min)

    • Backpropagation, intuitively | Deep Learning Chapter 3arrow-up-right (3Blue1Brown, 13 min)

    • (Pankaj Kumar Porwal, 5:40 min)

    • (Galaxy Inferno Codes, 5:40 min)

    • (Aladdin Persson, 21 min)

    • (Aladdin Persson, 11 min)

    hashtag
    Until next week you should...

    • Watch the following videos:

      • Cross Validationarrow-up-right (StatQuest Video, 6 min)

        • The video is mandatory

        • The accompanying notebook is optional

      • (StatQuest, 7 min)

      • (StatQuest, 7 min)

      • (DigitalSreeni, 10 min)

    • Decide on a project for the course and form groups

    • Complete the two assignments in the following notebooks:

    file-pdf
    526KB
    251030_Introduction_Part_I.pdf
    PDF
    arrow-up-right-from-squareOpen

    learn about embeddings, where the text tokens are mapped as vectors in a high dimensional space. With embeddings and labelled examples, these vectors can then be tuned so that words with similar meaning will have a similar direction in the vector space. This will begin the process of training a neural network to understand sentiment in text -- and you'll begin by looking at movie reviews, training a neural network on texts that are labelled 'positive' or 'negative' and determining which words in a sentence drive those meanings.

    hashtag
    Learning Resources

    • Week 1 and 2 of the course Natural Language Processing in TensorFlowarrow-up-right

    hashtag
    Until next week you should...

    • watch ML with RNNs (NLP Zero to Hero - Part 4)arrow-up-right [6 Min]

    • watch LSTM for NLP (NLP Zero to Hero - Part 5)arrow-up-right [5 Min]

    • watch Training an AI to create poetry (NLP Zero to Hero - Part 6)arrow-up-right [8 Min]

    • complete to generate text in the unique speaking style of Star Wars character Master Yoda.

    • watch the videos "", "", and "" to help you evaluating and improving your model

    • consider a baseline model or a baseline comparison for your project task according to the instructions given

    • document the evaluation results of your baseline model and the used metric(s) in your project repository

    file-pdf
    467KB
    241205_NLP in TensorFlow-Part-I.pdf
    PDF
    arrow-up-right-from-squareOpen
    learn about image augmentation, a technique to avoid overfitting by tweaking the training set to potentially increase the diversity of subjects it covers.
  • discuss your project ideas.

  • hashtag
    Slides

    hashtag
    Learning Resources

    • Neural Networks Part 8: Image Classification with Convolutional Neural Networks (CNNs) arrow-up-right(StatQuest with Josh Starmer, 15 min)

    • C4W1L04 Paddingarrow-up-right (DeepLearningAI, 9:50 min)

    • C4W2L10 Data Augmentationarrow-up-right (DeepLearningAI, 9:30 min)

    • (Aladdin Persson, first 10 min)

    • (Aladdin Persson, first 7 min)

    • (Kody Simpson, 23 min)

    hashtag
    Until next week you should...

    • watch thisarrow-up-right video to get an introduction on transfer learning (8 min)

    • watch thisarrow-up-right video to learn how to implement transfer learning with CNNs (12 min)

    • work through thisarrow-up-right blog to learn about multi-class classification

    • complete the exercise assignment in

    • investigate the characteristics of your project's dataset according to the instructions given

    • document your findings on the dataset characteristics according to the instructions of above

    file-pdf
    627KB
    251113_CNN_Part_I.pdf
    PDF
    arrow-up-right-from-squareOpen

    Week 6 - Project Feedback Session

    hashtag
    This week you will...

    • get individual feedback on your project idea from one of the instructors

    circle-exclamation

    Make sure you complete the first milestone, that is the literature review and descriptive statistics, on the Sunday before the feedback session! Follow the instructions given in the template repository and share the link to your project repository in the Google Sheet including the current list of projects, so we can review you completions there.

    hashtag
    We will then assign your project team a time slot within the regular course time with one of the instructors.

    hashtag
    Until next week you should...

    • Watch the following videos:

      • (9 min)

      • (5 min)

    Week 10 - Sequences, Time Series and Prediction

    hashtag
    This week you will...

    • take a look at some of the unique considerations involved when handling sequential time series data -- where values change over time, like the temperature on a particular day, or the number of visitors to your web site. We'll discuss various methodologies for predicting future values in these time series.

    • begin to teach neural networks to recognize and predict on time series.

    • explore using Recurrent Neural networks (RNN) and Long Short Term Memory (LSTM) networks and see how useful they are to classify and predict on sequential data.

    • add CNNs on top of Dnns and RNNs and put it together using a real world data series -- one which measures sunspot activity over hundreds of years,

    hashtag
    Learning Resources

    • Week 1 and 2 of the course

    hashtag
    Until next week you should...

    • complete your project work

    • prepare your project presentation according to the instructions given

    Parameters vs Hyperparametersarrow-up-right
    Validation data: How it works and why you need itarrow-up-right
    TensorFlow Tutorial 3 - Neural Networks with Sequential and Functional APIarrow-up-right
    TensorFlow Tutorial 14 - Callbacks with Keras and Writing Custom Callbacksarrow-up-right
    Bias and Variance (Overfitting)arrow-up-right
    Model Evaluation (Confusion Matrix)arrow-up-right
    Callback Functions in TensorFlowarrow-up-right
    Assignment Notebook 1arrow-up-right
    Assignment Notebook 2arrow-up-right
    this notebookarrow-up-right
    Why human-level performance?arrow-up-right
    Avoidable biasarrow-up-right
    Understanding human-level performancearrow-up-right
    herearrow-up-right
    TensorFlow Tutorial 4 - Convolutional Neural Networks with Sequential and Functional APIarrow-up-right
    TensorFlow Tutorial 18 - Custom Dataset for Imagesarrow-up-right
    Data Augmentation - Deep Learning with Tensorflow | Ep. 19arrow-up-right
    this notebookarrow-up-right
    herearrow-up-right
    Sequences, Time Series and Predictionarrow-up-right
    herearrow-up-right
    (6 min)
  • (8 min)

  • (8 min)

  • Complete the exercise assignment in

  • What is NLParrow-up-right
    NLP Zero to Hero Part 1arrow-up-right
    NLP Zero to Hero Part 2arrow-up-right
    NLP Zero to Hero Part 3arrow-up-right
    Embeddings explainedarrow-up-right
    this notebookarrow-up-right

    Week 5 - Convolutional Neural Networks, Part II

    hashtag
    This week you will...

    • get familiar wit transfer learning, a powerful technique to include the knowledge of models that were trained on large datasets and benefit from the features these models already learned in your own problem scenario.

    • move beyond binary classification into categorical classification and the specific coding considerations for the corresponding models.

    • present your key findings for the literature review considering you selected project

    hashtag
    Learning Resources

    • (8 min)

    • on how to implement transfer learning with CNNs (12 min)

    • to learn about multi-class classification

    hashtag
    Until next week you should...

    • Prepare questions for the instructor team on potential problems you see in your project

    • Watch the following videos:

      • (9 min)

    circle-exclamation

    complete the first milestone, that is the literature review and descriptive statistics, on Sunday before the feedback session next week! Follow the instructions given in the template repository and share the link to your project repository in the Google Sheet including the current list of projects, so we can review you completions there.

    (5 min)
  • (6 min)

  • (8 min)

  • (8 min)

  • Complete the exercise assignment in

  • file-pdf
    1MB
    250522_CNNs in TensorFlow-Part-II.pdf
    PDF
    arrow-up-right-from-squareOpen
    Presentation Slides from this week
    Introduction on Transfer Learningarrow-up-right
    Videoarrow-up-right
    Blogarrow-up-right
    What is NLParrow-up-right
    NLP Zero to Hero Part 1arrow-up-right
    NLP Zero to Hero Part 2arrow-up-right
    NLP Zero to Hero Part 3arrow-up-right
    Embeddings explainedarrow-up-right
    this notebookarrow-up-right

    Week 11 & 12 - Presentation of the Final Projects

    hashtag
    This week you will...

    • present your project in the final presentations. :-)

    hashtag
    After the Final Presentation you should...

    • complete your project documentation and submit it according to the instructions given

    herearrow-up-right
    C4W1L06 Convolutions Over Volumesenvelope