# Week 1 - General Introduction

#### This week you will...

* get all details about the structure and form of the course.
* get to know your fellow course participants.
* discuss the general types of training large language models.
* discuss current sources for staying up-to-date.

#### Learning Resources

{% file src="/files/yEwWcV2VgB1svG0hurU5" %}

* [Hugging Face NLP course](https://huggingface.co/learn/nlp-course/chapter1/1)
* [YouTube channel from Yannic Kilcher](https://www.youtube.com/@YannicKilcher)

#### Until next week you should...

* [x] decide on a project.
* [x] watch [Creating your own ChatGPT: Supervised fine-tuning (SFT)](https://www.youtube.com/watch?v=NXevvEF3QVI\&t=418s) from Niels Rogge (1 hour).
* [x] note at least one question on the video above.
* [x] watch the four videos of the [Rasa Algorithm Whiteboard on Transformers and Attention](https://www.youtube.com/watch?v=yGTUuEx3GkA) (Part 1 to Part 4; about 50 minutes in total) if the transformers architecture is new to you.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://opencampus.gitbook.io/opencampus-machine-learning-program/courses/archive/application-of-transformer-models/week-1-general-introduction.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
