Start: soon
Build your ChatGPT
You will learn and understand how Large Language Models (LLM) work from the inside, creating them from scratch, step by step.
Who is this course for?
The course is perfect for Data Scientists, ML engineers and data processing specialists working on machine learning tasks and wishing to deepen their knowledge in the audio field. This course is optimized for busy people, whether they are working professionals or students who cannot devote all their time to training.
feedback from our students
Program
- multi-layer perceptron
- matmul
- gelu
- datasets
- data loading
- synthetic data generation
- machine learning
- backpropagation
- linux
- ssh
- bash
Probabilistic models and RNN
- attention
- softmax
- positional encoder
- transformer
- residual
- layernorm
- GPT-2
- minBPE
- byte pair encoding
- initialization
- optimization
- AdamW
- device
- CPU
- GPU
- mixed precision training
- fp16
- bf16
- fp8, ...
- quantization
- distillation
- pruning
- distributed optimization
- DDP
- ZeRO
kv-cache
- supervised finetuning SFT
- EFT
- LoRA
- chat
- reinforcement learning
- RLHF
- PPO
- DPO
- VQVAE
- diffusion transformer
API
- Telegram
- streamlit
docker
- ci/cd
- k8s
model runtime optimization: triton, torchscript,...
How we teach
Online classes
Our classes are conducted by leading experts and cover key topics in the creation of LLM.
You will gain valuable knowledge and skills that you can apply in real projects.
You will gain valuable knowledge and skills that you can apply in real projects.
Homework and feedback
Independent work is the most important component of mastering the material and training. We regularly set and check homework. We give feedback and monitor the student's progress.
Live communication
In our chat rooms, you can always discuss the material with the teachers, ask them questions about the program.
The final project
Throughout the course, you will be working on a large project to create your own ChatGPT.
I want to build a ChatGPT
Лист ожидания
Мы сообщим вам, когда запустим программу и предложим скидку на обучение ✨
Нажимая на кнопку отправить, вы соглашаетесь с политикой конфиденциальности.
FAQ
The program is designed for 10 weeks of study and 40 academic hours of lectures and seminars. After the end of lectures and seminars, students will submit project work. To master the program comfortably, you will need to devote 10-15 hours a week.
Classes will not be divided into lectures and practical exercises. During each lesson, the theory and the practical part will be analyzed.
Students will submit their homework to Google Colab.
Class recordings will be available in your personal account on our platform.
Classes will be held online, on the Zoom platform.
Python, the basics of Machine Learning and Deep Learning, a mathematics course from a technical university to understand formulas. If you are in doubt whether the course is right for you, you can take the test on the course page above.
we also have a chatbot
softmax ai
The bot does not just give out ready-made answers, but it teaches students the ability to analyze and solve problems on their own. He has an amazing ability to turn complex ideas into simple explanations, making learning accessible and easy for everyone.
Скачать программу курса в PDF
Нажимая на кнопку "отправить", вы даете согласие на обработку персональных данных
