GaggiX
6 days ago
A very useful guide about how diffusion models work and implementation: https://keras.io/examples/generative/ddim/
I find the explanation in this article very intuitive.
mandoline
5 days ago
[dead]
6 days ago
A very useful guide about how diffusion models work and implementation: https://keras.io/examples/generative/ddim/
I find the explanation in this article very intuitive.
5 days ago
[dead]
5 days ago
So anyone up for a discussion on this paper at: https://www.alphaxiv.org/abs/2403.18103
6 days ago
Does something similar exist for LLM/GPT?
Edit to add: I'm mostly interested in this aspect:
"The target audience of this tutorial includes [those] who are interested in [...] applying these models to solve other problems."
6 days ago
Andrej Karpathy has a youtube playlist:
https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs...
He is building new learning materials under his new company "Eureka Labs":
Sebastian Raschka's book "Build a Large Language Model (From Scratch) just released:
https://www.manning.com/books/build-a-large-language-model-f...
All of these resources are excellent.
6 days ago
Andrej Karpathy has very good video tutorials on how to write your own GPT: https://www.youtube.com/watch?v=kCc8FmEb1nY
6 days ago
This is excellent
5 days ago
3Blue1Brown has a pretty great video series walking through Transformers:
5 days ago
This paper is much clearer and succinct than the original papers from the field.
Trying to build a protein diffusion model from scratch right now.
The math explainer is quite helpful
5 days ago
The first diffusion model for text generation was published less than a year ago. Should add something about that
6 days ago
> see tutorial on diffusion > get excited > it's all math in latex > despair
6 days ago
Latex is great in this case, because the equations are all written out clearly.
If you want to understand diffusion, it's a little difficult to avoid math.
6 days ago
You may find the huggingface course more approachable
5 days ago
Also this blog post https://yang-song.net/blog/2021/score/
6 days ago
Maybe check out the fast ai course. Jeremy Howard has a way of explaining stuff.
6 days ago
the math is learnable and with gpt nowadays, extremely so
6 days ago
You are right! LLMs accept the formulas and may explain them...
It will be more difficult to tell when they are wrong, though - when you cannot verify directly. But it will be a device for people to get acquainted with the math.
6 days ago
Diffusion is math. It’s difficult to avoid math if you want to understand math.
5 days ago
Be that as it may, this isn't what I'd call a "tutorial," in the sense that you'd better already have a strong command of the subject matter or you won't get much out of it.
6 days ago