GaggiX
a year ago
A very useful guide about how diffusion models work and implementation: https://keras.io/examples/generative/ddim/
I find the explanation in this article very intuitive.
mandoline
a year ago
[dead]
a year ago
A very useful guide about how diffusion models work and implementation: https://keras.io/examples/generative/ddim/
I find the explanation in this article very intuitive.
a year ago
[dead]
a year ago
So anyone up for a discussion on this paper at: https://www.alphaxiv.org/abs/2403.18103
a year ago
Does something similar exist for LLM/GPT?
Edit to add: I'm mostly interested in this aspect:
"The target audience of this tutorial includes [those] who are interested in [...] applying these models to solve other problems."
a year ago
Andrej Karpathy has a youtube playlist:
https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs...
He is building new learning materials under his new company "Eureka Labs":
Sebastian Raschka's book "Build a Large Language Model (From Scratch) just released:
https://www.manning.com/books/build-a-large-language-model-f...
All of these resources are excellent.
a year ago
Andrej Karpathy has very good video tutorials on how to write your own GPT: https://www.youtube.com/watch?v=kCc8FmEb1nY
a year ago
This is excellent
a year ago
3Blue1Brown has a pretty great video series walking through Transformers:
a year ago
This paper is much clearer and succinct than the original papers from the field.
Trying to build a protein diffusion model from scratch right now.
The math explainer is quite helpful
a year ago
The first diffusion model for text generation was published less than a year ago. Should add something about that
a year ago
> see tutorial on diffusion > get excited > it's all math in latex > despair
a year ago
Latex is great in this case, because the equations are all written out clearly.
If you want to understand diffusion, it's a little difficult to avoid math.
a year ago
You may find the huggingface course more approachable
a year ago
Also this blog post https://yang-song.net/blog/2021/score/
a year ago
Maybe check out the fast ai course. Jeremy Howard has a way of explaining stuff.
a year ago
the math is learnable and with gpt nowadays, extremely so
a year ago
You are right! LLMs accept the formulas and may explain them...
It will be more difficult to tell when they are wrong, though - when you cannot verify directly. But it will be a device for people to get acquainted with the math.
a year ago
Diffusion is math. It’s difficult to avoid math if you want to understand math.
a year ago
Be that as it may, this isn't what I'd call a "tutorial," in the sense that you'd better already have a strong command of the subject matter or you won't get much out of it.
a year ago