paulgb
2 years ago
Simon Wilson’s (simonw on here) blog is good, lots of good notes from someone who actively plays with a lot of LLMs.
daceba
2 years ago
[dead]
Item id: 41579134
2 years ago
Simon Wilson’s (simonw on here) blog is good, lots of good notes from someone who actively plays with a lot of LLMs.
2 years ago
[dead]
2 years ago
AI explained. It's a youtube channel that gives a nice in-depth overview of the latest papers in the field of LLMs.
https://www.youtube.com/@aiexplained-official
They also have a free newsletter and more behind a Patreon subscription.
https://signaltonoise.beehiiv.com/p/the-3rd-era-of-ai-langua...
2 years ago
Like it or not, Stephen Wolfram. e.g. https://writings.stephenwolfram.com/2024/08/whats-really-goi... and https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...
2 years ago
https://gwern.net/#deep-learning
Gwern is the place for me. His deep dive on meta-learning is always interesting.
2 years ago
Recommending Gwern on any technical topic is practically cheating; he always has in-depth, impeccably referenced overviews, complete with experiments he has done.
For deep learning in particular, I will add Neel Nanda's interpretability work: https://www.neelnanda.io/mechanistic-interpretability
2 years ago
He's the best writer online. If you're reading this Gwern, know that you're greatly admired.
2 years ago
blog design is goat
2 years ago
Hey I have a blog site where I write about implementing different papers and doing deep dives on the papers!
I try to go for those things you're looking for. It's hard to find good resources nowadays with real people behind them.
I hope you enjoy the posts. Feel free to reach out about anything on there
2 years ago
Reading through this now. Really appreciate the knowledge sharing!
Your content is amazing and with some more polish I feel like it would really shine! (Some sentences not flowing quite right is a little confusing for me, reading the GAN deep dive)
2 years ago
Hey, thanks for your feedback, I'm glad you're finding it interesting!
Noted I am quite new to writing like this, where exactly was it confusing? I'll definitely take this on board and try to increase the clarity in my writing.
2 years ago
Neat ! Bookmarked :)
2 years ago
You've created an account just for this two word comment?
Totally not suspicious.
2 years ago
Fwiw I didn't create that account, I didnt notice it was so new earlier. It is a bit weird though
2 years ago
random tangent: I like your input.sh website
2 years ago
Thank you!
2 years ago
It’s a big field!
But if you’re in a few discords and a bunch of subreddits, you’re doing it right.
The most interesting stuff happens in GitHub PR’s, but you have to know where to look. Kohya’s misnamed SD3 branch has a ton of good flux hints, for example. It’s also where furkan gets pretty much all his content, before it gets paywalled.
Unfortunately, unless you participate full-time it’s hard to follow along. But if you really dig in and learn to modify your tooling (Comfy, kohya etc), you’ll start to come across some really impressive people who are all self-taught, and very accessible.
It’s totally possible to work your way up to the frontier with a few months of hacking. (And disposable income for GPU time.)
And the overlap between image AI’s and LLM’s is actually pretty great since they’re all transformers under the hood.
Civit, in my experience, is a good source for weights but most of the guides are written by people without much actual experience.
If you haven’t already, use tensorflow or wandb to get an intuitive understanding of your training parameters. It’s very easy to connect your tools to these services. This is by far the most helpful thing I’ve done, and something I really regret not doing sooner.
2 years ago
Any discords you recommend?
2 years ago
I'm on:
Image
- Terminus Research Group, from bghira of SimpleTuner/diffusers https://discord.gg/cSmvcU9Me9
- AI Toolkit https://github.com/ostris/ai-toolkit https://discord.gg/VXmU2f5WEU
- Stable Diffusion https://discord.gg/stablediffusion
LLM
- LLamaIndex https://www.llamaindex.ai https://discord.com/invite/eN6D2HQ4aX
- Nous research https://discord.gg/nousresearch
- LangChain https://discord.gg/hMrfPpUk
Platforms
- Replicate https://discord.gg/replicate
2 years ago
>It’s also where furkan gets pretty much all his content, before it gets paywalled.
Who/what is Furkan?
2 years ago
2 years ago
> use tensorflow
I think you meant TensorBoard?
2 years ago
yep!
2 years ago
You can find 99% of companies and reasearchers. Just follow them. If you need some names, just ask!
2 years ago
I hate that this is true, but it is. If you want ot keep up to date with news, following on X + hanging around on discord is the way.
2 years ago
A site run by a fascist transphobe? Hard pass.
2 years ago
But you're happy living in a country built on the bones of ??? run by warmongering ???
2 years ago
x requires an account.
2 years ago
LOL
2 years ago
2 years ago
2 years ago
r/LocalLLaMA
2 years ago
LocalLlama is the place. Really high quality people and discussion there and surprisingly collaborative. Very different than most subreddits.
2 years ago
I like LocalLLaMA because it's not just for algorithm/math experts, it's for people who want to use LLMs locally (as the name says), so there is often practical discussion on how to use "off the shelf" models and kits. This also implies a patient crowd who will sometimes go into great detail about specific details, since there are many non-specialists.
2 years ago
Go to one of the AI Tinkerers events in your area?
2 years ago
This one sends a fairly good (generated) summary each day:
2 years ago
This is a pretty good weekly roundup of art-related developments:
2 years ago
Keep a broad perspective: https://pivot-to-ai.com/
2 years ago
https://www.lesswrong.com/ for HN-style longer AI-related posts, especially around alignment and consciousness
2 years ago
I think that's what OP is not interested in
2 years ago
Indeed, OP's "disinterested" list matches LessWrong almost perfectly.
> Disinterested: CEO said, politics, winter, alignment, eats us all, not a human, etc.
2 years ago
Isn't it pretty niche to not want discussions of winter or alignment? I guess you can go read Nick Land? If there's not at least a mini-winter or alignment some time soon it's going full Nick Land, right?
What I mean is, Nick Land is the only person I know of who can at least sort of credibly claim to have a theory for why alignment isn't just not guaranteed, but is in fact impossible, and there's ~no chance of a lasting winter.
2 years ago
This indy guy is ‘hands on’
2 years ago
Huggingface community
2 years ago
Chipp AI public discord is pretty active and folks tend to talk about the latest stuff there. It’s a mostly non-technical crowd though.
2 years ago
Let me know if that’s a good fit.
2 years ago
2 years ago
I like Machine Learning Street Talk discord server.
2 years ago
www.machine-ethics.net if you've interested in the ethics of AI
2 years ago
Here's a primary literature review on Nick Land's thesis that AI and capitalism are teleologically identical and will converge on the event horizon of the techno-economic singularity.
It's AI hype to the max.
2 years ago
Not really not "eats us all, not a human" though. Do OP's requirements really make sense?
2 years ago
Just simulate your own with some LLMs?
2 years ago
2 years ago
ask chatgpt about your favorite research echo chamber
2 years ago
This is why I'm creating https://medium.com/ai-engineers to focus on the rising class of AI engineers and practical content for devs who want to use AI to build apps.