paulgb
a year ago
Simon Wilson’s (simonw on here) blog is good, lots of good notes from someone who actively plays with a lot of LLMs.
daceba
a year ago
[dead]
Item id: 41579134
a year ago
Simon Wilson’s (simonw on here) blog is good, lots of good notes from someone who actively plays with a lot of LLMs.
a year ago
[dead]
a year ago
AI explained. It's a youtube channel that gives a nice in-depth overview of the latest papers in the field of LLMs.
https://www.youtube.com/@aiexplained-official
They also have a free newsletter and more behind a Patreon subscription.
https://signaltonoise.beehiiv.com/p/the-3rd-era-of-ai-langua...
a year ago
Like it or not, Stephen Wolfram. e.g. https://writings.stephenwolfram.com/2024/08/whats-really-goi... and https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...
a year ago
https://gwern.net/#deep-learning
Gwern is the place for me. His deep dive on meta-learning is always interesting.
a year ago
Recommending Gwern on any technical topic is practically cheating; he always has in-depth, impeccably referenced overviews, complete with experiments he has done.
For deep learning in particular, I will add Neel Nanda's interpretability work: https://www.neelnanda.io/mechanistic-interpretability
a year ago
He's the best writer online. If you're reading this Gwern, know that you're greatly admired.
a year ago
blog design is goat
a year ago
Hey I have a blog site where I write about implementing different papers and doing deep dives on the papers!
I try to go for those things you're looking for. It's hard to find good resources nowadays with real people behind them.
I hope you enjoy the posts. Feel free to reach out about anything on there
a year ago
Reading through this now. Really appreciate the knowledge sharing!
Your content is amazing and with some more polish I feel like it would really shine! (Some sentences not flowing quite right is a little confusing for me, reading the GAN deep dive)
a year ago
Hey, thanks for your feedback, I'm glad you're finding it interesting!
Noted I am quite new to writing like this, where exactly was it confusing? I'll definitely take this on board and try to increase the clarity in my writing.
a year ago
Neat ! Bookmarked :)
a year ago
You've created an account just for this two word comment?
Totally not suspicious.
a year ago
Fwiw I didn't create that account, I didnt notice it was so new earlier. It is a bit weird though
a year ago
random tangent: I like your input.sh website
a year ago
Thank you!
a year ago
It’s a big field!
But if you’re in a few discords and a bunch of subreddits, you’re doing it right.
The most interesting stuff happens in GitHub PR’s, but you have to know where to look. Kohya’s misnamed SD3 branch has a ton of good flux hints, for example. It’s also where furkan gets pretty much all his content, before it gets paywalled.
Unfortunately, unless you participate full-time it’s hard to follow along. But if you really dig in and learn to modify your tooling (Comfy, kohya etc), you’ll start to come across some really impressive people who are all self-taught, and very accessible.
It’s totally possible to work your way up to the frontier with a few months of hacking. (And disposable income for GPU time.)
And the overlap between image AI’s and LLM’s is actually pretty great since they’re all transformers under the hood.
Civit, in my experience, is a good source for weights but most of the guides are written by people without much actual experience.
If you haven’t already, use tensorflow or wandb to get an intuitive understanding of your training parameters. It’s very easy to connect your tools to these services. This is by far the most helpful thing I’ve done, and something I really regret not doing sooner.
a year ago
Any discords you recommend?
a year ago
I'm on:
Image
- Terminus Research Group, from bghira of SimpleTuner/diffusers https://discord.gg/cSmvcU9Me9
- AI Toolkit https://github.com/ostris/ai-toolkit https://discord.gg/VXmU2f5WEU
- Stable Diffusion https://discord.gg/stablediffusion
LLM
- LLamaIndex https://www.llamaindex.ai https://discord.com/invite/eN6D2HQ4aX
- Nous research https://discord.gg/nousresearch
- LangChain https://discord.gg/hMrfPpUk
Platforms
- Replicate https://discord.gg/replicate
a year ago
>It’s also where furkan gets pretty much all his content, before it gets paywalled.
Who/what is Furkan?
a year ago
a year ago
> use tensorflow
I think you meant TensorBoard?
a year ago
yep!
a year ago
You can find 99% of companies and reasearchers. Just follow them. If you need some names, just ask!
a year ago
I hate that this is true, but it is. If you want ot keep up to date with news, following on X + hanging around on discord is the way.
a year ago
A site run by a fascist transphobe? Hard pass.
a year ago
But you're happy living in a country built on the bones of ??? run by warmongering ???
a year ago
x requires an account.
a year ago
LOL
a year ago
a year ago
a year ago
r/LocalLLaMA
a year ago
LocalLlama is the place. Really high quality people and discussion there and surprisingly collaborative. Very different than most subreddits.
a year ago
I like LocalLLaMA because it's not just for algorithm/math experts, it's for people who want to use LLMs locally (as the name says), so there is often practical discussion on how to use "off the shelf" models and kits. This also implies a patient crowd who will sometimes go into great detail about specific details, since there are many non-specialists.
a year ago
Go to one of the AI Tinkerers events in your area?
a year ago
This one sends a fairly good (generated) summary each day:
a year ago
This is a pretty good weekly roundup of art-related developments:
a year ago
Keep a broad perspective: https://pivot-to-ai.com/
a year ago
https://www.lesswrong.com/ for HN-style longer AI-related posts, especially around alignment and consciousness
a year ago
I think that's what OP is not interested in
a year ago
Indeed, OP's "disinterested" list matches LessWrong almost perfectly.
> Disinterested: CEO said, politics, winter, alignment, eats us all, not a human, etc.
a year ago
Isn't it pretty niche to not want discussions of winter or alignment? I guess you can go read Nick Land? If there's not at least a mini-winter or alignment some time soon it's going full Nick Land, right?
What I mean is, Nick Land is the only person I know of who can at least sort of credibly claim to have a theory for why alignment isn't just not guaranteed, but is in fact impossible, and there's ~no chance of a lasting winter.
a year ago
This indy guy is ‘hands on’
a year ago
Huggingface community
a year ago
Chipp AI public discord is pretty active and folks tend to talk about the latest stuff there. It’s a mostly non-technical crowd though.
a year ago
Let me know if that’s a good fit.
a year ago
a year ago
I like Machine Learning Street Talk discord server.
a year ago
www.machine-ethics.net if you've interested in the ethics of AI
a year ago
Here's a primary literature review on Nick Land's thesis that AI and capitalism are teleologically identical and will converge on the event horizon of the techno-economic singularity.
It's AI hype to the max.
a year ago
Not really not "eats us all, not a human" though. Do OP's requirements really make sense?
a year ago
Just simulate your own with some LLMs?
a year ago
a year ago
ask chatgpt about your favorite research echo chamber
a year ago
This is why I'm creating https://medium.com/ai-engineers to focus on the rising class of AI engineers and practical content for devs who want to use AI to build apps.