swyx
9 months ago
I am still not over the collapse of Gatsby (for reference i nearly joined the company in 2017, was saved only by my own character flaws).
They rode the highs - being the default docs tool for React, and building a massive ecosystem of integrations you could install out of the box. But too many abstractions, divided goals between cloud and OSS, and the better stewardship/design of Nextjs brought it down.
There were the simple lessons (https://swyx.io/a-world-without-plugins-cig). its easy to say in hindsight that graphql was too much for gatsby. i also believe the company went too hard for number of integrations over quality of them, an issue I had even in my interview. this was a poorer expression of the better insight that seb markbage had; just have a small api surface area bro (https://www.youtube.com/watch?v=4anAwXYqLG8)
But the bigger lesson is bitterer. Frontend tooling isnt worth that much. the fact that vercel is pretty much the only successful frontend startup of its generation makes it an exception to the rule (there are plenty of smaller companies that are thriving, like tailwind, but it is not a venture scale startup and thats fine). People dont pay for frontend tooling. they expect it to be free, expect it to do everything, get into internicine squabbles between frameworks when they are all basically doomed compared to just betting on React sponsored by Facebook and now Vercel (and a little bit of Shopify), or going back to fullstack frameworks like Django/Rails/Laravel. all frontend tooling, nextjs included, is just leadgen, loss leaders, while investors/salespeople patiently wait until you "grow up" by... building cloud backend/ci/cd services.
5 years ago i wrote about the "frontend ceiling" for individual developer careers (https://x.com/swyx/status/1682748872047886337) - i fear this is the "frontend ceiling" for companies.
I deeply admire Astro and hope they figure out a way to break the ceiling. Their recent cloud products have been encouraging.
vladgur
9 months ago
I am for one surprised that the initial concept of Gatsby -- a static site generator with React, GraphQL and other hype words of late 2010s -- was actually able to raise $40+ million dollars to build a platform for what to me at the time seemed incredibly over-engineered stack for static html pages and an unproven founder.
It was truly a testament of times
CSSer
9 months ago
RIP ZIRP. Kyle was cool and had the right attitude about a lot of things. He built some great frontend tooling e.g. fontsource, without locking it into his larger projects like Vercel did. That was very altruistic. Regardless, yeah, I couldn’t believe it when Gatsby got its seed round. It was a wild time.
ayuhito
9 months ago
Kyle is a great guy. Just to correct the timeline a little bit, I only created Fontsource after its predecessor, Typefaces (which was made by Kyle), was left abandoned when Gatsby took off.
I wouldn’t say he made Typefaces specifically for the Gatsby ecosystem, but he definitely had the hacker mindset for creating frontend tooling for a while.
CSSer
9 months ago
Thank you for that correction! I had to google to find the name because I was fuzzy on it. Your last paragraph matches my recall. The point I was trying to make was that I appreciated that Typefaces wasn’t automatically part of Gatsby just because of Kyle’s affiliation.
swyx
9 months ago
we do live in a society
com2kid
9 months ago
> But the bigger lesson is bitterer. Frontend tooling isnt worth that much.
This is a modern oddity, as historically front end tooling was worth a lot.
During the 80s and 90s, multiple companies made a lot of money off of front end tooling. Even as late as 2009 or so, Silverlight tooling was bringing in money for Microsoft. But think of how popular Flash was and the empire that helped build. Prior to that. Visual Basic helped Microsoft take over the world. Go back another generation and Borland's Delphi dominated for years.
And, arguably, all of those systems were more productive than anything we have now. (A topic I've written about many times!) As an industry, we may indeed be getting exactly what we pay for.
yen223
9 months ago
I lived through the times when you had to pay lots of money for software tooling. As a kid from a third-world country, I don't share the same rosy sentiment towards those times.
It's too easy to take for granted, but modern-day free open-source tooling is a godsend for a lot of folks out there.
com2kid
9 months ago
Historically software companies were smart enough to overlook piracy outside of their key markets. Plenty of poor American kids learned to program on pirated copies of visual studio.
Some point the company's got greedy and decided they want to crack down in all piracy. This shortsightedness first hit Adobe. I'd estimate that half the people who know photoshop learned it on a pirated copy. The harder Adobe makes piracy, the fewer kids teach themselves photoshop.
Microsoft, to their credit, made Visual Studio Community Edition, although IMHO they nerfed the first few releases too much.
You can view commercial software with overlooked piracy as a form of the rich subsidizing everyone else.
Again it is unfortunate that companies got greedy and tore the system down for a one time boost in revenue.
rapind
9 months ago
> Microsoft, to their credit, made Visual Studio Community Edition, although IMHO they nerfed the first few releases too much.
"Developers, developers, developers". IMO Steve was right... also VB 4-6 was amazing.
swyx
9 months ago
until it goes unmaintained because nobody pays for it
MikeTheGreat
9 months ago
> Even as late as 2009 or so, Silverlight tooling was bringing in money for Microsoft
Huh. It always kinda seemed like a "Microsoft's version of <...>, because Microsoft always has to compete with everything, including <...>". In this case, <...> is "Adobe Flash"
I'm curious if people have examples of what it was used for?
Looking at the Wikipedia page [1] which says
"According to statowl.com, Microsoft Silverlight had a penetration of 64.2% in May 2011. Usage on July 2010 was 53.6%, whereas as of May 2011 market leader Adobe Flash was installed on 95.3% of browsers, and Java was supported on 76.5% of browsers.[10]"
That shocked me - what was this used for, anyways?
Wikipedia goes on to say
"Silverlight was used to provide video streaming for the NBC coverage of the 2008 Summer Olympics in Beijing,[11] the 2010 Winter Olympics in Vancouver,[12] and the 2008 conventions for both major United States political parties.[13] Silverlight was also used by Amazon Video and Netflix for their instant video streaming services"
If Silverlight was being used for Netflix I can see it being installed on 60%+ of browsers just from that.
Still, I'm curious - anybody have have examples of what else it was used for?
com2kid
9 months ago
Silverlight's real usage was rapid internal corporate app development. Internal tools basically. It is hard to describe exactly how absurdly popular Silverlight was at the time within corporations.
Microsoft had a big internal political battle and did the stupidest thing possible and abandoned Silveright, which pissed off a LOT of companies, who then started building internal web apps instead. This lead to a slow migration off of Microsoft's technology stack within companies, and now basically Office is what is left.
For younger developers, it is hard to describe what life was like before.
So you'd go to work, and there was a custom C#, or possibly Visual Basic, time tracking app you logged into. Internal corporate web pages were written in ASP, or ASPX. Lots of internal databases were running on SQL server or just MS Access, and you directly talked to them through custom apps running on your machine.
Because the C#/VB development experience was so good, this was honestly easier than writing a website is now. Because apps only had to run on one platform (Windows) and mobile didn't exist yet, making UIs was easy-peasy. Microsoft made a ton of inroads into corporate because Bob from Accounting figured out he could setup a database running off of a local file share (MS Access) and write a simple GUI to keep track of vacation usage using some books he found in his local library, or maybe he even got ahold of some old MSDN CDs, which literally had higher quality documentation and examples than anything made in the last 15 years or so.
Silverlight was a continuation of that linage, super easy to write UIs in, super fast to develop. You could data bind a form to a backend database in a few minutes. You'd get full accessibility, hotkeys, everything, faster than you can debug a single CSS issue.
From what I understand (I was a very low level employee when it all went down) the OS org got pissed that the developer org was basically making the dominant UI framework, ripped it away from them and rewrote it as WinRT. Short of it is, Microsoft ended up losing mobile, they lost the trust of corporations, and they lost the trust of developers. After Silverlight died there aren't really anymore "Windows developers" as a career field. Everything moved to websites.
Lutger
9 months ago
Good analysis. They really killed the golden goose, never understood it. But internal rivalry makes sense, the same thing that bankrupted Nokia.
I know a lot of developers that were really happy in that older Microsoft ecosystem, it was a semi permeable walled garden where you could walk 'the Microsoft way' and everything was kind of laid out before you, neat and cosy. At the dev conferences when javascript started to become unavoidable, there was still a period where they kind of pretended Microsoft invented the web and gave it a nice but small spot alongside all the other, more important technology with which Real Developers make Real Software.
You could have discussions on architecture, but nothing fundamental really, and you'd always follow the prescribed pathways that Microsoft thought out for you. These changed every couple of years, which gave everybody new goals, new certifications to reach, new rewrites to accomplish and get paid for. Anyone that was moderately skilled was quite productive, and it was very easy to get into.
When the web got more complicated than html + jquery in server side generated templates, these developers often had a very bad time and fully retreated into their 'backend' role. The most recent anti javascript stronghold is Blazor, not sure if that is still a viable way to avoid modern frontend tooling.
I never really understood why Microsoft abandoned desktop gui apps like they did and left their walled garden unattended. It was one of their strong points, even though I disliked it a lot.
neonsunset
9 months ago
Silverlight legacy lives on in the form of https://opensilver.net. I don't have experience with it, but am going to assume that it's a shadow of the former self.
They do have a pretty cool demo project however: https://xaml.io
MikeTheGreat
9 months ago
Thanks for the reply! That was very illuminating!
I remember Access + SQL Server being popular, and ASP/ASPX being popular, and Visual Studio experience being easy + popular, and never quite understood why everyone switched to the web stack.
mirchiseth
9 months ago
SAP used it for their CRM when they moved from desktop client to browser based clients.
skeeter2020
9 months ago
we used it for a highly interactive scheduler UI in a commercial software project. The appeal was do Flash development with .Net developers.
swyx
9 months ago
yes good point. ofc Unity/Unreal Engine today also makes great money.
i think those frontends you mention made money because they had defacto monopoly on a certain platform or kind of experience that was unavailable anywhere else. xcode is a piece of absolute crap but i still have to pay $100 a year or whatever for it.
perhaps the emergence of web standards - both JS and browser standards - killed frontend. when everyone can build their own tools that run everywhere, and the browser api's are often pretty good, then why buy instead of build, or pick the next one that is free and good enough.
com2kid
9 months ago
> xcode is a piece of absolute crap but i still have to pay $100 a year or whatever for it.
You say xcode is horrible, but have you tried opening a project in Android Studio after 6 months and getting it to compile again?
It was funny, when I was at Microsoft, almost no one used Visual Studio because it wasn't able to handle code on the scale of MS's code bases. (I think things may be different now). That and it didn't support unusual build scenarios (which now it does.)
I wonder if it is the same case at Apple with xcode. Do OS engineers on MacOS actually use xcode to developer MacOS?
sakesun
9 months ago
I'd blame web browser model for productivity problem we are having now.
epolanski
9 months ago
Graphql was what made me hate Gatsby to be honest.
I think Typescript's websites uses it (or used to), and I wanted to fix a bug in the website and holy hell if Gatsby made me dislike the experience..
andrewingram
9 months ago
Even as a massive GraphQL fan, the GraphQL layer is what made me migrate all my projects away from Gatsby. It just doesn’t portray it at its best.
swyx
9 months ago
(just saying hey andrew! love to see you are still on the graphql train)
jwngr
9 months ago
Astro is what I wanted and thought Gatsby would be. GraphQL was the wrong sized abstraction for a basic blog site like mine. And once Gatsby turned towards the cloud (which made sense as a business), everything just got so complicated. I was swept up by it too.
Cool insight on frontend ceilings -- deployment is king.
dartos
9 months ago
I think frontend tooling is valuable, but there’s so much good free out there that it’s hard to monetize.
Gatsby always seemed wildly overengineered to me. It’s like all the bad parts of react, with all the bad parts of complicated js tooling, and none of the upsides.
Never made sense.
kelnos
9 months ago
> Frontend tooling isnt worth that much.
Is any tooling worth that much, really? I think the key is that backend tooling lends itself to selling hosted solutions, while frontend tooling is usually stuff you run locally or on CI to build artifacts. Sure, there are exceptions, but most people don't pay for developer-focused software anymore, at least not directly.
theflyinghorse
9 months ago
Sure. There are several companies selling paid JVMs and corpos gladly pay them a lot of money.
mmckelvy
9 months ago
My bet is on Remix (which will eventually just be React Router). I think it's just the right amount of abstraction over native web functionality with a nice, simple API that doesn't deviate too much from web standards. I also think the full stack approach just makes sense for developing on the web.
soufianee
9 months ago
Remix is backed by Shopify, compared to Next.js being backed by Vercel. Does this influence any decision to take?
Today Next.js has a big advantage which is that they have already integrated most of the new React 19 rendering features and apis. I think it will take a while for Remix to catch up to that.
Other notable frameworks are community led Waku made by Daishi Kato from Pmdrs and TanStart made by Tanner from Tanstack.
Also there's Redwood.js betting on a more integrated experience.
Today I am using Nextjs because I don't think I can go back to not using RSCs, but when Remix catches up or Waku and TanStart get to v1, I sure will give them a serious try!
mmckelvy
9 months ago
Shopify "backing it" means less to me than the maintainers themselves. The Remix maintainers are straight shooters and have been maintaining open source consistently for over a decade now.
I also just like their API and design decisions.
madeofpalk
9 months ago
> Remix is backed by Shopify
This makes me distrust it (slightly more than I distrust Next/Vercel).
Shopify's core business is not in making javascript frameworks. Remix is always one bad Shopify away from being ejected.
user
9 months ago
swyx
9 months ago
> which will eventually just be React Router
how strongly do you believe this. because ive just read both docs and i think they have different goals/audiences (tho obviously same owner). i think react router will be a poorer project if it starts to require serverside components like it is looking
mmckelvy
9 months ago
They made an announcement that they are merging the projects a little while back: https://remix.run/blog/merging-remix-and-react-router. Obviously things could change, but I think RR v7 will effectively be the next iteration of Remix.
swyx
9 months ago
ah yeah. they didnt quite address my concerns in that post. but they know better than i.
mind-blight
9 months ago
I'm a huge remix fan. Remix, Shadcn, postgres, and Prisma have been great for rapid development
mmckelvy
9 months ago
Agreed, minus the Primsa.
mind-blight
9 months ago
Honestly, I hated Prisma for the longest time. Like, hated it. I tried to rip it out of projects multiple times. Why would you build a node library in Rust? (as one of many problems) But, I had a mental shift recently that helped me appreciate it more: I use Prisma only for features that fit neatly into an simple ORM (i.e. building a web page based on a bunch of joins). Anything else, I use raw SQL.
They released TypedSql (https://www.prisma.io/docs/orm/prisma-client/using-raw-sql/t...) which is heavily inspired by PgTyped. That lets me write raw Postgres SQL that's converted into TypeScript. The other things I do:
- If I want derived data, write views that encapsulate the transform. Prisma supports reading from views - If I need something more complex, use DuckDB + python for analysis and write to the appropriate table. - If I need to cache complex queries, just use a materialized view and read it as a prisma object
It's not perfect, but that let's me use prisma for what it's good at (Managing an ORM and deeply nested queries), then fall back into raw SQL for everything else.
Going straight to SQL has been a breath of fresh air, but, let's be honest, dealing with deeply nested joins really sucks when all you want to do is build a page that shows a company, all of it's people, and all of those people's relationships. ORMs are pretty handy for that last case, and I use SQL for everything else
CharlieDigital
9 months ago
Check out Kysley: https://kysely.dev/
mind-blight
9 months ago
I've looked into it a bit. I'm getting to the point where I either want to use a full ORM, or I want to write raw SQL and have it checked against the database.
Query builders are nice, but they sometimes end up in this middle ground where they have the worst parts of an ORM (needing to learn a new syntax and not getting access to all the DB features) and the worst parts of raw SQL (Unpacking relationships into objects w/ pointers is error prone boilerplate that sucks to write).
I love SqlAlchemy since it's still enough of an ORM to solve the main problem I want solved. Super curious to hear if you've had good experiences with Keysley and how it deals with transforming relationships into objects
madeofpalk
9 months ago
Is Vercel a frontend tooling startup?
I've always seen them as a AWS-wrapping hosting company, who funds some react projects on the side and will drop them at a moment's notice.
Netlify, who bought Gatsby on its decline, still seems to be going alright without being a frontend tooling company.
swyx
9 months ago
> etlify, who bought Gatsby on its decline, still seems to be going alright without being a frontend tooling company.
what makes you so sure :/
victorhooi
9 months ago
I'm probably a bit out of the loop her - but you referenced Gatsby's collapse?
Did something happen to them, in the community or project?
Googling, I saw that they were acquired by Netlify in early 2023 - but not much concrete beyond that?