Pure and Impure Software Engineering

41 pointsposted 3 days ago
by colonCapitalDee

27 Comments

bigfishrunning

a few seconds ago

This dichotomy exists, and the author states the illusion of "competent" vs "incompetent", but I think it's more "Conscientious" vs "Indifferent". Tech business competition breeds indifference, because when you optimize around minimizing technical debt, your competitor will eat your lunch with worse code. Lots of competent engineers incur tons of technical debt, because they'll eventually be paid to swim in it, and they don't care. Open source projects tend to be written with much more care, because the reward mechanism is different.

alerter

an hour ago

Interesting take, and there is some truth to the "practical vs ideological" split, but I feel like it's a bit mixed up here.

The actual division I see is between programmers arguing for simpler, more direct solutions to problems (e.g see Casey's blog post on semantic compression, or the hype around HTMX) and those who want to architect the "perfect" scalable and extensible system. The latter is much more common in enterprise settings, usually performs worse, and is the source of a lot of incidental complexity.

The article mentions microservices and event driven systems as an example of "pure engineering", but I think it's the exact opposite. I always see the "pure" crowd advocating for single binaries, fewer dependencies, fewer network hops, and less future-proofing.

upghost

3 hours ago

I liked this article because I think it is a fairly charitable "strongman" take of the "pure" engineering camp from someone who identifies with the other camp.

That being said, there is an objective way out of this trap emdash check out Dave Farley's work on Modern Software Engineering [1].

It is a very clever approach to convert the process of software delivery into a software problem itself, with a minimal criteria of shipping new code safely every 24 hours.

When your "pure" engineers optimize around that, the distinction between your "pure" and "practical" devs tends to be pretty small.

[1]: https://a.co/d/eLvZYcE

sevensor

an hour ago

I think the article picks the wrong pure / impure dichotomy. Much more interesting to me is the split between people who want to abstract the application domain and people who want to engage with it. To the former, a CRUD app is a CRUD app. To the latter, CRUD is still a useful framework, but it’s just a tool that’s subordinate to a bigger purpose. Or take game dev; the decision to go deep on game engine design can be driven by your opinions about shipping versus tinkering, or it can result from having a game in mind and picking the best way to realize its mechanics. CS attracts a lot of abstract thinkers, and CS degrees reinforce the abstraction of the application domain, so I find that a lot of programmers take it as a point of pride that they don’t engage with it.

It’s probably clear where my sympathies lie here, so I’ll balance that by saying something nice about abstraction: it really can help you see the problem more clearly. It’s a great tool to avoid solving the same problem over and over again. Just make sure you’ve correctly identified the problem first!

Arisaka1

2 hours ago

I'm kind on the fence, but not with the article. It's true that there are engineers who lean more towards one or the other way. For example, since the author brings up the switch from Neovim to VS Code due to features, I do love using Neovim for my TypeScript and Golang needs. But, if I were to work with Java or C# I'm switching to IntelliJ or Rider.

I believe it's healthier to attain some kind of pure-leaning... centrism(?) if we were to present pure/impure as black/white choices. I find it easier to imagine someone who deeply cares about squeezing performance through min-maxing to suddenly shift gears and deliberately introduce debt and just ship-ship-ship for the sake of pushing the product out, because they know exactly the price of the corner that they're cutting.

So I don't see it as a "you're either this or that" but more like "you should be this, and also be that when it's deemed appropriate".

bentinata

an hour ago

Do you use "emdash" because you love to use it but don't want to be mistaken as AI-generated?

sarreph

2 hours ago

The dichotomy being presented here is great, and I appreciate the tact in presenting each side's strengths -- a tasteful and enjoyable read. It _is_ possible after all to exist on either branch of this bifurcation and have respect for the other side, even though (hint hint I'm looking at you, "pure" engineers) such a divide is the root of much intellectually-veiled baiting.

I do not however agree with the author that "pure engineering" is going away:

> But like I said, those times are gone. Tech companies now have to make money.

Tech companies have always had to make money... in a vacuum. The return of an AI hype-train laden with VC cash has in many senses recreated some of the air of extravagance of the 2010s-era; perhaps with even more frivolity than last time. I think the author is mistaking a decline in OSS library and tooling spending by companies -- for human use -- as fall in pure engineering efforts. I'd argue instead that the definition of what counts as a "pure engineering" effort has simply shifted to AI-based tooling. We see now, and will continue to see, lots of high-octane-brain-power effort and money being sunk into building the "best" protocols, interfaces, and libraries to interface with AI... which will also likely be OSS too!

The purist flamewars will just be about a lack of understanding of MCP rather than how to use Rust. :)

bjornsing

3 hours ago

Good read. I’ve thought about this distinction myself, but this was definitely more clearly articulated.

> This view is kind of like saying that engineers are just people who weren’t smart enough to do physics, or physicists aren’t smart enough to pure mathematics.

To some extent that’s true though. :) Source: I have an MSc in Engineering Physics.

tux3

3 hours ago

If there's one archetype that haunts math forums, it has to be the Retired Engineer that took a look at the Collatz conjecture or the Reimann Zeta zeroes and just came up with a theory.

This also happens in physics, but physics crackpots can come from anywhere. Especially now, having been reassured that they've hit the key insight, and you're absolutely right, it's not just a theory of everything — it's a revolutionary new foundation for physics! Would you like me to help you write a convincing paper delving more into these ideas?

amelius

2 hours ago

Impure software engineering generates too much technical debt.

Cthulhu_

2 hours ago

That's a pretty absolutist statement for what the article states is a very broad subject, well beyond code. Can you elaborate what you mean, or whether you have a different definition of impure software engineering?

mexicocitinluez

2 hours ago

lol.

I mean, of course it does? Requirements change, priorities change, rules/laws change, which all contributes to a constantly moving codebase.

When you're building a video game, do you have to worry about Congress changing healthcare laws? Cmon.

TeeWEE

3 hours ago

I dont like the "impure" label. But the guts of it is right. Most software solves a business problem. Even the "pure" ones could choose to deliver value sooner with tech debt.

trashburger

2 hours ago

Maybe "practical" engineering is a better label?

bob1029

2 hours ago

Game development is likely the most bipolar example of this. You get both flavors as strongly as possible in the same place. Part of it is incredibly pure as mentioned in the article. Building an engine that can run on all targets is impressive. But then you have to meet all of these artists and customers in the middle which requires some of the messiest work imaginable. You'll end up with odd game objects hidden under the scene that manage elaborate things because the technical team had no way to anticipate the messiness of the impure world of art and emergent gameplay mechanics. The best they can do is continue to support the pure aspects as best they can and account for this mess in their future engine designs.

There is a reason you see some shops perfectly happy using old tools like unity 2022lts, UE4, etc., and others constantly upgrading to the latest new version. In the later case, the quest for purity has outstripped all other priorities - We must be on the latest and greatest at all times. In the former case, they've already experienced the later case and realized that it can never be clean. It's always going to be messy somewhere when you are working on something this complicated. Might as well use the engine that has already been deployed to a billion devices and proven itself over a decade.

Those who have been in the industry for a while can often tell when an indie dev is going to fail at launching a game simply by how they talk about the technology they intend to use. Shopping for tools is fun. It's pure and clean. You haven't really committed to anything when you buy a screw driver or a hammer. The moment you use that hammer to tear into that first piece of drywall, you have a kinetic, messy situation on your hands. Tooling might still be important but it needs to take a back seat to the mission at that point.

Dilettante_

2 hours ago

> If you liked this post, consider [...] sharing it on Hacker News.

Not to be that guy, but is this not in violation of the guidelines?

  Don't solicit upvotes, comments, or submissions. Users should vote and comment when they run across something they personally find interesting—not for promotion.

Cthulhu_

2 hours ago

I've always interpreted that as applying more to comments, but I didn't write or enforce the rules. It's a text version of the list of 'share on social media' icons I think.

LoganDark

2 hours ago

I'm very perfectionistic and find it really difficult to accept imperfect solutions to a problem, to the point where I'll just lock up until I can come up with a better way. Is that just an early-career thing, or is there some way I can get better at giving up the idea of perfection?

davidee

2 hours ago

Redefine what perfection is (although I'd argue you'd probably do well to work on disabusing yourself of the idea of perfection altogether - but that's for another time).

Back to redefinition: what's perfect for you may not be what's perfect for your team, your division, your line of business, your company, your personal project, whatever. Is part of the perfection metric time to deliver? Customer (user) satisfaction? Reduction of support requests? I'm not saying any one of these is right, but I believe there's a framework of compromise out there that can help you should you want to change this area of your professional life. In short, think outside the core problem and expand the radius of context from just you and that notion of perfection, to something larger, something more systemic - I believe that can help.

On the other hand, if your drive for whatever you believe perfection is, works for you, then, meh, do you! We do need folks to scream that x or y isn't good enough, even if only to evaluate if we should find a better compromise than the current one.

mexicocitinluez

2 hours ago

> Is that just an early-career thing, or is there some way I can get better at giving up the idea of perfection?

No, you just have to really, really get it into your head that perfection most often results in missed deadlines and never truly finishing anything.

One of my hot takes is that anybody that considers themselves a perfectionist but can also list off things they've completed doesn't actually understand what true perfectionism means. They're just bragging about their attention to detail.

000ooo000

4 hours ago

Quite a bit of speculation and generalisation here..

Cthulhu_

2 hours ago

And that's fine, it encourages thought and a framework and whatnot. Given it's a personal blog and not a paper, I'll file it under "author's personal opinion" more than "generally accepted fact"

n4r9

3 hours ago

How do you mean? To me this reads like the author is proposing a framework for interpreting known phenomena in the tech industry.

keyle

3 hours ago

Classic case of empowering two keywords and going to town with cliches, like most self help book style.

It's a shame it became about that because there are some good points in there. Proper engineering used to be a bigger part of the whole tech industry.

jappgar

2 hours ago

I have to think they borrowed "pure" from haskell. It's such a stupid word to use in both cases.

Purity is an illusion. Water looks pure even when it's tainted with lead.

Purity isn't good. If you only drank pure water you'd be starving your body of necessary minerals.

The real antagonists are idealists and pragmatists.

Idealists are fun to talk to but terrible to work with.

anonzzzies

2 hours ago

I hoped this was the pure of Haskell. It is very much not and I enjoy reading it. You did not I guess.