danck
4 hours ago
> At the same time, the press service states that some of the staff will continue to have access to a special platform for AI assistants, which the Government Offices themselves developed, and through which they gain access to ChatGPT and Claude.
Sounds like they just want to maintain control over the outbound traffic which sounds rather sensible to me.
lucumo
3 hours ago
> Sounds like they just want to maintain control over the outbound traffic which sounds rather sensible to me.
Yeah, and probably also forcing Zero Data Retention contracts on those service, instead of the consumer variants.
theplumber
3 hours ago
The contracts are really worthless if for example Trump wants to share the transcripts with Putin. At this point I don’t understand why governments would outsource any of their data services to 3rd parties (I.e outside of the EU). EU should establish an EU gov cloud program and just run the models themselves for all the EU countries(under license of course). They would probably get better bargaining power as well.
abm53
an hour ago
You’ve leapt to the most extreme scenario to declare these contracts worthless.
Of course something like what you describe could happen. But under the central case, ensuring some privacy (with the ability to seek damages if breached) whilst still providing access to frontier models seems like a reasonable trade-off with a lot of value.
kube-system
34 minutes ago
When it comes to government data, contracts are often much stronger than you may be used to in the private sector, as mishandling the data can be criminal in nature. And data sovereignty requirements are common. This stuff is table stakes when selling to governments.
petcat
3 hours ago
Such a thing would require building data centers, i.e. industrial compute factories, but the EU is politically paralyzed from doing that because electricity is already outrageously expensive and there is just sort of a general popular outrage about the prospect of it.
Frieren
2 hours ago
> the EU is politically paralyzed from doing that because electricity is already outrageously expensive and there is just sort of a general popular outrage about the prospect of it.
That is called democracy. Where the good of citizens is valued above what big corporations want. To push up pollution and power prices so big American tech companies can play with AI seems something that only a mad king would do.
elmer2
35 minutes ago
If AI can find cancers faster than a human, which they've already proven, it's tradeoff that's worth it. It's only getting better and there's no telling how else it will benefit humanity.
Governments are always at least a decade behind when it comes to technology. Just don't complain when they have massive data breaches weekly, because they decided their principals were more important.
philipallstar
an hour ago
It's not democracy. People don't want high energy prices. It's just their only voting options are all politicians who will give them high energy prices.
Big corporations are only big because they provide what customers want. They don't get to extract money from people's work, the way politicians can.
Kamq
4 minutes ago
To be fair, the current spike in prices definitely wasn't from anything europeans were able to vote on...
Frieren
38 minutes ago
> Big corporations are only big because they provide what customers want.
Big corporations are big because they purchased all competitors. I recommend that you read the book Enshitification.
xvector
2 hours ago
Citizens are dumb though, the stupidity of the public killed nuclear. Not every decision needs to be democratic. Certainly not core infrastructure decisions.
It's also so easy to astroturf to manipulate public opinion. If I were China, I'd post so much anti-datacenter content everywhere in the West to gain a leg up in the race to superintelligence, because we are dumb enough to let our citizenry influence these decisions.
Imagine if we did the same thing for the nuclear race. ASI is winner-take-all, the first one to ASI can just lock everyone else out.
ruaraidh
an hour ago
How definitive. I wish I had your certainty about literally anything.
pixl97
20 minutes ago
There is no certainty, only probability.
The recent growth of LLMs is a black swan. Any future prediction you attempt to make has massive error bars.
Europe is in a very precarious position. If LLMs actually play out and lead to economic booms (I'm not saying for individuals, note that), the EU as a whole will get absolutely trounced economically and likely experience a shrinking economy for the next 20+ years along with a shrinking population in most of the member countries. They are so far behind on power and compute of the US and China there is not any current path to catching up.
The US itself is in a precarious position with the amount of debt it has accrued, it could be right that LLMs are what leads to future economic booms, but be so far in the hole it takes decades to recover.
China is really in the best place at the moment. Trying to build up power and compute as fast as it can, copying American innovation at the cheap, and having a mountain of US and EU money to spend on it.
BubbleRings
8 minutes ago
Well, it doesn’t seem to be a time for dilly-dallying. IMO the danger and promise of AGI is through the roof, and the urgency is up there with them.
It’s time to decide your stand. But if you want to make an informed decision, you probably want to:
- Read up on the possible dangers until you get it,
- Learn about the advantages and breakthroughs already happening, and,
- Do some extensive work on a real project with at least an Opus-level LLM, so you really understand what an astounding new thing it is in our world.
Frieren
34 minutes ago
> Not every decision needs to be democratic.
So our technoverlords should decide for us? All these arguments to go back to the middle ages and feudal systems are based on the idea that we should be oppressed and our opinion should not count. That thinking destroys enlighten societies and bring inequality and poverty.
pixl97
19 minutes ago
It would be a mistake to blindly assume that democracy can survive the technical future. The rise of democracy went hand in hand with the importance of skilled labor. If the need for labor dies, at least in my eyes, democracy dies with it.
interactivecode
an hour ago
If I was a American oligarch who became president due to my ties to social media platforms and influence I would also advocate european governments use American AI services.
consumer451
2 hours ago
There are no data centers in the EU?
pixl97
18 minutes ago
Don't look at data centers by number, look at data centers by compute. The US has somewhere between 100 and 1000x more compute.
InsidiousWombat
2 hours ago
data center being in EU matters little when it is owned by US company that US govt can just tell "gimme that data"
consumer451
2 hours ago
Sure, even in colocation cases, Google LLC owns all the data, but we certainly do have DCs in the EU.
Now, do we have DCs with "temporary gas generators" operating 24/7 that were thrown together in the last 2 years? Probably not.
myrmidon
an hour ago
How is electricity outrageously expensive? We get power in the most flexible of forms (electrical) delivered directly to our homes at a rate that no human in history would have ever performed voluntary physical labor for (the equivalent of thousands of horses or people for a few hundred bucks an hour, assuming <500$/MWh). Even complete energy autarky has become feasible for private individuals if you are willing to invest.
Just because power used to be even cheaper in the recent past, by doing non-sustainable shit and pushing all the resulting costs onto others/the future does not mean that was ever appropriate, necessary or desirable, and everyone advocating for chasing that model is a greedy, selfish asshole in my view.
roosterIllusi0n
2 hours ago
AI is local. They need to invest in procuring hardware, which means making it themselves if that is the only way to get a card in every computer that can do the job.
If cloud based AI is any good, they will sell versions that can be hosted locally just like every other service since the beginning of the internet.
pixl97
16 minutes ago
> They need to invest in procuring hardware,
Ooops, too late.
I think one of the AI 2027 videos covered this pretty well. EU cannot make nor really afford the compute they need to buy. All they really have the ability to control is UV machines for making masks which is going to get politically hot very soon.
The US and China have claimed all production for years to come.
erwald
3 hours ago
The internal service is Microsoft Copilot, so this is probably just a really really dumb decision.
toss1
an hour ago
Yes, my first thought on reading the headline was: "the result will be they'll just ensure everyone uses some worse AI models".
So only mildly surprised on reading the article to read they are intentionally forcing them onto a specific worse model.
laurentiurad
3 hours ago
No, they use OpenAI with deployment in the Swedish data centers, which keeps inference local. Azure and GCP already offers this. No idea about Claude though.
soco
3 hours ago
Maybe it's what you meant, but let me underline that "local" does NOT mean under your control. As long it's with Microsoft, it will fall under the exactly same Cloud Act, so it can be shut off or copied over the pond on a whim.
laurentiurad
3 hours ago
You're right in theory, but it doesn't mean the US gov has unrestricted access to the data. There needs to be a legal process in place and there are safeguards that prevent accessing the data without that. This will happen to any company within US jurisdiction, as authorities can compel any provider to give them the required data.
ffsm8
3 hours ago
https://en.wikipedia.org/wiki/CLOUD_Act
You say that but that's not reflected in the law, and historically the us government has repeatedly created such sweeping surveillance systems. It's highly unlikely they only made it legal, and aren't using it sweepingly considering theyre on record doing so before it was legalized through the act before too...
And as that's international law... It's always kinda a coin toss whenever anyone actually pays it any attention. No real recourse if violated after all.
bartread
18 minutes ago
I think with Anthropic the only way you get control of data residency is to use their models via another platform, so I tend to agree with you.
IIRC OpenAI do offer data residency controls but only to enterprise customers and subject to minimum spend.
adelekeabdulgan
4 hours ago
why then are they using Microsoft Copilot?
pelorat
24 minutes ago
They have a business deal with Microsoft, they have no business deals with Anthropic or OpenAI. Employees were using their private subscriptions for work related tasks. I guess a strongly worded letter to the employees was not enough.
przmk
3 hours ago
Probably for the same reason as in most companies: Microsoft “assured” them that their data is safe… who cares about the Cloud Act, right?
mr_mitm
3 hours ago
Or: Microsoft has the data already, so why give the data to Anthropic and OpenAI, too?
kevin_thibedeau
3 hours ago
Microsoft will helpfully house that data in China. The others won't.
igl
3 hours ago
AWS and GCP also use local Chinese joint-venture partners to comply with Chinese regulations. Warm greetings to Moscow!
tonyhart7
3 hours ago
I rather trust MS than OpenAI or Antrophic
MS don't train your data
InsidiousWombat
2 hours ago
MS barely trains on their own data given how shit copilot is even when dealing with MS stuff
nalekberov
3 hours ago
I second this.
Roark66
3 hours ago
Same reason why the Fortune 200 company I'm currently doing some work for uses it. 70% discount on api costs compared with Anthropic, but access to the same Anthropic models.
Here every person gets $500 of copilot "credits" per month and that is a lot of use. $500 in Anthropic API gets used in 3 days.
The only disadvantage is that copilot cli has a very crappy and limited plugin system. For example a plugin can register a hook when a model calls a tool, but it's impossible to show a question to a user from such plugin.
Also it's "Autopilot" mode is designed to waste tokens. It injects things like "did you do absolutely everything you can about this? If not continue" and it's impossible to disable this without reverse engineering.
adelekeabdulgan
2 hours ago
I dont think opting for copilot on a cost basis fit into "ban".
refactor_master
2 hours ago
Because nobody was ever fired from choosing Microsoft, and apparently this still holds for AI?
trilogic
an hour ago
The rise of HugstonOne.
sandworm101
4 hours ago
It is part of the trend to locally-hosted AI. I demoed my home rig (3x5060s) to my boss last week. It certainly was not as performant as commercial options, but was well above the 90% solution for what we needed. The boss was shocked at the price points for home-built hardware. Gaming GPUs are pricy, but are nowhere near the prices for commercial (rack-mount) compute hardware.
(People actually came by my desk to see "the AI", the physical thing. It blows people's minds to realize AI doesn't need a data center, that it is just some computer parts sitting on a desk.)
The big hitter AI companies see the writing on the wall: open source models and local AI rigs will decimate the market for big AI in the next few years.
snarf21
3 hours ago
I see this as the eventually end game. Open source models and local hardware are going to be the only path forward for companies as the AI providers move to a constant need to increase prices to drive profitability and stock price.
wafflemaker
3 hours ago
Can you post a picture? It sounds super cool. Was it a specialized hardware, or a consumer mobo with 3 PCIe slots?
sandworm101
3 hours ago
It is just a Asrock motherboard and 1000w corsair power supply sitting on the bottom shelf of a "mining rack" open air case. The GPUs are attached with janky pci risers (the motherboard has four pci slots). I went with 5060s so I could stay with "short" 2-fan cards. The boot drive is a 500GB NVME with an encrypted 2tb NVME for storage, both on the mobo. I added four cheap fans and an oldschool (with a nob) fan controller to circulate air away from the GPUs. RAM options are maxed out at 4x16GB DDR4 sticks. Expansion options include adding a fourth 5060 and any number of SATA storage drives for content/models.
It, of course, runs on linux. I went with stock ubuntu so I could attach a screen and/or remote in to a full GUI. Having a full GUI also makes the rig more relatable to people who's eye glaze over when they see a terminal interface. "It's just a funny-looking desktop computer."
At 48GB of VRAM it can run basically any LLM I would want to download. Speeds are fine for a single user (Tok/s numbers change based on model/mode). But if I were using it for something like ComyfUI I would ditch the multiple 5060s and go with a 5070ti or 5080 as ComfyUI does better with a single powerful GPU.
sebzim4500
3 hours ago
It's not locally hosted, as they say they will be accessing the same models but through a controlled system rather than on their own accounts
rmnwski
3 hours ago
Interesting! How many token/s using what model are you getting out of it? And what are the other specs?
vocram
4 hours ago
Cool, but that sounds out of reach financially and technically for most people
flir
3 hours ago
I don't think it will be the moment nvidia decide there's more money to be made in selling hardware for local-first inference. They'll do the training themselves and give the models away for free, like the toy in a box of cornflakes.
I'm sure cloud models will always have a slight edge but most tasks, most of the time, won't need that few extra percentage points of performance.
antihipocrat
3 hours ago
In a lot of sci-fi games an upgrade path for ship/cybernetic hardware is to replace the 'AI chip'. If the models performance ever start to plateau I can't wait to see AI models being baked into the chip itself.
flir
13 minutes ago
Somebody did it... here we go: https://taalas.com/the-path-to-ubiquitous-ai/
Llama 3.1 8B baked into an ASIC. Expect 1/10th the power requirements, and other savings.
This is one of the reasons I don't believe the "it'll never be profitable" narrative. Just stop training when you think your model's "good enough" and move to custom silicon.
sandworm101
3 hours ago
>> out of reach financially and technically for most people
Yes and no. I bought most of the hardware before the rampocalypse. It is just an AM4 chip on a nothing motherboard. Even today, 16GB 5060s are maybe 500 each. 64GB of DDR4 is another 500$. Add a power supply and pci risers and the basic parts could be purchased today for around 3000$... call it 4000$ all-in including my labor to get everything connected and talking to each other.
4000$ is money but is also almost nothing in the world of commercial IT purchases.
logicchains
3 hours ago
The article is about the Swedish Government, hopefully it wouldn't be out of reach for them.
nayroclade
4 hours ago
They're using Copilot, not locally-hosted AI.