CodesInChaos
3 hours ago
> In a snake-eating-its-own-tail irony, a 2023 analysis found that between 33% and 46% of workers on the platform were using large language models to complete their tasks,
I assume AI use by workers has risen to the point where it renders Mechanical Turk pointless.
6510
2 minutes ago
I don't see why I would care how they do the job. Just do the job, I have other things to do.
skt5
an hour ago
This likely means those consuming the outputs of Mechanical Turk don't have a good way to measure the value (aka quality) of the outputs.
If they did - then they shouldn't care whether it's a human or a LLM. And if it's a LLM - then the cost will roughly correlate to the MIN(cost of the LLM, cost of a human) to do the task.
AndrewOMartin
25 minutes ago
I think the "state of the art" of measuring the quality of outputs was to send the same task to multiple "agents" and only accept answers if over a certain amount agree. With some human review and reputation scoring sprinkled on top. It was a while since I was in this field though
moralestapia
3 hours ago
Yeah, I was doing this kind of Artificial Artificial Artificial Intelligence back in 2012 to make some extra $$$. Glad they finally "patched" that hole ^^.
pc86
2 hours ago
You were using LLMs in 2012?
subarctic
an hour ago
Artificial AI = stuff like mechanical turk where they get humans to do stuff computers can't do and make it look like it's "AI"
Artificial Artificial Intelligence = using computers to do mechanical turk jobs
moralestapia
an hour ago
You wrote the same thing twice, hehe.
But the point gets across.
simlevesque
2 hours ago
They were faking artificial intelligence by using real individuals.
pixel_popping
2 hours ago
Fiverr-5.5 was the leading model back then.
moralestapia
2 hours ago
Not LLMs. (Useful) LLMs came to the market around 2022.