In a real-world test, the best AI completed 1 in 40 full tasks satisfactorily. Researchers put together the Remote Labor Index, a set of 100 typical remote working tasks – data visualization, architecture drawing, game development, etc. These are the kind of tasks you would normally give to remote gig workers through an online task platform.
The results are sobering. The best AI was Manus, delivering 2.5% acceptable results. Gemini 2.5 Pro managed only 0.8% task completion.
Don’t be blinded by the fact that AI can solve a few very specific tasks well. In the real world, AI is very, very far from taking anybody’s job.
It’s refreshing to see some real-world data that puts the hype about AI replacing jobs into perspective. AI’s ability to handle specific tasks is impressive, but as this test shows, there’s still a long way to go before it can take over complex work that requires human judgment and creativity.