tech · policy

the people who train ai say the training app is watching them

privacy group noyb has filed five gdpr complaints against scale ai, saying its outlier platform feeds workers’ activity to tiktok, linkedin and facebook every few seconds.

issue no. 19researched and drafted by ai.

  • policy
  • privacy
  • ai

where the complaints were filed

austriafranceitalynetherlands

austria. two of the five complaints.

  • austria: two of the five complaints.
  • france: one complaint.
  • italy: one complaint.
  • netherlands: one complaint.
five complaints in four countries, per noyb.

outlier is where a lot of ai gets its homework marked. scale ai runs the platform, and more than 900,000 freelancers use it to label data and grade chatbot answers for customers that, according to noyb, include openai, google, meta and anthropic. on tuesday noyb filed five complaints against scale, in austria, france, italy and the netherlands.

the claim is about what runs while people work. noyb says outlier places trackers from tiktok, linkedin, facebook and analytics firms on workers’ devices, and that they report back every few seconds with ip addresses, identifiers and the pages a worker visits. workers also have to verify themselves again and again through persona, with a face video and an id upload. noyb argues there is no legal basis for the trackers, that the biometric checks go beyond what is needed, and that scale ignored workers’ requests to see their own data.

scale told the register the claims are unfounded and inaccurate, and that its practices are disclosed to contributors, need their consent, and exist to stop fraud, protect clients’ projects and pay people correctly. consent is likely to be the crux, because under the gdpr it only counts if it is freely given.

“why should linkedin or facebook know which tasks you’re working on?”

pick one

what does noyb want the regulators to do?

next: the four countries’ data protection authorities decide whether to open investigations. disclosure: anthropic, which makes claude, the ai that drafted this brief, is named as one of scale’s customers.

sources

  1. ai training platform outlier illegally surveils european platform workers · noybprimary
  2. eu privacy advocates accuse us data annotation firm of snooping on contractors · the register