Data Annotation
Crowd platform where vetted contributors train AI models through writing, ranking and evaluation tasks.
About
Data Annotation (dataannotation.tech) is a crowd platform where vetted contributors train AI models by writing prompts, ranking responses, reviewing code and solving STEM problems, the core human-feedback loop behind RLHF. The platform is operated by Surge Labs, Inc. (the site's header reads "powered by surge"), the Surge AI subsidiary behind the contractor-facing side of one of the largest data-labeling businesses in the industry. The site advertises starting pay of $20 per hour with higher rates for coding and specialist tracks, and pays contributors weekly via PayPal, which has made it one of the most talked-about AI gig platforms of the last two years.
Task categories span chatbot evaluation and response ranking, code review, writing and editing, math and science problems, multilingual work and image tasks, with accuracy as the gating metric and higher-paying projects unlocked by strong quality scores. Caveat: onboarding is competitive, work availability varies week to week, and eligibility is restricted to a handful of countries (US, UK, Canada, Australia, New Zealand and Ireland), so it is not a general-purpose annotation vendor for enterprises.
What it can do
- RLHF response ranking and preference-pair generation
- AI code evaluation and debugging tasks
- Prompt writing and content editing
- STEM and multilingual annotation projects
- Weekly PayPal payouts with no minimum threshold
Setup
Apply on dataannotation.tech, pass the starter assessment for your skill track, then pick up tasks from the dashboard.
Prerequisites
Residency in a supported country; passing score on the qualification assessment.
Use cases
Works with
Trust score — 7/10
Scored 7/10 (verified tier, metrics-v1). Evidence: Strengths: operated by Surge Labs, Inc. (Surge AI subsidiary; confirmed via court filings, Time reporting and the site's own 'powered by surge' branding); widely covered by independent reviewer sites in 2025-2026, weekly PayPal payouts, structured RLHF task taxonomy; core RLHF loop: response ranking, code review, prompt writing, STEM tasks; Docked for: (1) no public enterprise offering, contributor-side product only; (2) work availability varies; (3) geo-restricted to ~6 countries. Manual review: caveat on competitive onboarding and inconsistent availability noted in entry. License: proprietary (crowd platform; contributor pay from $20/hr advertised).
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 8.0/10
- Maintenance · recency, releases, issue load
- 7.0/10
- Openness · license + docs
- 4.0/10
- Manual review · sanity read + red-flag check
- 7.0/10
- · Strengths: operated by Surge Labs, Inc. (Surge AI subsidiary; confirmed via court filings, Time reporting and the site's own 'powered by surge' branding)
- · widely covered by independent reviewer sites in 2025-2026, weekly PayPal payouts, structured RLHF task taxonomy
- · core RLHF loop: response ranking, code review, prompt writing, STEM tasks
- · Docked for: (1) no public enterprise offering, contributor-side product only; (2) work availability varies; (3) geo-restricted to ~6 countries
- · manual review: caveat on competitive onboarding and inconsistent availability noted in entry
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.