peterindia.net

Data Labeling Software

A hand-verified directory of data labeling and annotation platforms — from managed human-in-the-loop services to open-source, self-hosted tools for building high-quality machine learning training data.

Enterprise & Managed Data Labeling Platforms 5

Full-service platforms pairing software with vetted human annotation workforces, built for large-scale, high-accuracy training data programs.

1

Appen

Delivers expert human data for frontier AI, with 30 years of data excellence helping teams build, train, and deploy trustworthy AI models across 500+ locales.

Human-in-the-LoopRLHFFrontier AI
Visit site →

End-to-end platform to annotate, version, and manage ground truth data for your AI, ranked the #1 data annotation platform on G2.

MultimodalRLHF/SFTEnterprise
Visit site →

Formerly TELUS International; enriches data with a global range of human-annotation services at scale, spanning generative AI, physical AI, and robotics data.

Human AnnotationManaged ServicesRebranded
Visit site →

Formerly marketed as Scale Rapid; collects, curates, and annotates data to train and evaluate models with high-quality labels from domain experts.

RLHFGenerative AIRenamed
Visit site →

Now positioned as an RL data engine for AI teams, partnering with leading AI labs on environments, custom evaluations, and enterprise agent training.

RL EnvironmentsEvaluationsFrontier AI
Visit site →

Cloud & Vision-Specific Annotation Platforms 3

Cloud-native and specialized annotation tooling for computer vision, multi-sensor, and AI-application development pipelines.

Formerly SageMaker Data Labeling; helps build highly accurate training datasets and now includes hands-on support to fine-tune generative AI models.

Cloud-NativeAWSRenamed
Visit site →

An enterprise-first AI development platform combining data management, models, pipelines, and human feedback in one unified, ready-to-go environment.

AI DevelopmentPipelinesMarketplace
Visit site →

Multi-sensor LiDAR annotation and calibration tools to accelerate computer vision training for autonomous vehicles, robotics, and physical AI.

LiDARAutonomous VehiclesCalibration
Visit site →

Open Source & Self-Hosted Annotation Tools 5

Free and community-driven annotation tools that can be self-hosted, customized, and integrated directly into ML pipelines.

The most flexible open-source data labeling and AI evaluation platform, supporting agent traces, LLM evals, RLHF, computer vision, and NLP.

Open SourceMultimodalSelf-Hosted
Visit site →
10

CVAT

A leading platform for building high-quality visual datasets, now maintained under the independent cvat-ai GitHub org (moved from Intel's OpenVINO Toolkit).

Open SourceVideo/ImageMoved Org
Visit site →

A graphical image annotation tool; now archived and part of the Label Studio community, with the repository preserved under HumanSignal's GitHub org.

Open SourceArchivedSuperseded
Visit site →
12

Sloth

A tool for labeling image and video data for computer vision research, built in Python with a lightweight, extensible design.

Open SourceResearchPython
Visit site →
13

tagtog

An AI-enabled text annotation tool at its core for NLP, supporting PDF, Markdown, CSV, HTML, and tweets to create labeled datasets.

NLPText AnnotationAI-Assisted
Visit site →