LLM & Agent Evaluation

Agentic Traces

Connect observability tools to enable human-in-the-loop review

RLHF & Fine-Tuning

Collect human preferences, corrections, rankings

LLM Evaluations

Create custom benchmarks and rubrics, side-by-side comparison

RAG & Retrieval QA

Evaluate retrieval relevance, grade generated answers against source

Computer Vision

Image Classification

Put images into categories

Object Detection

Detect objects on image, boxes, polygons, circular, and keypoints supported

Object Tracking

Label and track multiple objects frame-by-frame

Semantic Segmentation

Partition image into multiple segments. Use ML models to pre-label and optimize the process

NLP, Documents, Chatbots

PDF & Image OCR

Annotate complex, large-scale documents with ease

Named Entity Recognition

Extract and put relevant bits of information into pre-defined categories

Question Answering

Answer questions based on context

Sentiment Analysis

Determine whether a document is positive, negative or neutral

Audio & Speech

Audio Transcription

Advanced interface for speed and precision at scale

Waveform or Spectrogram

Supports advanced audio files and use cases

Speaker Diarization

Partition an input audio stream into homogeneous segments according to the speaker identity

Emotion Recognition

Tag and identify emotion from the audio

Robots, Sensors, IoT Devices

Classification

Put time series into categories

Segmentation

Identify regions relevant to the activity type you're building your ML algorithm for

Event Recognition

Label single events on plots of time series data

Multi-Modal

Dialogue Processing

Call center recording can be simultaneously transcribed and processed as text

Optical Character Recognition

Put an image and text right next to each other

Time Series with Reference

Use video or audio streams to easier segment time series data