Agent Ecosystem#

Welcome to the FiftyOne Agent Ecosystem! ๐Ÿค–

Here youโ€™ll discover expert workflows, MCP-powered tools, and skills that let AI assistants take real action on your data.

FiftyOne agents go beyond code generation. They import datasets, run model inference, find duplicates, evaluate predictions, and build custom plugins, all from a single prompt. Browse the skills below to see what your agent can do out of the box, or develop your own.


๐Ÿ“ฅ fiftyone-dataset-import

Universal dataset import for FiftyOne supporting all media types (images, videos, point clouds, 3D scenes), all label formats (COCO, YOLO, VOC, CVAT, KITTI, etc.), multimodal grouped datasets, and Hugging Face Hub datasets. Use when users want to import any dataset regardless of format or source, load datasets from Hugging Face, handle autonomous driving data with multiple cameras and LiDAR, or create grouped datasets from multimodal data.

Import

๐Ÿ“ค fiftyone-dataset-export

Export FiftyOne datasets to standard formats (COCO, YOLO, VOC, CVAT, CSV, etc.) and Hugging Face Hub. Use when converting datasets, exporting for training, creating archives, sharing data in specific formats, or publishing datasets to Hugging Face Hub.

Export

๐Ÿ” fiftyone-find-duplicates

Find duplicate or near-duplicate images in FiftyOne datasets using brain similarity computation. Use when users want to deduplicate datasets, find similar images, cluster visually similar content, or remove redundant samples. Requires FiftyOne MCP server with @voxel51/brain plugin installed.

QA

๐Ÿค– fiftyone-dataset-inference

Run model inference on FiftyOne datasets using Zoo models or custom models. Use when applying ML models for detection, classification, segmentation, or embeddings on existing datasets.

Inference

๐Ÿ“ˆ fiftyone-model-evaluation

Evaluate model predictions against ground truth using COCO, Open Images, or custom protocols. Use when computing mAP, precision, recall, confusion matrices, or analyzing TP/FP/FN examples for detection, classification, segmentation, or regression tasks.

Evaluation

๐Ÿ“Š fiftyone-embeddings-visualization

Visualize datasets in 2D using embeddings with UMAP or t-SNE dimensionality reduction. Use when users want to explore dataset structure, find clusters in images, identify outliers, color samples by class or metadata, or understand data distribution.

Embeddings

๐Ÿงน fiftyone-dataset-curation

End-to-end dataset curation for any FiftyOne dataset\: inspect schema and media quality (blur, brightness, corruption, resolution), audit annotation quality (mistakenness, hardness, duplicate labels, IoU overlaps), analyze class distributions and imbalances, explore embedding space and data gaps, find near/exact duplicates, create curated subsets using semantic search and brain ops, build train/val/test splits, and answer natural language questions about your data. Delegates to fiftyone-find-duplicates and fiftyone-embeddings-visualization. Requires FiftyOne MCP server with @voxel51/brain and @voxel51/utils plugins.

Curation

๐Ÿ”Œ fiftyone-develop-plugin

Develop custom FiftyOne plugins (operators and panels) from scratch. Use when users want to create, build, or develop a new plugin for FiftyOne App, extend FiftyOne with custom operators, create interactive panels, add new functionality to FiftyOne, or integrate external APIs/services into FiftyOne.

Development

๐Ÿ“ fiftyone-code-style

Write Python code following FiftyOne's official conventions. Use when contributing to FiftyOne, developing plugins, or writing code that integrates with FiftyOne's codebase. Covers module structure, import organization, Google-style docstrings, lazy imports, guard patterns, and error handling.

Development

๐ŸŽจ fiftyone-voodo-design

Build FiftyOne UIs using VOODO (@voxel51/voodo), the official React component library. Use when building plugin panels, creating interactive UIs, styling FiftyOne applications, or needing React components with proper design tokens. Fetches complete component API reference dynamically.

Development

๐Ÿท๏ธ fiftyone-issue-triage

Triage FiftyOne GitHub issues by validating status, categorizing resolution, and generating standardized responses. Use when reviewing issues to determine if already fixed, won't fix, not reproducible, no longer relevant, or still valid. Includes investigation workflow and response templates.

Support

๐Ÿ““ fiftyone-create-notebook

Creates Jupyter notebooks for FiftyOne workflows including getting-started guides, tutorials, recipes, and full ML pipelines. Use when users want to create a notebook, write a tutorial, build a demo, document a workflow, or generate a FiftyOne walkthrough covering data loading, exploration, inference, evaluation, and export. Builds notebooks cell-by-cell using NotebookEdit.

Development

๐Ÿ”ง fiftyone-troubleshoot

Diagnose and fix common FiftyOne issues automatically. Use when a dataset disappeared, the App won't open, changes aren't saving, MongoDB errors occur, video codecs fail, notebook connectivity breaks, operators are missing, or any recurring FiftyOne pain point needs solving. Includes a NEVER-DO safety section to prevent accidental data loss or direct MongoDB manipulation.

Support

๐Ÿ”Œ fiftyone-generate-data-lens-connector

Generate a Data Lens connector from an external database schema. Use when users want to connect an external data source (PostgreSQL, BigQuery, Databricks, MySQL, SQLite, etc.) to FiftyOne Data Lens, create a DataLensOperator from a CREATE TABLE statement or column list, or build a plugin that lets users browse and import data from their database through the FiftyOne App.

Development

๐Ÿ›ก๏ธ fiftyone-eval-plugin

Evaluates FiftyOne plugins for quality, security, and agent-readiness. Use when reviewing a plugin before installation, auditing an existing plugin, validating a plugin you just built, or assessing community plugins for safety. Checks manifest integrity, security risks (filesystem access, network calls, command execution, data exfiltration), schema quality, risk classification, code conventions, and agent discoverability. Produces a structured report with scores and actionable recommendations.

Development

๐Ÿงฉ fiftyone-zoo-remote-model

Integrate models into FiftyOne's remote model zoo. Use when wrapping a model (detection, classification, segmentation, embedding, keypoint, or vision-language) for `register_zoo_model_source` and `load_zoo_model` so it works with `dataset.apply_model`, debugging zoo registration, fixing `manifest.json` issues, building custom `fom.Model` / `TorchModelMixin` subclasses, or resolving DataLoader pickle errors and `ModuleNotFoundError` from spawned multi-worker DataLoader workers.

Development