Skip to main content
FiftyOne 1.19.0 documentation - Home FiftyOne 1.19.0 documentation - Home
Product
  • Data Annotation
  • Data Curation
  • Model Evaluation
  • Integrations
  • Plugins
Solutions
  • Agriculture
  • Autonomous Vehicles & Systems
  • Aviation
  • Defense
  • Healthcare
  • Manufacturing
  • Research
  • Retail
  • Robotics
  • Security
  • Sports
Customers
Resources
  • Blog
  • Upcoming Events
  • On-Demand Webinars
  • Whitepapers & Reports
  • Computer Vision Community
  • CV Research
  • Newsroom
Docs
Book a demo

Get Started

  • Overview
  • Installation
    • Usage environments
    • Python venvs
    • Upgrading MongoDB
    • Troubleshooting
  • Getting Started
    • Building Plugins with AI Agents NEW
    • Auto Labeling Guide
      • Prepare Your Dataset and Delegated Operators
      • Configure Auto Labeling Run
      • Analyze Predictions
      • Visualize Embeddings
      • Finalize Approvals
      • Guide Summary
    • Annotation Guide NEW
      • Quickstart: Multimodal Annotation
      • Setup Data Splits
      • Smart Sample Selection
      • 2D Annotation + QA
      • 3D Annotation
      • Train + Evaluate
      • Iteration Loop
      • Guide Summary
    • Object Detection Guide
      • Loading Detection Datasets
      • Adding Object Detections
      • Finding Detection Mistakes
      • Evaluating Detections
      • Guide Summary
    • Medical Imaging Guide
      • Getting Started with Medical Imaging
      • Guide Summary
    • Self-Driving Guide
      • Loading Self-Driving Datasets
      • Advanced Self-Driving Techniques
      • Guide Summary
    • 3D Visual AI Guide
      • Getting Started with 3D Datasets
      • Getting Started with Loading 3D Annotations
      • Guide Summary
    • Model Evaluation Guide
      • Basic Model Evaluation
      • Advanced Evaluation Analysis
      • Guide Summary
    • Segmentation Guide
      • Loading a Segmentation Dataset
      • Adding Instance Segmentations
      • Segment Anything 2 in FiftyOne
      • Guide Summary
    • Depth Estimation Guide
      • Loading Depth Data
      • Using Depth Estimation Models
      • Guide Summary
    • Model Dataset Zoo Guide
      • Exploring the Dataset Zoo
      • Exploring the Model Zoo
      • Exploring Remote Zoo Models
      • Guide Summary
    • Manufacturing Guide
      • Manufacturing Datasets
      • Understanding and Using Embeddings
      • Clustering and Labeling with Embeddings
      • Custom Embeddings for Industrial Data
      • Integrations, Plugins, and Model Evaluation
      • Data Augmentation for Manufacturing
      • 3D Visualization for Defect Inspection
      • Extended Dataset Exploration
      • Valeo Anomaly Dataset
      • PPE Detection and Safety Monitoring
      • Video Analytics for Safety
      • Guide Summary

Workflows

  • Data I/O
    • Importing data
    • Exporting datasets
    • Data Lens πŸš€
    • Cloud-backed media πŸš€
  • Curation: Pre-Annotation
    • Using image embeddings
    • Dimensionality reduction
    • Clustering images
    • Exploring image uniqueness
    • Removing duplicate images
  • Annotation
    • Annotating datasets
    • Annotation Workflows πŸš€ NEW
    • Auto-Labeling πŸš€
    • Building Annotation Workflows and Ontologies NEW
  • Curation: Post-Annotation
    • Data Quality πŸš€
    • Finding classification mistakes
    • Finding detection mistakes
    • Removing duplicate objects
  • Model Training
    • Data Loading with Torch Datasets
    • Torch dataset basics
    • Training on MNIST with Torch
    • Speed Up FiftyOneTorchDataset with Vectorize Mode
    • Training with Detectron2
    • Fine-tuning YOLOv8 models
  • Model Inference
    • Adding object detections
    • Adding classifier predictions
    • Zero-shot classification
  • Model Evaluation
    • Evaluating models NEW
    • Evaluating object detections
    • Evaluating a classifier

Fundamentals

  • FiftyOne Concepts
    • FiftyOne basics
    • Dataset views
    • Grouped datasets
    • Using aggregations
    • Interactive plots
    • Drawing labels on samples
    • Using sample parsers
    • Configuring FiftyOne
    • Roles and permissions πŸš€
    • Dataset Versioning πŸš€
    • Query Performance πŸš€
  • Using datasets
  • FiftyOne App
  • FiftyOne Enterprise πŸš€
    • Overview
    • Installation
    • Getting Started
    • API connection
    • App
    • Secrets
    • Management SDK
    • Migrations
    • Pluggable Auth
  • FiftyOne Brain
    • Overview
    • Labs
  • FiftyOne Multimodal NEW

FiftyOne Ecosystem

  • Dataset Zoo
    • Overview
    • Remote datasets
    • API reference
  • Model Zoo
    • Overview
    • Remote models
    • Model interface
    • API reference
  • Agents
    • Using Agents
    • Developing Tools & Skills
    • FiftyOne Agent πŸš€ NEW
  • Plugins
    • Overview
    • Using plugins
    • Developing plugins
    • Contributing plugins
    • Enterprise plugins πŸš€
    • API reference
      • plugins.operators
        • plugins.operators.model_evaluation
        • plugins.operators.annotation
        • plugins.operators.dataset
        • plugins.operators.group_by
      • plugins.panels
        • plugins.panels.model_evaluation
        • plugins.panels.similarity_search
      • plugins.utils
        • plugins.utils.model_evaluation
    • TypeScript API reference
      • @fiftyone/state
      • @fiftyone/plugins
      • @fiftyone/operators
      • @fiftyone/spaces
      • @fiftyone/aggregations
      • @fiftyone/relay
      • @fiftyone/utilities
  • Integrations
    • COCO
    • Open Images
    • ActivityNet
    • Integrating with Annotation Backends
    • CVAT
    • Annotating with CVAT
    • Label Studio
    • V7
    • Labelbox
    • Annotating with Labelbox
    • Qdrant
    • Redis
    • Pinecone
    • MongoDB
    • Elasticsearch
    • PostgreSQL Pgvector
    • Databricks Mosaic AI
    • Milvus
    • LanceDB
    • Hugging Face
    • Ultralytics
    • TwelveLabs
    • Albumentations
    • SuperGradients
    • OpenCLIP
    • PyTorch Hub
    • Lightning Flash

Resources

  • Tutorials
    • Using FiftyOne Skills with Gemini CLI NEW
    • Integrating NVIDIA Cosmos-Transfer with FiftyOne NEW
    • Google Gemini Vision in FiftyOne NEW
    • Exploring Kaputt Dataset
    • DINOv3 visual search
    • pandas and FiftyOne
    • Working with Open Images
    • Embeddings with Qdrant
    • 3D point clouds with Point-E
    • Monocular depth estimation
    • Data augmentation
    • Detecting small objects
    • Anomaly detection
  • Recipes
    • Creating views
    • Draw labels on samples
    • Convert dataset formats
    • Merging datasets
    • Custom dataset importers
    • Custom dataset exporters
    • Custom sample parsers
  • Cheat Sheets
    • FiftyOne terminology
    • Filtering cheat sheet
    • Views cheat sheet
    • pandas vs FiftyOne
  • CLI
  • API Reference
    • fiftyone.brain
      • fiftyone.brain.internal
        • fiftyone.brain.internal.core
        • fiftyone.brain.internal.models
      • fiftyone.brain.config
      • fiftyone.brain.similarity
      • fiftyone.brain.visualization
    • fiftyone.core
      • fiftyone.core.annotation
        • fiftyone.core.annotation.attributes
        • fiftyone.core.annotation.constants
        • fiftyone.core.annotation.generate_label_schemas
        • fiftyone.core.annotation.hydrate_label_schemas
        • fiftyone.core.annotation.nodes
        • fiftyone.core.annotation.utils
        • fiftyone.core.annotation.validate_label_schemas
      • fiftyone.core.map
        • fiftyone.core.map.batcher
        • fiftyone.core.map.factory
        • fiftyone.core.map.mapper
        • fiftyone.core.map.process
        • fiftyone.core.map.threading
        • fiftyone.core.map.typing
      • fiftyone.core.odm
        • fiftyone.core.odm.database
        • fiftyone.core.odm.dataset
        • fiftyone.core.odm.document
        • fiftyone.core.odm.embedded_document
        • fiftyone.core.odm.frame
        • fiftyone.core.odm.mixins
        • fiftyone.core.odm.ontology
        • fiftyone.core.odm.runs
        • fiftyone.core.odm.sample
        • fiftyone.core.odm.utils
        • fiftyone.core.odm.views
        • fiftyone.core.odm.workspace
      • fiftyone.core.plots
        • fiftyone.core.plots.base
        • fiftyone.core.plots.manager
        • fiftyone.core.plots.matplotlib
        • fiftyone.core.plots.plotly
        • fiftyone.core.plots.utils
        • fiftyone.core.plots.views
      • fiftyone.core.session
        • fiftyone.core.session.client
        • fiftyone.core.session.constants
        • fiftyone.core.session.events
        • fiftyone.core.session.notebooks
        • fiftyone.core.session.session
        • fiftyone.core.session.templates
        • fiftyone.core.session.utils
      • fiftyone.core.threed
        • fiftyone.core.threed.camera
        • fiftyone.core.threed.lights
        • fiftyone.core.threed.material_3d
        • fiftyone.core.threed.mesh
        • fiftyone.core.threed.object_3d
        • fiftyone.core.threed.pointcloud
        • fiftyone.core.threed.scene_3d
        • fiftyone.core.threed.shape_3d
        • fiftyone.core.threed.transformation
        • fiftyone.core.threed.utils
        • fiftyone.core.threed.validators
      • fiftyone.core.aggregations
      • fiftyone.core.brain
      • fiftyone.core.camera
      • fiftyone.core.cli
      • fiftyone.core.clips
      • fiftyone.core.collections
      • fiftyone.core.config
      • fiftyone.core.context
      • fiftyone.core.dataset
      • fiftyone.core.document
      • fiftyone.core.evaluation
      • fiftyone.core.expressions
      • fiftyone.core.fields
      • fiftyone.core.frame
      • fiftyone.core.frame_utils
      • fiftyone.core.groups
      • fiftyone.core.json
      • fiftyone.core.labels
      • fiftyone.core.logging
      • fiftyone.core.media
      • fiftyone.core.metadata
      • fiftyone.core.models
      • fiftyone.core.ontology
      • fiftyone.core.ontology_validation
      • fiftyone.core.patches
      • fiftyone.core.runs
      • fiftyone.core.sample
      • fiftyone.core.service
      • fiftyone.core.singletons
      • fiftyone.core.stages
      • fiftyone.core.state
      • fiftyone.core.storage
      • fiftyone.core.tags
      • fiftyone.core.uid
      • fiftyone.core.utils
      • fiftyone.core.validation
      • fiftyone.core.video
      • fiftyone.core.view
    • fiftyone.factory
      • fiftyone.factory.repos
        • fiftyone.factory.repos.delegated_operation
        • fiftyone.factory.repos.delegated_operation_doc
        • fiftyone.factory.repos.execution_store
      • fiftyone.factory.repo_factory
    • fiftyone.migrations
      • fiftyone.migrations.runner
    • fiftyone.operators
      • fiftyone.operators.cache
        • fiftyone.operators.cache.decorator
        • fiftyone.operators.cache.ephemeral
        • fiftyone.operators.cache.serialization
        • fiftyone.operators.cache.utils
      • fiftyone.operators.store
        • fiftyone.operators.store.clone
        • fiftyone.operators.store.models
        • fiftyone.operators.store.notification_service
        • fiftyone.operators.store.service
        • fiftyone.operators.store.store
        • fiftyone.operators.store.subscription_registry
      • fiftyone.operators.categories
      • fiftyone.operators.constants
      • fiftyone.operators.decorators
      • fiftyone.operators.delegated
      • fiftyone.operators.evaluation_metric
      • fiftyone.operators.events
      • fiftyone.operators.executor
      • fiftyone.operators.logging_utils
      • fiftyone.operators.message
      • fiftyone.operators.operations
      • fiftyone.operators.operator
      • fiftyone.operators.panel
      • fiftyone.operators.permissions
      • fiftyone.operators.registry
      • fiftyone.operators.remote_notifier
      • fiftyone.operators.server
      • fiftyone.operators.sse
      • fiftyone.operators.types
      • fiftyone.operators.utils
    • fiftyone.plugins
      • fiftyone.plugins.constants
      • fiftyone.plugins.context
      • fiftyone.plugins.core
      • fiftyone.plugins.definitions
      • fiftyone.plugins.secrets
      • fiftyone.plugins.skills
      • fiftyone.plugins.utils
    • fiftyone.types
      • fiftyone.types.dataset_types
    • fiftyone.utils
      • fiftyone.utils.clip
        • fiftyone.utils.clip.model
        • fiftyone.utils.clip.tokenizer
        • fiftyone.utils.clip.zoo
      • fiftyone.utils.data
        • fiftyone.utils.data.base
        • fiftyone.utils.data.converters
        • fiftyone.utils.data.exporters
        • fiftyone.utils.data.importers
        • fiftyone.utils.data.ingestors
        • fiftyone.utils.data.parsers
      • fiftyone.utils.eval
        • fiftyone.utils.eval.activitynet
        • fiftyone.utils.eval.base
        • fiftyone.utils.eval.classification
        • fiftyone.utils.eval.coco
        • fiftyone.utils.eval.detection
        • fiftyone.utils.eval.openimages
        • fiftyone.utils.eval.regression
        • fiftyone.utils.eval.segmentation
      • fiftyone.utils.tracking
        • fiftyone.utils.tracking.deepsort
      • fiftyone.utils.activitynet
      • fiftyone.utils.annotations
      • fiftyone.utils.aws
      • fiftyone.utils.bdd
      • fiftyone.utils.beam
      • fiftyone.utils.caltech
      • fiftyone.utils.cityscapes
      • fiftyone.utils.coco
      • fiftyone.utils.csv
      • fiftyone.utils.cvat
      • fiftyone.utils.depth_anything
      • fiftyone.utils.dicom
      • fiftyone.utils.eta
      • fiftyone.utils.fiw
      • fiftyone.utils.flash
      • fiftyone.utils.geojson
      • fiftyone.utils.geotiff
      • fiftyone.utils.github
      • fiftyone.utils.groups
      • fiftyone.utils.hmdb51
      • fiftyone.utils.huggingface
      • fiftyone.utils.image
      • fiftyone.utils.imagenet
      • fiftyone.utils.iou
      • fiftyone.utils.kinetics
      • fiftyone.utils.kitti
      • fiftyone.utils.labelbox
      • fiftyone.utils.labels
      • fiftyone.utils.labelstudio
      • fiftyone.utils.lfw
      • fiftyone.utils.open_clip
      • fiftyone.utils.openimages
      • fiftyone.utils.openlabel
      • fiftyone.utils.patches
      • fiftyone.utils.pe
      • fiftyone.utils.places
      • fiftyone.utils.quickstart
      • fiftyone.utils.qwen3_vl
      • fiftyone.utils.random
      • fiftyone.utils.rerun
      • fiftyone.utils.rfdetr
      • fiftyone.utils.sam
      • fiftyone.utils.sam2
      • fiftyone.utils.sam3
      • fiftyone.utils.sama
      • fiftyone.utils.scale
      • fiftyone.utils.sharp
      • fiftyone.utils.super_gradients
      • fiftyone.utils.tf
      • fiftyone.utils.torch
      • fiftyone.utils.transformers
      • fiftyone.utils.transforms
      • fiftyone.utils.twelvelabs
      • fiftyone.utils.ucf101
      • fiftyone.utils.ultralytics
      • fiftyone.utils.useragent
      • fiftyone.utils.utils3d
      • fiftyone.utils.video
      • fiftyone.utils.voc
      • fiftyone.utils.yolo
      • fiftyone.utils.youtube
    • fiftyone.zoo
      • fiftyone.zoo.datasets
        • fiftyone.zoo.datasets.base
        • fiftyone.zoo.datasets.tf
        • fiftyone.zoo.datasets.torch
      • fiftyone.zoo.models
        • fiftyone.zoo.models.torch
    • fiftyone.constants
  • Contribute
  • Release Notes
  • Deprecation Notices
  • FAQ
Product
  • Data Annotation
  • Data Curation
  • Model Evaluation
  • Integrations
  • Plugins
Solutions
  • Agriculture
  • Autonomous Vehicles & Systems
  • Aviation
  • Defense
  • Healthcare
  • Manufacturing
  • Research
  • Retail
  • Robotics
  • Security
  • Sports
Customers
Resources
  • Blog
  • Upcoming Events
  • On-Demand Webinars
  • Whitepapers & Reports
  • Computer Vision Community
  • CV Research
  • Newsroom
Docs
Book a demo

Get Started

  • Overview
  • Installation
    • Usage environments
    • Python venvs
    • Upgrading MongoDB
    • Troubleshooting
  • Getting Started
    • Building Plugins with AI Agents NEW
    • Auto Labeling Guide
      • Prepare Your Dataset and Delegated Operators
      • Configure Auto Labeling Run
      • Analyze Predictions
      • Visualize Embeddings
      • Finalize Approvals
      • Guide Summary
    • Annotation Guide NEW
      • Quickstart: Multimodal Annotation
      • Setup Data Splits
      • Smart Sample Selection
      • 2D Annotation + QA
      • 3D Annotation
      • Train + Evaluate
      • Iteration Loop
      • Guide Summary
    • Object Detection Guide
      • Loading Detection Datasets
      • Adding Object Detections
      • Finding Detection Mistakes
      • Evaluating Detections
      • Guide Summary
    • Medical Imaging Guide
      • Getting Started with Medical Imaging
      • Guide Summary
    • Self-Driving Guide
      • Loading Self-Driving Datasets
      • Advanced Self-Driving Techniques
      • Guide Summary
    • 3D Visual AI Guide
      • Getting Started with 3D Datasets
      • Getting Started with Loading 3D Annotations
      • Guide Summary
    • Model Evaluation Guide
      • Basic Model Evaluation
      • Advanced Evaluation Analysis
      • Guide Summary
    • Segmentation Guide
      • Loading a Segmentation Dataset
      • Adding Instance Segmentations
      • Segment Anything 2 in FiftyOne
      • Guide Summary
    • Depth Estimation Guide
      • Loading Depth Data
      • Using Depth Estimation Models
      • Guide Summary
    • Model Dataset Zoo Guide
      • Exploring the Dataset Zoo
      • Exploring the Model Zoo
      • Exploring Remote Zoo Models
      • Guide Summary
    • Manufacturing Guide
      • Manufacturing Datasets
      • Understanding and Using Embeddings
      • Clustering and Labeling with Embeddings
      • Custom Embeddings for Industrial Data
      • Integrations, Plugins, and Model Evaluation
      • Data Augmentation for Manufacturing
      • 3D Visualization for Defect Inspection
      • Extended Dataset Exploration
      • Valeo Anomaly Dataset
      • PPE Detection and Safety Monitoring
      • Video Analytics for Safety
      • Guide Summary

Workflows

  • Data I/O
    • Importing data
    • Exporting datasets
    • Data Lens πŸš€
    • Cloud-backed media πŸš€
  • Curation: Pre-Annotation
    • Using image embeddings
    • Dimensionality reduction
    • Clustering images
    • Exploring image uniqueness
    • Removing duplicate images
  • Annotation
    • Annotating datasets
    • Annotation Workflows πŸš€ NEW
    • Auto-Labeling πŸš€
    • Building Annotation Workflows and Ontologies NEW
  • Curation: Post-Annotation
    • Data Quality πŸš€
    • Finding classification mistakes
    • Finding detection mistakes
    • Removing duplicate objects
  • Model Training
    • Data Loading with Torch Datasets
    • Torch dataset basics
    • Training on MNIST with Torch
    • Speed Up FiftyOneTorchDataset with Vectorize Mode
    • Training with Detectron2
    • Fine-tuning YOLOv8 models
  • Model Inference
    • Adding object detections
    • Adding classifier predictions
    • Zero-shot classification
  • Model Evaluation
    • Evaluating models NEW
    • Evaluating object detections
    • Evaluating a classifier

Fundamentals

  • FiftyOne Concepts
    • FiftyOne basics
    • Dataset views
    • Grouped datasets
    • Using aggregations
    • Interactive plots
    • Drawing labels on samples
    • Using sample parsers
    • Configuring FiftyOne
    • Roles and permissions πŸš€
    • Dataset Versioning πŸš€
    • Query Performance πŸš€
  • Using datasets
  • FiftyOne App
  • FiftyOne Enterprise πŸš€
    • Overview
    • Installation
    • Getting Started
    • API connection
    • App
    • Secrets
    • Management SDK
    • Migrations
    • Pluggable Auth
  • FiftyOne Brain
    • Overview
    • Labs
  • FiftyOne Multimodal NEW

FiftyOne Ecosystem

  • Dataset Zoo
    • Overview
    • Remote datasets
    • API reference
  • Model Zoo
    • Overview
    • Remote models
    • Model interface
    • API reference
  • Agents
    • Using Agents
    • Developing Tools & Skills
    • FiftyOne Agent πŸš€ NEW
  • Plugins
    • Overview
    • Using plugins
    • Developing plugins
    • Contributing plugins
    • Enterprise plugins πŸš€
    • API reference
      • plugins.operators
        • plugins.operators.model_evaluation
        • plugins.operators.annotation
        • plugins.operators.dataset
        • plugins.operators.group_by
      • plugins.panels
        • plugins.panels.model_evaluation
        • plugins.panels.similarity_search
      • plugins.utils
        • plugins.utils.model_evaluation
    • TypeScript API reference
      • @fiftyone/state
      • @fiftyone/plugins
      • @fiftyone/operators
      • @fiftyone/spaces
      • @fiftyone/aggregations
      • @fiftyone/relay
      • @fiftyone/utilities
  • Integrations
    • COCO
    • Open Images
    • ActivityNet
    • Integrating with Annotation Backends
    • CVAT
    • Annotating with CVAT
    • Label Studio
    • V7
    • Labelbox
    • Annotating with Labelbox
    • Qdrant
    • Redis
    • Pinecone
    • MongoDB
    • Elasticsearch
    • PostgreSQL Pgvector
    • Databricks Mosaic AI
    • Milvus
    • LanceDB
    • Hugging Face
    • Ultralytics
    • TwelveLabs
    • Albumentations
    • SuperGradients
    • OpenCLIP
    • PyTorch Hub
    • Lightning Flash

Resources

  • Tutorials
    • Using FiftyOne Skills with Gemini CLI NEW
    • Integrating NVIDIA Cosmos-Transfer with FiftyOne NEW
    • Google Gemini Vision in FiftyOne NEW
    • Exploring Kaputt Dataset
    • DINOv3 visual search
    • pandas and FiftyOne
    • Working with Open Images
    • Embeddings with Qdrant
    • 3D point clouds with Point-E
    • Monocular depth estimation
    • Data augmentation
    • Detecting small objects
    • Anomaly detection
  • Recipes
    • Creating views
    • Draw labels on samples
    • Convert dataset formats
    • Merging datasets
    • Custom dataset importers
    • Custom dataset exporters
    • Custom sample parsers
  • Cheat Sheets
    • FiftyOne terminology
    • Filtering cheat sheet
    • Views cheat sheet
    • pandas vs FiftyOne
  • CLI
  • API Reference
    • fiftyone.brain
      • fiftyone.brain.internal
        • fiftyone.brain.internal.core
        • fiftyone.brain.internal.models
      • fiftyone.brain.config
      • fiftyone.brain.similarity
      • fiftyone.brain.visualization
    • fiftyone.core
      • fiftyone.core.annotation
        • fiftyone.core.annotation.attributes
        • fiftyone.core.annotation.constants
        • fiftyone.core.annotation.generate_label_schemas
        • fiftyone.core.annotation.hydrate_label_schemas
        • fiftyone.core.annotation.nodes
        • fiftyone.core.annotation.utils
        • fiftyone.core.annotation.validate_label_schemas
      • fiftyone.core.map
        • fiftyone.core.map.batcher
        • fiftyone.core.map.factory
        • fiftyone.core.map.mapper
        • fiftyone.core.map.process
        • fiftyone.core.map.threading
        • fiftyone.core.map.typing
      • fiftyone.core.odm
        • fiftyone.core.odm.database
        • fiftyone.core.odm.dataset
        • fiftyone.core.odm.document
        • fiftyone.core.odm.embedded_document
        • fiftyone.core.odm.frame
        • fiftyone.core.odm.mixins
        • fiftyone.core.odm.ontology
        • fiftyone.core.odm.runs
        • fiftyone.core.odm.sample
        • fiftyone.core.odm.utils
        • fiftyone.core.odm.views
        • fiftyone.core.odm.workspace
      • fiftyone.core.plots
        • fiftyone.core.plots.base
        • fiftyone.core.plots.manager
        • fiftyone.core.plots.matplotlib
        • fiftyone.core.plots.plotly
        • fiftyone.core.plots.utils
        • fiftyone.core.plots.views
      • fiftyone.core.session
        • fiftyone.core.session.client
        • fiftyone.core.session.constants
        • fiftyone.core.session.events
        • fiftyone.core.session.notebooks
        • fiftyone.core.session.session
        • fiftyone.core.session.templates
        • fiftyone.core.session.utils
      • fiftyone.core.threed
        • fiftyone.core.threed.camera
        • fiftyone.core.threed.lights
        • fiftyone.core.threed.material_3d
        • fiftyone.core.threed.mesh
        • fiftyone.core.threed.object_3d
        • fiftyone.core.threed.pointcloud
        • fiftyone.core.threed.scene_3d
        • fiftyone.core.threed.shape_3d
        • fiftyone.core.threed.transformation
        • fiftyone.core.threed.utils
        • fiftyone.core.threed.validators
      • fiftyone.core.aggregations
      • fiftyone.core.brain
      • fiftyone.core.camera
      • fiftyone.core.cli
      • fiftyone.core.clips
      • fiftyone.core.collections
      • fiftyone.core.config
      • fiftyone.core.context
      • fiftyone.core.dataset
      • fiftyone.core.document
      • fiftyone.core.evaluation
      • fiftyone.core.expressions
      • fiftyone.core.fields
      • fiftyone.core.frame
      • fiftyone.core.frame_utils
      • fiftyone.core.groups
      • fiftyone.core.json
      • fiftyone.core.labels
      • fiftyone.core.logging
      • fiftyone.core.media
      • fiftyone.core.metadata
      • fiftyone.core.models
      • fiftyone.core.ontology
      • fiftyone.core.ontology_validation
      • fiftyone.core.patches
      • fiftyone.core.runs
      • fiftyone.core.sample
      • fiftyone.core.service
      • fiftyone.core.singletons
      • fiftyone.core.stages
      • fiftyone.core.state
      • fiftyone.core.storage
      • fiftyone.core.tags
      • fiftyone.core.uid
      • fiftyone.core.utils
      • fiftyone.core.validation
      • fiftyone.core.video
      • fiftyone.core.view
    • fiftyone.factory
      • fiftyone.factory.repos
        • fiftyone.factory.repos.delegated_operation
        • fiftyone.factory.repos.delegated_operation_doc
        • fiftyone.factory.repos.execution_store
      • fiftyone.factory.repo_factory
    • fiftyone.migrations
      • fiftyone.migrations.runner
    • fiftyone.operators
      • fiftyone.operators.cache
        • fiftyone.operators.cache.decorator
        • fiftyone.operators.cache.ephemeral
        • fiftyone.operators.cache.serialization
        • fiftyone.operators.cache.utils
      • fiftyone.operators.store
        • fiftyone.operators.store.clone
        • fiftyone.operators.store.models
        • fiftyone.operators.store.notification_service
        • fiftyone.operators.store.service
        • fiftyone.operators.store.store
        • fiftyone.operators.store.subscription_registry
      • fiftyone.operators.categories
      • fiftyone.operators.constants
      • fiftyone.operators.decorators
      • fiftyone.operators.delegated
      • fiftyone.operators.evaluation_metric
      • fiftyone.operators.events
      • fiftyone.operators.executor
      • fiftyone.operators.logging_utils
      • fiftyone.operators.message
      • fiftyone.operators.operations
      • fiftyone.operators.operator
      • fiftyone.operators.panel
      • fiftyone.operators.permissions
      • fiftyone.operators.registry
      • fiftyone.operators.remote_notifier
      • fiftyone.operators.server
      • fiftyone.operators.sse
      • fiftyone.operators.types
      • fiftyone.operators.utils
    • fiftyone.plugins
      • fiftyone.plugins.constants
      • fiftyone.plugins.context
      • fiftyone.plugins.core
      • fiftyone.plugins.definitions
      • fiftyone.plugins.secrets
      • fiftyone.plugins.skills
      • fiftyone.plugins.utils
    • fiftyone.types
      • fiftyone.types.dataset_types
    • fiftyone.utils
      • fiftyone.utils.clip
        • fiftyone.utils.clip.model
        • fiftyone.utils.clip.tokenizer
        • fiftyone.utils.clip.zoo
      • fiftyone.utils.data
        • fiftyone.utils.data.base
        • fiftyone.utils.data.converters
        • fiftyone.utils.data.exporters
        • fiftyone.utils.data.importers
        • fiftyone.utils.data.ingestors
        • fiftyone.utils.data.parsers
      • fiftyone.utils.eval
        • fiftyone.utils.eval.activitynet
        • fiftyone.utils.eval.base
        • fiftyone.utils.eval.classification
        • fiftyone.utils.eval.coco
        • fiftyone.utils.eval.detection
        • fiftyone.utils.eval.openimages
        • fiftyone.utils.eval.regression
        • fiftyone.utils.eval.segmentation
      • fiftyone.utils.tracking
        • fiftyone.utils.tracking.deepsort
      • fiftyone.utils.activitynet
      • fiftyone.utils.annotations
      • fiftyone.utils.aws
      • fiftyone.utils.bdd
      • fiftyone.utils.beam
      • fiftyone.utils.caltech
      • fiftyone.utils.cityscapes
      • fiftyone.utils.coco
      • fiftyone.utils.csv
      • fiftyone.utils.cvat
      • fiftyone.utils.depth_anything
      • fiftyone.utils.dicom
      • fiftyone.utils.eta
      • fiftyone.utils.fiw
      • fiftyone.utils.flash
      • fiftyone.utils.geojson
      • fiftyone.utils.geotiff
      • fiftyone.utils.github
      • fiftyone.utils.groups
      • fiftyone.utils.hmdb51
      • fiftyone.utils.huggingface
      • fiftyone.utils.image
      • fiftyone.utils.imagenet
      • fiftyone.utils.iou
      • fiftyone.utils.kinetics
      • fiftyone.utils.kitti
      • fiftyone.utils.labelbox
      • fiftyone.utils.labels
      • fiftyone.utils.labelstudio
      • fiftyone.utils.lfw
      • fiftyone.utils.open_clip
      • fiftyone.utils.openimages
      • fiftyone.utils.openlabel
      • fiftyone.utils.patches
      • fiftyone.utils.pe
      • fiftyone.utils.places
      • fiftyone.utils.quickstart
      • fiftyone.utils.qwen3_vl
      • fiftyone.utils.random
      • fiftyone.utils.rerun
      • fiftyone.utils.rfdetr
      • fiftyone.utils.sam
      • fiftyone.utils.sam2
      • fiftyone.utils.sam3
      • fiftyone.utils.sama
      • fiftyone.utils.scale
      • fiftyone.utils.sharp
      • fiftyone.utils.super_gradients
      • fiftyone.utils.tf
      • fiftyone.utils.torch
      • fiftyone.utils.transformers
      • fiftyone.utils.transforms
      • fiftyone.utils.twelvelabs
      • fiftyone.utils.ucf101
      • fiftyone.utils.ultralytics
      • fiftyone.utils.useragent
      • fiftyone.utils.utils3d
      • fiftyone.utils.video
      • fiftyone.utils.voc
      • fiftyone.utils.yolo
      • fiftyone.utils.youtube
    • fiftyone.zoo
      • fiftyone.zoo.datasets
        • fiftyone.zoo.datasets.base
        • fiftyone.zoo.datasets.tf
        • fiftyone.zoo.datasets.torch
      • fiftyone.zoo.models
        • fiftyone.zoo.models.torch
    • fiftyone.constants
  • Contribute
  • Release Notes
  • Deprecation Notices
  • FAQ
  • Plugins Ecosystem
  • plugins
  • plugins.panels
  • plugins.panels.similarity_search

plugins.panels.similarity_search#

  • plugins.panels.similarity_search.constants
    • RunStatus
      • RunStatus.PENDING
      • RunStatus.RUNNING
      • RunStatus.COMPLETED
      • RunStatus.FAILED
      • RunStatus.encode()
      • RunStatus.replace()
      • RunStatus.split()
      • RunStatus.rsplit()
      • RunStatus.join()
      • RunStatus.capitalize()
      • RunStatus.casefold()
      • RunStatus.title()
      • RunStatus.center()
      • RunStatus.count()
      • RunStatus.expandtabs()
      • RunStatus.find()
      • RunStatus.partition()
      • RunStatus.index()
      • RunStatus.ljust()
      • RunStatus.lower()
      • RunStatus.lstrip()
      • RunStatus.rfind()
      • RunStatus.rindex()
      • RunStatus.rjust()
      • RunStatus.rstrip()
      • RunStatus.rpartition()
      • RunStatus.splitlines()
      • RunStatus.strip()
      • RunStatus.swapcase()
      • RunStatus.translate()
      • RunStatus.upper()
      • RunStatus.startswith()
      • RunStatus.endswith()
      • RunStatus.removeprefix()
      • RunStatus.removesuffix()
      • RunStatus.isascii()
      • RunStatus.islower()
      • RunStatus.isupper()
      • RunStatus.istitle()
      • RunStatus.isspace()
      • RunStatus.isdecimal()
      • RunStatus.isdigit()
      • RunStatus.isnumeric()
      • RunStatus.isalpha()
      • RunStatus.isalnum()
      • RunStatus.isidentifier()
      • RunStatus.isprintable()
      • RunStatus.zfill()
      • RunStatus.format()
      • RunStatus.format_map()
      • RunStatus.maketrans()
    • QueryType
      • QueryType.TEXT
      • QueryType.IMAGE
      • QueryType.UPLOAD
      • QueryType.encode()
      • QueryType.replace()
      • QueryType.split()
      • QueryType.rsplit()
      • QueryType.join()
      • QueryType.capitalize()
      • QueryType.casefold()
      • QueryType.title()
      • QueryType.center()
      • QueryType.count()
      • QueryType.expandtabs()
      • QueryType.find()
      • QueryType.partition()
      • QueryType.index()
      • QueryType.ljust()
      • QueryType.lower()
      • QueryType.lstrip()
      • QueryType.rfind()
      • QueryType.rindex()
      • QueryType.rjust()
      • QueryType.rstrip()
      • QueryType.rpartition()
      • QueryType.splitlines()
      • QueryType.strip()
      • QueryType.swapcase()
      • QueryType.translate()
      • QueryType.upper()
      • QueryType.startswith()
      • QueryType.endswith()
      • QueryType.removeprefix()
      • QueryType.removesuffix()
      • QueryType.isascii()
      • QueryType.islower()
      • QueryType.isupper()
      • QueryType.istitle()
      • QueryType.isspace()
      • QueryType.isdecimal()
      • QueryType.isdigit()
      • QueryType.isnumeric()
      • QueryType.isalpha()
      • QueryType.isalnum()
      • QueryType.isidentifier()
      • QueryType.isprintable()
      • QueryType.zfill()
      • QueryType.format()
      • QueryType.format_map()
      • QueryType.maketrans()
  • plugins.panels.similarity_search.operators
    • SimilaritySearchOperator
      • SimilaritySearchOperator.config
      • SimilaritySearchOperator.execute()
      • SimilaritySearchOperator.add_secrets()
      • SimilaritySearchOperator.builtin
      • SimilaritySearchOperator.method_to_uri()
      • SimilaritySearchOperator.name
      • SimilaritySearchOperator.resolve_delegation()
      • SimilaritySearchOperator.resolve_execution_options()
      • SimilaritySearchOperator.resolve_input()
      • SimilaritySearchOperator.resolve_output()
      • SimilaritySearchOperator.resolve_placement()
      • SimilaritySearchOperator.resolve_run_name()
      • SimilaritySearchOperator.resolve_type()
      • SimilaritySearchOperator.risk_level
      • SimilaritySearchOperator.to_json()
      • SimilaritySearchOperator.uri
    • InitSimilarityRunOperator
      • InitSimilarityRunOperator.config
      • InitSimilarityRunOperator.execute()
      • InitSimilarityRunOperator.add_secrets()
      • InitSimilarityRunOperator.builtin
      • InitSimilarityRunOperator.method_to_uri()
      • InitSimilarityRunOperator.name
      • InitSimilarityRunOperator.resolve_delegation()
      • InitSimilarityRunOperator.resolve_execution_options()
      • InitSimilarityRunOperator.resolve_input()
      • InitSimilarityRunOperator.resolve_output()
      • InitSimilarityRunOperator.resolve_placement()
      • InitSimilarityRunOperator.resolve_run_name()
      • InitSimilarityRunOperator.resolve_type()
      • InitSimilarityRunOperator.risk_level
      • InitSimilarityRunOperator.to_json()
      • InitSimilarityRunOperator.uri
    • ListSimilarityRunsOperator
      • ListSimilarityRunsOperator.config
      • ListSimilarityRunsOperator.execute()
      • ListSimilarityRunsOperator.add_secrets()
      • ListSimilarityRunsOperator.builtin
      • ListSimilarityRunsOperator.method_to_uri()
      • ListSimilarityRunsOperator.name
      • ListSimilarityRunsOperator.resolve_delegation()
      • ListSimilarityRunsOperator.resolve_execution_options()
      • ListSimilarityRunsOperator.resolve_input()
      • ListSimilarityRunsOperator.resolve_output()
      • ListSimilarityRunsOperator.resolve_placement()
      • ListSimilarityRunsOperator.resolve_run_name()
      • ListSimilarityRunsOperator.resolve_type()
      • ListSimilarityRunsOperator.risk_level
      • ListSimilarityRunsOperator.to_json()
      • ListSimilarityRunsOperator.uri
    • SimilaritySearchSubscriptionOperator
      • SimilaritySearchSubscriptionOperator.subscription_config
      • SimilaritySearchSubscriptionOperator.IS_SSE_OPERATOR
      • SimilaritySearchSubscriptionOperator.add_secrets()
      • SimilaritySearchSubscriptionOperator.builtin
      • SimilaritySearchSubscriptionOperator.config
      • SimilaritySearchSubscriptionOperator.execute()
      • SimilaritySearchSubscriptionOperator.method_to_uri()
      • SimilaritySearchSubscriptionOperator.name
      • SimilaritySearchSubscriptionOperator.resolve_delegation()
      • SimilaritySearchSubscriptionOperator.resolve_execution_options()
      • SimilaritySearchSubscriptionOperator.resolve_input()
      • SimilaritySearchSubscriptionOperator.resolve_output()
      • SimilaritySearchSubscriptionOperator.resolve_placement()
      • SimilaritySearchSubscriptionOperator.resolve_run_name()
      • SimilaritySearchSubscriptionOperator.resolve_type()
      • SimilaritySearchSubscriptionOperator.risk_level
      • SimilaritySearchSubscriptionOperator.to_json()
      • SimilaritySearchSubscriptionOperator.uri
  • plugins.panels.similarity_search.run_manager
    • get_head_dataset_id()
    • RunManager
      • RunManager.create_run()
      • RunManager.get_run()
      • RunManager.set_run()
      • RunManager.update_run()
      • RunManager.set_operator_run_id()
      • RunManager.find_run_by_operator_id()
      • RunManager.delete_run()
      • RunManager.list_runs()

Module contents#

Similarity search panel.

This panel provides a non-blocking interface for running similarity searches against pre-computed embeddings. Queries run as delegated operations and results are stored as persistent runs that users can browse, apply, clone, and iterate on.

Copyright 2017-2026, Voxel51, Inc.
voxel51.com

Classes:

SimilaritySearchPanel([_builtin])

Panel for running and managing similarity search queries.

class plugins.panels.similarity_search.SimilaritySearchPanel(_builtin=False)#

Bases: Panel

Panel for running and managing similarity search queries.

Attributes:

config

The OperatorConfig for the operator.

builtin

Whether the operator is builtin.

name

risk_level

The effective risk level of the operator, which is used by guardrail systems of an agent to classify tool calls.

uri

The unique identifier of the operator: plugin_name/operator_name.

Methods:

on_load(ctx)

on_unload(ctx)

get_brain_keys(ctx)

Refresh available similarity brain keys.

list_runs(ctx)

Refresh the runs list.

apply_run(ctx)

Apply a completed run's results as the current view.

delete_run(ctx)

Delete a run from the store.

bulk_delete_runs(ctx)

Delete multiple runs from the store.

clone_run(ctx)

Return a run's config for pre-filling the new search form.

rename_run(ctx)

Rename a run.

on_change_view(ctx)

Called when the panel navigates between pages.

get_sample_media(ctx)

Return media URLs for the given sample IDs.

render(ctx)

Defines the panel's layout and events.

add_secrets(secrets)

Adds secrets to the operator.

execute(ctx)

Executes the operator.

method_to_uri(method_name)

Converts a method name to a URI.

on_startup(ctx)

resolve_delegation(ctx)

Returns the resolved forced delegation flag.

resolve_execution_options(ctx)

Returns the resolved execution options.

resolve_input(ctx)

Returns the resolved input property.

resolve_output(ctx)

Returns the resolved output property.

resolve_panel_config()

Returns the registration config for this panel.

resolve_placement(ctx)

Returns the resolved placement of the operator.

resolve_run_name(ctx)

Returns the resolved run name of the operator.

resolve_type(ctx,Β type)

Returns the resolved input or output property.

to_json()

Returns a JSON representation of the operator.

property config#

The OperatorConfig for the operator.

on_load(ctx)#
on_unload(ctx)#
get_brain_keys(ctx)#

Refresh available similarity brain keys.

list_runs(ctx)#

Refresh the runs list.

Accepts an optional owner param ("mine" or "all") to filter runs server-side. Non-managers are always restricted to their own runs regardless of the requested filter.

apply_run(ctx)#

Apply a completed run’s results as the current view.

delete_run(ctx)#

Delete a run from the store.

bulk_delete_runs(ctx)#

Delete multiple runs from the store.

clone_run(ctx)#

Return a run’s config for pre-filling the new search form.

rename_run(ctx)#

Rename a run.

on_change_view(ctx)#

Called when the panel navigates between pages.

get_sample_media(ctx)#

Return media URLs for the given sample IDs.

Filepaths are returned as-is by default. In FiftyOne Enterprise, cloud filepaths (e.g. s3://..., gs://...) are resolved to signed HTTPS URLs so the frontend can render them directly.

render(ctx)#

Defines the panel’s layout and events.

This method is called after every panel event is called (on load, button callback, context change event, etc).

Parameters:

ctx – the fiftyone.operators.executor.ExecutionContext

Returns:

a fiftyone.operators.types.Property

add_secrets(secrets)#

Adds secrets to the operator.

Parameters:

secrets – a list of secrets

property builtin#

Whether the operator is builtin.

execute(ctx)#

Executes the operator.

Subclasses must implement this method.

Parameters:

ctx – the fiftyone.operators.executor.ExecutionContext

Returns:

JSON serializable data, or None

method_to_uri(method_name)#

Converts a method name to a URI.

Parameters:

method_name – the method name

Returns:

a URI

property name#
on_startup(ctx)#
resolve_delegation(ctx)#

Returns the resolved forced delegation flag.

Subclasses can implement this method to decide if delegated execution should be forced for the given operation.

Parameters:

ctx – the fiftyone.operators.executor.ExecutionContext

Returns:

whether the operation should be delegated (True), run immediately (False), or None to defer to resolve_execution_options() to specify the available options

resolve_execution_options(ctx)#

Returns the resolved execution options.

Subclasses can implement this method to define the execution options available for the operation.

Parameters:

ctx – the fiftyone.operators.executor.ExecutionContext

Returns:

a fiftyone.operators.executor.ExecutionOptions instance

resolve_input(ctx)#

Returns the resolved input property.

Subclasses can implement this method to define the inputs to the operator. This method should never be called directly. Instead use resolve_type().

By default, this method is called once when the operator is created. If the operator is dynamic, this method is called each time the input changes.

Parameters:

ctx – the fiftyone.operators.executor.ExecutionContext

Returns:

a fiftyone.operators.types.Property, or None

resolve_output(ctx)#

Returns the resolved output property.

Subclasses can implement this method to define the outputs of the operator.

By default, this method is called once when the operator is created. If the operator is dynamic, this method is called after the operator is executed.

Parameters:

ctx – the fiftyone.operators.executor.ExecutionContext

Returns:

a fiftyone.operators.types.Property, or None

resolve_panel_config()#

Returns the registration config for this panel.

resolve_placement(ctx)#

Returns the resolved placement of the operator.

Subclasses can implement this method to define the placement of the operator.

Parameters:

ctx – the fiftyone.operators.executor.ExecutionContext

Returns:

a fiftyone.operators.types.Placement, or None

resolve_run_name(ctx)#

Returns the resolved run name of the operator.

Subclasses can implement this method to define the run name of the operator.

Parameters:

ctx – the fiftyone.operators.executor.ExecutionContext

Returns:

a string, or None

resolve_type(ctx, type)#

Returns the resolved input or output property.

Parameters:
  • ctx – the fiftyone.operators.executor.ExecutionContext

  • type – the type of property to resolve, either "inputs" or "outputs"

Returns:

a fiftyone.operators.types.Property, or None

property risk_level#

The effective risk level of the operator, which is used by guardrail systems of an agent to classify tool calls.

to_json()#

Returns a JSON representation of the operator.

Returns:

a JSON dict

property uri#

The unique identifier of the operator: plugin_name/operator_name.

previous

plugins.panels.model_evaluation.utils

next

plugins.panels.similarity_search.constants

IN THIS ARTICLE
  • Module contents
    • SimilaritySearchPanel
      • SimilaritySearchPanel.config
      • SimilaritySearchPanel.on_load()
      • SimilaritySearchPanel.on_unload()
      • SimilaritySearchPanel.get_brain_keys()
      • SimilaritySearchPanel.list_runs()
      • SimilaritySearchPanel.apply_run()
      • SimilaritySearchPanel.delete_run()
      • SimilaritySearchPanel.bulk_delete_runs()
      • SimilaritySearchPanel.clone_run()
      • SimilaritySearchPanel.rename_run()
      • SimilaritySearchPanel.on_change_view()
      • SimilaritySearchPanel.get_sample_media()
      • SimilaritySearchPanel.render()
      • SimilaritySearchPanel.add_secrets()
      • SimilaritySearchPanel.builtin
      • SimilaritySearchPanel.execute()
      • SimilaritySearchPanel.method_to_uri()
      • SimilaritySearchPanel.name
      • SimilaritySearchPanel.on_startup()
      • SimilaritySearchPanel.resolve_delegation()
      • SimilaritySearchPanel.resolve_execution_options()
      • SimilaritySearchPanel.resolve_input()
      • SimilaritySearchPanel.resolve_output()
      • SimilaritySearchPanel.resolve_panel_config()
      • SimilaritySearchPanel.resolve_placement()
      • SimilaritySearchPanel.resolve_run_name()
      • SimilaritySearchPanel.resolve_type()
      • SimilaritySearchPanel.risk_level
      • SimilaritySearchPanel.to_json()
      • SimilaritySearchPanel.uri
Voxel51
Talk to a CV expert
Product
Data Annotation Data Curation Model Evaluation Integrations Plugins Pricing
Solutions
Agriculture Autonomous Systems Defense Healthcare Manufacturing Retail Robotics Security
Developers
Documentation Events & Meetups Computer Vision Glossary Community
Resources
Blog Customer Stories Model Zoo Dataset Zoo CV Research
Company
About Voxel51 Careers Press

Β© Copyright 2017-2026, Voxel51, Inc.

Terms of Service
Privacy Policy