Note

This is a community plugin, an external project maintained by its respective author. Community plugins are not part of FiftyOne core and may change independently. Please review each plugin’s documentation and license before use.

GitHub Repo

Concept Space Traversal Plugin#

concept_traversal

This plugin allows you to “traverse” the concept space of a similarity index by adding text prompts (with configurable strength) to a base image.

Note: This plugin requires a similarity index that supports prompts (i.e. embeds text and images) to be present on the dataset. You can create one with:

import fiftyone as fo
import fiftyone.brain as fob

dataset = fo.load_dataset("my_dataset")
fob.compute_similarity(
    dataset,
    brain_key="my_brain_key",
    model="clip-vit-base32-torch",
    metric="cosine",
    )

Watch On Youtube#

Video Thumbnail

Installation#

fiftyone plugins download https://github.com/jacobmarks/concept-space-traversal-plugin

Refer to the main README for more information about managing downloaded plugins and developing plugins locally.

Operators#

open_traversal_panel#

  • Opens the concept space traversal panel on click

  • Only activated when the dataset has a similarity index

traverser#

  • Runs the Traverser on the dataset

get_sample_url#

  • Returns the resource URL of the media file associated with a sample, from the sample’s ID.

Development#

This plugin was a joint creation between myself and Ibrahim Manjra. Couldn’t have done it without his JavaScript wizardry!