Note

This is a community plugin, an external project maintained by its respective author. Community plugins are not part of FiftyOne core and may change independently. Please review each plugin’s documentation and license before use.

GitHub Repo

Twilio Automation Plugin#

twilio

This plugin is a Python plugin that allows you to automate data ingestion with twilio. Take pictures with your phone and send them to a Twilio number. The plugin will automatically download the images and add them to your dataset.

This plugin is a direct byproduct of the hackathon at the Twilio SIGNAL Creator Summit 2023.

This plugin demonstrates how to do the following:

  • use Python to create an operator with different options depending on user choices

  • add a custom operator icon via the operators icon property

  • download images from URL — with authentication — and add them to the dataset

Installation#

Twilio Setup#

Before installing this plugin, you must set up your Twilio account:

  1. Create a Twilio account. Twilio offers a free trial, so you can try this out without paying anything.

  2. Buy (with the free trial credits) a toll-free phone number that can receive MMS messages. You can do this from the Twilio Console.

  3. Go to the Twilio Console and copy the “Account SID”, “Auth Token”, and “My Twilio phone number” values. Add these values as environment variables in your shell rc (.bashrc, .zshrc, etc.)):

export TWILIO_ACCOUNT_SID=<your account SID>
export TWILIO_AUTH_TOKEN=<your auth token>
export TWILIO_PHONE_NUMBER=<your Twilio phone number>

You will need to restart your shell for these environment variables to take effect.

  1. Install the twilio Python helper library.

pip install twilio

Plugin Installation#

To install the plugin, run the following command:

fiftyone plugins download https://github.com/jacobmarks/twilio-automation-plugin

Operators#

add_twilio_images#

Add images received by your Twilio number to the dataset. This operator only adds images that have not already been added to the dataset.

When you run the operator, it will download the images, assign them a filepath, and add them to the dataset with metadata.

Filtering by message body#

When executing the operator, you can filter the images that are added to the dataset by the message body.

Notes#

Local datasets only#

This plugin is only meant for local datasets. If you are working with large-scale, remotely hosted datasets, you likely need a more robust solution FiftyOne Teams

Cost#

This plugin uses Twilio’s MMS service, which costs $0.02 message received. You can send up to 10 images per message, so the cost is $0.002 per image. If you are using the free trial, you will have $13 in credits left after buying a phone number, which is enough for 6,500 images.