# fiftyone.core.evaluation Evaluation runs framework. Copyright 2017-2026, Voxel51, Inc.
[voxel51.com](https://voxel51.com/)

**Classes:** | [`EvaluationInfo`](#fiftyone.core.evaluation.EvaluationInfo)(key[, version, timestamp, config]) | Information about an evaluation that has been run on a dataset. | |---------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------| | [`EvaluationMethodConfig`](#fiftyone.core.evaluation.EvaluationMethodConfig)(\*\*kwargs) | Base class for configuring [`EvaluationMethod`](#fiftyone.core.evaluation.EvaluationMethod) instances. | | [`EvaluationMethod`](#fiftyone.core.evaluation.EvaluationMethod)(config) | Base class for evaluation methods. | | [`EvaluationResults`](#fiftyone.core.evaluation.EvaluationResults)(samples, config, key[, ...]) | Base class for evaluation results. | ### *class* fiftyone.core.evaluation.EvaluationInfo(key, version=None, timestamp=None, config=None) Bases: [`BaseRunInfo`](fiftyone.core.runs.md#fiftyone.core.runs.BaseRunInfo) Information about an evaluation that has been run on a dataset. * **Parameters:** * **key** – the evaluation key * **timestamp** (*None*) – the UTC `datetime` when the evaluation was run * **config** (*None*) – the [`EvaluationMethodConfig`](#fiftyone.core.evaluation.EvaluationMethodConfig) for the evaluation **Methods:** | [`config_cls`](#fiftyone.core.evaluation.EvaluationInfo.config_cls)() | The `BaseRunConfig` class associated with this class. | |-----------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------| | [`attributes`](#fiftyone.core.evaluation.EvaluationInfo.attributes)() | Returns a list of class attributes to be serialized. | | [`builder`](#fiftyone.core.evaluation.EvaluationInfo.builder)() | Returns a ConfigBuilder instance for this class. | | [`copy`](#fiftyone.core.evaluation.EvaluationInfo.copy)() | Returns a deep copy of the object. | | [`custom_attributes`](#fiftyone.core.evaluation.EvaluationInfo.custom_attributes)([dynamic, private]) | Returns a customizable list of class attributes. | | [`default`](#fiftyone.core.evaluation.EvaluationInfo.default)() | Returns the default config instance. | | [`from_dict`](#fiftyone.core.evaluation.EvaluationInfo.from_dict)(d) | Constructs a Config object from a JSON dictionary. | | [`from_json`](#fiftyone.core.evaluation.EvaluationInfo.from_json)(path, \*args, \*\*kwargs) | Constructs a Serializable object from a JSON file. | | [`from_kwargs`](#fiftyone.core.evaluation.EvaluationInfo.from_kwargs)(\*\*kwargs) | Constructs a Config object from keyword arguments. | | [`from_str`](#fiftyone.core.evaluation.EvaluationInfo.from_str)(s, \*args, \*\*kwargs) | Constructs a Serializable object from a JSON string. | | [`get_class_name`](#fiftyone.core.evaluation.EvaluationInfo.get_class_name)() | Returns the fully-qualified class name string of this object. | | [`load_default`](#fiftyone.core.evaluation.EvaluationInfo.load_default)() | Loads the default config instance from file. | | [`parse_array`](#fiftyone.core.evaluation.EvaluationInfo.parse_array)(d, key[, default]) | Parses a raw array attribute. | | [`parse_bool`](#fiftyone.core.evaluation.EvaluationInfo.parse_bool)(d, key[, default]) | Parses a boolean value. | | [`parse_categorical`](#fiftyone.core.evaluation.EvaluationInfo.parse_categorical)(d, key, choices[, default]) | Parses a categorical JSON field, which must take a value from among the given choices. | | [`parse_dict`](#fiftyone.core.evaluation.EvaluationInfo.parse_dict)(d, key[, default]) | Parses a dictionary attribute. | | [`parse_int`](#fiftyone.core.evaluation.EvaluationInfo.parse_int)(d, key[, default]) | Parses an integer attribute. | | [`parse_mutually_exclusive_fields`](#fiftyone.core.evaluation.EvaluationInfo.parse_mutually_exclusive_fields)(fields) | Parses a mutually exclusive dictionary of pre-parsed fields, which must contain exactly one field with a truthy value. | | [`parse_number`](#fiftyone.core.evaluation.EvaluationInfo.parse_number)(d, key[, default]) | Parses a number attribute. | | [`parse_object`](#fiftyone.core.evaluation.EvaluationInfo.parse_object)(d, key, cls[, default]) | Parses an object attribute. | | [`parse_object_array`](#fiftyone.core.evaluation.EvaluationInfo.parse_object_array)(d, key, cls[, default]) | Parses an array of objects. | | [`parse_object_dict`](#fiftyone.core.evaluation.EvaluationInfo.parse_object_dict)(d, key, cls[, default]) | Parses a dictionary whose values are objects. | | [`parse_path`](#fiftyone.core.evaluation.EvaluationInfo.parse_path)(d, key[, default]) | Parses a path attribute. | | [`parse_raw`](#fiftyone.core.evaluation.EvaluationInfo.parse_raw)(d, key[, default]) | Parses a raw (arbitrary) JSON field. | | [`parse_string`](#fiftyone.core.evaluation.EvaluationInfo.parse_string)(d, key[, default]) | Parses a string attribute. | | [`serialize`](#fiftyone.core.evaluation.EvaluationInfo.serialize)([reflective]) | Serializes the object into a dictionary. | | [`to_str`](#fiftyone.core.evaluation.EvaluationInfo.to_str)([pretty_print]) | Returns a string representation of this object. | | [`validate_all_or_nothing_fields`](#fiftyone.core.evaluation.EvaluationInfo.validate_all_or_nothing_fields)(fields) | Validates a dictionary of pre-parsed fields checking that either all or none of the fields have a truthy value. | | [`write_json`](#fiftyone.core.evaluation.EvaluationInfo.write_json)(path[, pretty_print]) | Serializes the object and writes it to disk. | #### *classmethod* config_cls() The `BaseRunConfig` class associated with this class. #### attributes() Returns a list of class attributes to be serialized. This method is called internally by `serialize()` to determine the class attributes to serialize. Subclasses can override this method, but, by default, all attributes in vars(self) are returned, minus private attributes, i.e., those starting with “_”. The order of the attributes in this list is preserved when serializing objects, so a common pattern is for subclasses to override this method if they want their JSON files to be organized in a particular way. * **Returns:** a list of class attributes to be serialized #### *classmethod* builder() Returns a ConfigBuilder instance for this class. #### copy() Returns a deep copy of the object. * **Returns:** a Serializable instance #### custom_attributes(dynamic=False, private=False) Returns a customizable list of class attributes. By default, all attributes in vars(self) are returned, minus private attributes (those starting with “_”). * **Parameters:** * **dynamic** – whether to include dynamic properties, e.g., those defined by getter/setter methods or the `@property` decorator. By default, this is False * **private** – whether to include private properties, i.e., those starting with “_”. By default, this is False * **Returns:** a list of class attributes #### *classmethod* default() Returns the default config instance. By default, this method instantiates the class from an empty dictionary, which will only succeed if all attributes are optional. Otherwise, subclasses should override this method to provide the desired default configuration. #### *classmethod* from_dict(d) Constructs a Config object from a JSON dictionary. Config subclass constructors accept JSON dictionaries, so this method simply passes the dictionary to cls(). * **Parameters:** **d** – a dict of fields expected by cls * **Returns:** an instance of cls #### *classmethod* from_json(path, \*args, \*\*kwargs) Constructs a Serializable object from a JSON file. Subclasses may override this method, but, by default, this method simply reads the JSON and calls from_dict(), which subclasses must implement. * **Parameters:** * **path** – the path to the JSON file on disk * **\*args** – optional positional arguments for `self.from_dict()` * **\*\*kwargs** – optional keyword arguments for `self.from_dict()` * **Returns:** an instance of the Serializable class #### *classmethod* from_kwargs(\*\*kwargs) Constructs a Config object from keyword arguments. * **Parameters:** **\*\*kwargs** – keyword arguments that define the fields expected by cls * **Returns:** an instance of cls #### *classmethod* from_str(s, \*args, \*\*kwargs) Constructs a Serializable object from a JSON string. Subclasses may override this method, but, by default, this method simply parses the string and calls from_dict(), which subclasses must implement. * **Parameters:** * **s** – a JSON string representation of a Serializable object * **\*args** – optional positional arguments for `self.from_dict()` * **\*\*kwargs** – optional keyword arguments for `self.from_dict()` * **Returns:** an instance of the Serializable class #### *classmethod* get_class_name() Returns the fully-qualified class name string of this object. #### *classmethod* load_default() Loads the default config instance from file. Subclasses must implement this method if they intend to support default instances. #### *static* parse_array(d, key, default=) Parses a raw array attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default list to return if key is not present * **Returns:** a list of raw (untouched) values * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_bool(d, key, default=) Parses a boolean value. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default bool to return if key is not present * **Returns:** True/False * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_categorical(d, key, choices, default=) Parses a categorical JSON field, which must take a value from among the given choices. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **choices** – either an iterable of possible values or an enum-like class whose attributes define the possible values * **default** – a default value to return if key is not present * **Returns:** the raw (untouched) value of the given field, which is equal to a value from `choices` * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the key was present in the dictionary but its value was not an allowed choice, or if no default value was provided and the key was not found in the dictionary #### *static* parse_dict(d, key, default=) Parses a dictionary attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default dict to return if key is not present * **Returns:** a dictionary * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_int(d, key, default=) Parses an integer attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default integer value to return if key is not present * **Returns:** an int * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_mutually_exclusive_fields(fields) Parses a mutually exclusive dictionary of pre-parsed fields, which must contain exactly one field with a truthy value. * **Parameters:** **fields** – a dictionary of pre-parsed fields * **Returns:** the (field, value) that was set * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if zero or more than one truthy value was found #### *static* parse_number(d, key, default=) Parses a number attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default numeric value to return if key is not present * **Returns:** a number (e.g. int, float) * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_object(d, key, cls, default=) Parses an object attribute. The value of d[key] can be either an instance of cls or a serialized dict from an instance of cls. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **cls** – the class of d[key] * **default** – a default cls instance to return if key is not present * **Returns:** an instance of cls * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_object_array(d, key, cls, default=) Parses an array of objects. The values in d[key] can be either instances of cls or serialized dicts from instances of cls. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **cls** – the class of the elements of list d[key] * **default** – the default list to return if key is not present * **Returns:** a list of cls instances * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_object_dict(d, key, cls, default=) Parses a dictionary whose values are objects. The values in d[key] can be either instances of cls or serialized dicts from instances of cls. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **cls** – the class of the values of dictionary d[key] * **default** – the default dict of cls instances to return if key is not present * **Returns:** a dictionary whose values are cls instances * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_path(d, key, default=) Parses a path attribute. The path is converted to an absolute path if necessary via `os.path.abspath(os.path.expanduser(value))`. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default string to return if key is not present * **Returns:** a path string * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_raw(d, key, default=) Parses a raw (arbitrary) JSON field. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default value to return if key is not present * **Returns:** the raw (untouched) value of the given field * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if no default value was provided and the key was not found in the dictionary #### *static* parse_string(d, key, default=) Parses a string attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default string to return if key is not present * **Returns:** a string * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### serialize(reflective=False) Serializes the object into a dictionary. Serialization is applied recursively to all attributes in the object, including element-wise serialization of lists and dictionary values. * **Parameters:** **reflective** – whether to include reflective attributes when serializing the object. By default, this is False * **Returns:** a JSON dictionary representation of the object #### to_str(pretty_print=True, \*\*kwargs) Returns a string representation of this object. * **Parameters:** * **pretty_print** – whether to render the JSON in human readable format with newlines and indentations. By default, this is True * **\*\*kwargs** – optional keyword arguments for `self.serialize()` * **Returns:** a string representation of the object #### *static* validate_all_or_nothing_fields(fields) Validates a dictionary of pre-parsed fields checking that either all or none of the fields have a truthy value. * **Parameters:** **fields** – a dictionary of pre-parsed fields * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if some values are truth and some are not #### write_json(path, pretty_print=False, \*\*kwargs) Serializes the object and writes it to disk. * **Parameters:** * **path** – the output path * **pretty_print** – whether to render the JSON in human readable format with newlines and indentations. By default, this is False * **\*\*kwargs** – optional keyword arguments for `self.serialize()` ### *class* fiftyone.core.evaluation.EvaluationMethodConfig(\*\*kwargs) Bases: [`BaseRunConfig`](fiftyone.core.runs.md#fiftyone.core.runs.BaseRunConfig) Base class for configuring [`EvaluationMethod`](#fiftyone.core.evaluation.EvaluationMethod) instances. * **Parameters:** **\*\*kwargs** – any leftover keyword arguments after subclasses have done their parsing **Attributes:** | [`type`](#fiftyone.core.evaluation.EvaluationMethodConfig.type) | The type of run. | |-----------------------------------------------------------------------|---------------------------------------------------------| | [`method`](#fiftyone.core.evaluation.EvaluationMethodConfig.method) | The name of the method. | | [`cls`](#fiftyone.core.evaluation.EvaluationMethodConfig.cls) | The fully-qualified name of this `BaseRunConfig` class. | | [`run_cls`](#fiftyone.core.evaluation.EvaluationMethodConfig.run_cls) | The `BaseRun` class associated with this config. | **Methods:** | [`attributes`](#fiftyone.core.evaluation.EvaluationMethodConfig.attributes)() | Returns the list of class attributes that will be serialized by [`serialize()`](#fiftyone.core.evaluation.EvaluationMethodConfig.serialize). | |-------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------| | [`base_config_cls`](#fiftyone.core.evaluation.EvaluationMethodConfig.base_config_cls)(type) | Returns the config class for the given run type. | | [`build`](#fiftyone.core.evaluation.EvaluationMethodConfig.build)() | Builds the `BaseRun` instance associated with this config. | | [`builder`](#fiftyone.core.evaluation.EvaluationMethodConfig.builder)() | Returns a ConfigBuilder instance for this class. | | [`copy`](#fiftyone.core.evaluation.EvaluationMethodConfig.copy)() | Returns a deep copy of the object. | | [`custom_attributes`](#fiftyone.core.evaluation.EvaluationMethodConfig.custom_attributes)([dynamic, private]) | Returns a customizable list of class attributes. | | [`default`](#fiftyone.core.evaluation.EvaluationMethodConfig.default)() | Returns the default config instance. | | [`from_dict`](#fiftyone.core.evaluation.EvaluationMethodConfig.from_dict)(d) | Constructs a `BaseRunConfig` from a serialized JSON dict representation of it. | | [`from_json`](#fiftyone.core.evaluation.EvaluationMethodConfig.from_json)(path, \*args, \*\*kwargs) | Constructs a Serializable object from a JSON file. | | [`from_kwargs`](#fiftyone.core.evaluation.EvaluationMethodConfig.from_kwargs)(\*\*kwargs) | Constructs a Config object from keyword arguments. | | [`from_str`](#fiftyone.core.evaluation.EvaluationMethodConfig.from_str)(s, \*args, \*\*kwargs) | Constructs a Serializable object from a JSON string. | | [`get_class_name`](#fiftyone.core.evaluation.EvaluationMethodConfig.get_class_name)() | Returns the fully-qualified class name string of this object. | | [`load_credentials`](#fiftyone.core.evaluation.EvaluationMethodConfig.load_credentials)(\*\*kwargs) | Loads any necessary credentials from the given keyword arguments or the relevant FiftyOne config. | | [`load_default`](#fiftyone.core.evaluation.EvaluationMethodConfig.load_default)() | Loads the default config instance from file. | | [`parse_array`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_array)(d, key[, default]) | Parses a raw array attribute. | | [`parse_bool`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_bool)(d, key[, default]) | Parses a boolean value. | | [`parse_categorical`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_categorical)(d, key, choices[, default]) | Parses a categorical JSON field, which must take a value from among the given choices. | | [`parse_dict`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_dict)(d, key[, default]) | Parses a dictionary attribute. | | [`parse_int`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_int)(d, key[, default]) | Parses an integer attribute. | | [`parse_mutually_exclusive_fields`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_mutually_exclusive_fields)(fields) | Parses a mutually exclusive dictionary of pre-parsed fields, which must contain exactly one field with a truthy value. | | [`parse_number`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_number)(d, key[, default]) | Parses a number attribute. | | [`parse_object`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_object)(d, key, cls[, default]) | Parses an object attribute. | | [`parse_object_array`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_object_array)(d, key, cls[, default]) | Parses an array of objects. | | [`parse_object_dict`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_object_dict)(d, key, cls[, default]) | Parses a dictionary whose values are objects. | | [`parse_path`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_path)(d, key[, default]) | Parses a path attribute. | | [`parse_raw`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_raw)(d, key[, default]) | Parses a raw (arbitrary) JSON field. | | [`parse_string`](#fiftyone.core.evaluation.EvaluationMethodConfig.parse_string)(d, key[, default]) | Parses a string attribute. | | [`serialize`](#fiftyone.core.evaluation.EvaluationMethodConfig.serialize)([reflective]) | Serializes the object into a dictionary. | | [`to_str`](#fiftyone.core.evaluation.EvaluationMethodConfig.to_str)([pretty_print]) | Returns a string representation of this object. | | [`validate_all_or_nothing_fields`](#fiftyone.core.evaluation.EvaluationMethodConfig.validate_all_or_nothing_fields)(fields) | Validates a dictionary of pre-parsed fields checking that either all or none of the fields have a truthy value. | | [`write_json`](#fiftyone.core.evaluation.EvaluationMethodConfig.write_json)(path[, pretty_print]) | Serializes the object and writes it to disk. | #### *property* type The type of run. #### *property* method The name of the method. #### attributes() Returns the list of class attributes that will be serialized by [`serialize()`](#fiftyone.core.evaluation.EvaluationMethodConfig.serialize). * **Returns:** a list of attributes #### *static* base_config_cls(type) Returns the config class for the given run type. * **Parameters:** **type** – a `BaseRunConfig.type` * **Returns:** a `BaseRunConfig` subclass #### build() Builds the `BaseRun` instance associated with this config. * **Returns:** a `BaseRun` instance #### *classmethod* builder() Returns a ConfigBuilder instance for this class. #### *property* cls The fully-qualified name of this `BaseRunConfig` class. #### copy() Returns a deep copy of the object. * **Returns:** a Serializable instance #### custom_attributes(dynamic=False, private=False) Returns a customizable list of class attributes. By default, all attributes in vars(self) are returned, minus private attributes (those starting with “_”). * **Parameters:** * **dynamic** – whether to include dynamic properties, e.g., those defined by getter/setter methods or the `@property` decorator. By default, this is False * **private** – whether to include private properties, i.e., those starting with “_”. By default, this is False * **Returns:** a list of class attributes #### *classmethod* default() Returns the default config instance. By default, this method instantiates the class from an empty dictionary, which will only succeed if all attributes are optional. Otherwise, subclasses should override this method to provide the desired default configuration. #### *classmethod* from_dict(d) Constructs a `BaseRunConfig` from a serialized JSON dict representation of it. * **Parameters:** **d** – a JSON dict * **Returns:** a `BaseRunConfig` #### *classmethod* from_json(path, \*args, \*\*kwargs) Constructs a Serializable object from a JSON file. Subclasses may override this method, but, by default, this method simply reads the JSON and calls from_dict(), which subclasses must implement. * **Parameters:** * **path** – the path to the JSON file on disk * **\*args** – optional positional arguments for `self.from_dict()` * **\*\*kwargs** – optional keyword arguments for `self.from_dict()` * **Returns:** an instance of the Serializable class #### *classmethod* from_kwargs(\*\*kwargs) Constructs a Config object from keyword arguments. * **Parameters:** **\*\*kwargs** – keyword arguments that define the fields expected by cls * **Returns:** an instance of cls #### *classmethod* from_str(s, \*args, \*\*kwargs) Constructs a Serializable object from a JSON string. Subclasses may override this method, but, by default, this method simply parses the string and calls from_dict(), which subclasses must implement. * **Parameters:** * **s** – a JSON string representation of a Serializable object * **\*args** – optional positional arguments for `self.from_dict()` * **\*\*kwargs** – optional keyword arguments for `self.from_dict()` * **Returns:** an instance of the Serializable class #### *classmethod* get_class_name() Returns the fully-qualified class name string of this object. #### load_credentials(\*\*kwargs) Loads any necessary credentials from the given keyword arguments or the relevant FiftyOne config. * **Parameters:** **\*\*kwargs** – subclass-specific credentials #### *classmethod* load_default() Loads the default config instance from file. Subclasses must implement this method if they intend to support default instances. #### *static* parse_array(d, key, default=) Parses a raw array attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default list to return if key is not present * **Returns:** a list of raw (untouched) values * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_bool(d, key, default=) Parses a boolean value. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default bool to return if key is not present * **Returns:** True/False * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_categorical(d, key, choices, default=) Parses a categorical JSON field, which must take a value from among the given choices. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **choices** – either an iterable of possible values or an enum-like class whose attributes define the possible values * **default** – a default value to return if key is not present * **Returns:** the raw (untouched) value of the given field, which is equal to a value from `choices` * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the key was present in the dictionary but its value was not an allowed choice, or if no default value was provided and the key was not found in the dictionary #### *static* parse_dict(d, key, default=) Parses a dictionary attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default dict to return if key is not present * **Returns:** a dictionary * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_int(d, key, default=) Parses an integer attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default integer value to return if key is not present * **Returns:** an int * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_mutually_exclusive_fields(fields) Parses a mutually exclusive dictionary of pre-parsed fields, which must contain exactly one field with a truthy value. * **Parameters:** **fields** – a dictionary of pre-parsed fields * **Returns:** the (field, value) that was set * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if zero or more than one truthy value was found #### *static* parse_number(d, key, default=) Parses a number attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default numeric value to return if key is not present * **Returns:** a number (e.g. int, float) * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_object(d, key, cls, default=) Parses an object attribute. The value of d[key] can be either an instance of cls or a serialized dict from an instance of cls. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **cls** – the class of d[key] * **default** – a default cls instance to return if key is not present * **Returns:** an instance of cls * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_object_array(d, key, cls, default=) Parses an array of objects. The values in d[key] can be either instances of cls or serialized dicts from instances of cls. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **cls** – the class of the elements of list d[key] * **default** – the default list to return if key is not present * **Returns:** a list of cls instances * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_object_dict(d, key, cls, default=) Parses a dictionary whose values are objects. The values in d[key] can be either instances of cls or serialized dicts from instances of cls. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **cls** – the class of the values of dictionary d[key] * **default** – the default dict of cls instances to return if key is not present * **Returns:** a dictionary whose values are cls instances * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_path(d, key, default=) Parses a path attribute. The path is converted to an absolute path if necessary via `os.path.abspath(os.path.expanduser(value))`. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default string to return if key is not present * **Returns:** a path string * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *static* parse_raw(d, key, default=) Parses a raw (arbitrary) JSON field. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default value to return if key is not present * **Returns:** the raw (untouched) value of the given field * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if no default value was provided and the key was not found in the dictionary #### *static* parse_string(d, key, default=) Parses a string attribute. * **Parameters:** * **d** – a JSON dictionary * **key** – the key to parse * **default** – a default string to return if key is not present * **Returns:** a string * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if the field value was the wrong type or no default value was provided and the key was not found in the dictionary #### *property* run_cls The `BaseRun` class associated with this config. #### serialize(reflective=False) Serializes the object into a dictionary. Serialization is applied recursively to all attributes in the object, including element-wise serialization of lists and dictionary values. * **Parameters:** **reflective** – whether to include reflective attributes when serializing the object. By default, this is False * **Returns:** a JSON dictionary representation of the object #### to_str(pretty_print=True, \*\*kwargs) Returns a string representation of this object. * **Parameters:** * **pretty_print** – whether to render the JSON in human readable format with newlines and indentations. By default, this is True * **\*\*kwargs** – optional keyword arguments for `self.serialize()` * **Returns:** a string representation of the object #### *static* validate_all_or_nothing_fields(fields) Validates a dictionary of pre-parsed fields checking that either all or none of the fields have a truthy value. * **Parameters:** **fields** – a dictionary of pre-parsed fields * **Raises:** [**ConfigError**](fiftyone.zoo.md#fiftyone.zoo.ConfigError) – if some values are truth and some are not #### write_json(path, pretty_print=False, \*\*kwargs) Serializes the object and writes it to disk. * **Parameters:** * **path** – the output path * **pretty_print** – whether to render the JSON in human readable format with newlines and indentations. By default, this is False * **\*\*kwargs** – optional keyword arguments for `self.serialize()` ### *class* fiftyone.core.evaluation.EvaluationMethod(config) Bases: [`BaseRun`](fiftyone.core.runs.md#fiftyone.core.runs.BaseRun) Base class for evaluation methods. Subclasses will typically declare an interface method that handles performing evaluation on an image, video, or entire collection. * **Parameters:** **config** – an [`EvaluationMethodConfig`](#fiftyone.core.evaluation.EvaluationMethodConfig) **Methods:** | [`run_info_cls`](#fiftyone.core.evaluation.EvaluationMethod.run_info_cls)() | The `BaseRunInfo` class associated with this class. | |---------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------| | [`cleanup`](#fiftyone.core.evaluation.EvaluationMethod.cleanup)(samples, key) | Cleans up the results of the run with the given key from the collection. | | [`delete_run`](#fiftyone.core.evaluation.EvaluationMethod.delete_run)(samples, key[, cleanup]) | Deletes the results associated with the given run key from the collection. | | [`delete_runs`](#fiftyone.core.evaluation.EvaluationMethod.delete_runs)(samples[, cleanup]) | Deletes all runs from the collection. | | [`ensure_requirements`](#fiftyone.core.evaluation.EvaluationMethod.ensure_requirements)() | Ensures that any necessary packages to execute this run are installed. | | [`ensure_usage_requirements`](#fiftyone.core.evaluation.EvaluationMethod.ensure_usage_requirements)() | Ensures that any necessary packages to use existing results for this run are installed. | | [`from_config`](#fiftyone.core.evaluation.EvaluationMethod.from_config)(config) | Instantiates a Configurable class from a Config instance. | | [`from_dict`](#fiftyone.core.evaluation.EvaluationMethod.from_dict)(d) | Instantiates a Configurable class from a Config dict. | | [`from_json`](#fiftyone.core.evaluation.EvaluationMethod.from_json)(json_path) | Instantiates a Configurable class from a Config JSON file. | | [`from_kwargs`](#fiftyone.core.evaluation.EvaluationMethod.from_kwargs)(\*\*kwargs) | Instantiates a Configurable class from keyword arguments defining the attributes of a Config. | | [`get_fields`](#fiftyone.core.evaluation.EvaluationMethod.get_fields)(samples, key) | Gets the fields that were involved in the given run. | | [`get_run_info`](#fiftyone.core.evaluation.EvaluationMethod.get_run_info)(samples, key) | Gets the `BaseRunInfo` for the given key on the collection. | | [`has_cached_run_results`](#fiftyone.core.evaluation.EvaluationMethod.has_cached_run_results)(samples, key) | Determines whether `BaseRunResults` for the given key are cached on the collection. | | [`list_runs`](#fiftyone.core.evaluation.EvaluationMethod.list_runs)(samples[, type, method]) | Returns the list of run keys on the given collection. | | [`load_run_results`](#fiftyone.core.evaluation.EvaluationMethod.load_run_results)(samples, key[, cache, ...]) | Loads the `BaseRunResults` for the given key on the collection. | | [`load_run_view`](#fiftyone.core.evaluation.EvaluationMethod.load_run_view)(samples, key[, select_fields]) | Loads the view on which the specified run was performed. | | [`parse`](#fiftyone.core.evaluation.EvaluationMethod.parse)(class_name[, module_name]) | Parses a Configurable subclass name string. | | [`register_run`](#fiftyone.core.evaluation.EvaluationMethod.register_run)(samples, key[, overwrite, cleanup]) | Registers a run of this method under the given key on the given collection. | | [`rename`](#fiftyone.core.evaluation.EvaluationMethod.rename)(samples, key, new_key) | Performs any necessary operations required to rename this run's key. | | [`save_run_info`](#fiftyone.core.evaluation.EvaluationMethod.save_run_info)(samples, run_info[, ...]) | Saves the run information on the collection. | | [`save_run_results`](#fiftyone.core.evaluation.EvaluationMethod.save_run_results)(samples, key, run_results) | Saves the run results on the collection. | | [`update_run_config`](#fiftyone.core.evaluation.EvaluationMethod.update_run_config)(samples, key, config) | Updates the `BaseRunConfig` for the given run on the collection. | | [`update_run_key`](#fiftyone.core.evaluation.EvaluationMethod.update_run_key)(samples, key, new_key) | Replaces the key for the given run with a new key. | | [`validate`](#fiftyone.core.evaluation.EvaluationMethod.validate)(config) | Validates that the given config is an instance of Config. | | [`validate_run`](#fiftyone.core.evaluation.EvaluationMethod.validate_run)(samples, key[, overwrite]) | Validates that the collection can accept this run. | #### *classmethod* run_info_cls() The `BaseRunInfo` class associated with this class. #### cleanup(samples, key) Cleans up the results of the run with the given key from the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key #### *classmethod* delete_run(samples, key, cleanup=True) Deletes the results associated with the given run key from the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **cleanup** (*True*) – whether to execute the run’s `BaseRun.cleanup()` method #### *classmethod* delete_runs(samples, cleanup=True) Deletes all runs from the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **cleanup** (*True*) – whether to execute the run’s `BaseRun.cleanup()` methods #### ensure_requirements() Ensures that any necessary packages to execute this run are installed. Runs should respect `fiftyone.config.requirement_error_level` when handling errors. #### ensure_usage_requirements() Ensures that any necessary packages to use existing results for this run are installed. Runs should respect `fiftyone.config.requirement_error_level` when handling errors. #### *classmethod* from_config(config) Instantiates a Configurable class from a Config instance. #### *classmethod* from_dict(d) Instantiates a Configurable class from a Config dict. * **Parameters:** **d** – a dict to construct a Config * **Returns:** an instance of cls #### *classmethod* from_json(json_path) Instantiates a Configurable class from a Config JSON file. * **Parameters:** **json_path** – path to a JSON file for type Config * **Returns:** an instance of cls #### *classmethod* from_kwargs(\*\*kwargs) Instantiates a Configurable class from keyword arguments defining the attributes of a Config. * **Parameters:** **\*\*kwargs** – keyword arguments that define the fields of a Config dict * **Returns:** an instance of cls #### get_fields(samples, key) Gets the fields that were involved in the given run. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **Returns:** a list of fields #### *classmethod* get_run_info(samples, key) Gets the `BaseRunInfo` for the given key on the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **Returns:** a `BaseRunInfo` #### *classmethod* has_cached_run_results(samples, key) Determines whether `BaseRunResults` for the given key are cached on the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **Returns:** True/False #### *classmethod* list_runs(samples, type=None, method=None, \*\*kwargs) Returns the list of run keys on the given collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **type** (*None*) – a specific run type to match, which can be: - a string [`fiftyone.core.runs.BaseRunConfig.type`](fiftyone.core.runs.md#fiftyone.core.runs.BaseRunConfig.type) - a [`fiftyone.core.runs.BaseRun`](fiftyone.core.runs.md#fiftyone.core.runs.BaseRun) class or its fully-qualified class name string * **method** (*None*) – a specific [`fiftyone.core.runs.BaseRunConfig.method`](fiftyone.core.runs.md#fiftyone.core.runs.BaseRunConfig.method) string to match * **\*\*kwargs** – optional config parameters to match * **Returns:** a list of run keys #### *classmethod* load_run_results(samples, key, cache=True, load_view=True, \*\*kwargs) Loads the `BaseRunResults` for the given key on the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **cache** (*True*) – whether to cache the results on the collection * **load_view** (*True*) – whether to load the run view in the results (True) or the full dataset (False) * **\*\*kwargs** – keyword arguments for the run’s `BaseRunConfig.load_credentials()` method * **Returns:** a `BaseRunResults`, or None if the run did not save results #### *classmethod* load_run_view(samples, key, select_fields=False) Loads the view on which the specified run was performed. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **select_fields** (*False*) – whether to exclude fields involved in other runs of the same type * **Returns:** a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) #### *static* parse(class_name, module_name=None) Parses a Configurable subclass name string. Assumes both the Configurable class and the Config class are defined in the same module. The module containing the classes will be loaded if necessary. * **Parameters:** * **class_name** – a string containing the name of the Configurable class, e.g. “ClassName”, or a fully-qualified class name, e.g. “eta.core.config.ClassName” * **module_name** – a string containing the fully-qualified module name, e.g. “eta.core.config”, or None if class_name includes the module name. Set module_name = \_\_name_\_ to load a class from the calling module * **Returns:** the Configurable class config_cls: the Config class associated with cls * **Return type:** [cls](fiftyone.brain.internal.core.elasticsearch.md#fiftyone.brain.internal.core.elasticsearch.ElasticsearchSimilarityConfig.cls) #### register_run(samples, key, overwrite=True, cleanup=True) Registers a run of this method under the given key on the given collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **overwrite** (*True*) – whether to allow overwriting an existing run of the same type * **cleanup** (*True*) – whether to execute an existing run’s `BaseRun.cleanup()` method when overwriting it #### rename(samples, key, new_key) Performs any necessary operations required to rename this run’s key. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **new_key** – a new run key #### *classmethod* save_run_info(samples, run_info, overwrite=True, cleanup=True) Saves the run information on the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **run_info** – a `BaseRunInfo` * **overwrite** (*True*) – whether to overwrite an existing run with the same key * **cleanup** (*True*) – whether to execute an existing run’s `BaseRun.cleanup()` method when overwriting it #### *classmethod* save_run_results(samples, key, run_results, overwrite=True, cache=True) Saves the run results on the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **run_results** – a `BaseRunResults`, or None * **overwrite** (*True*) – whether to overwrite an existing result with the same key * **cache** (*True*) – whether to cache the results on the collection #### *classmethod* update_run_config(samples, key, config) Updates the `BaseRunConfig` for the given run on the collection. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **config** – a `BaseRunConfig` #### *classmethod* update_run_key(samples, key, new_key) Replaces the key for the given run with a new key. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **new_key** – a new run key #### *classmethod* validate(config) Validates that the given config is an instance of Config. * **Raises:** **ConfigurableError** – if config is not an instance of Config #### validate_run(samples, key, overwrite=True) Validates that the collection can accept this run. The run may be invalid if, for example, a run of a different type has already been run under the same key and thus overwriting it would cause ambiguity on how to cleanup the results. * **Parameters:** * **samples** – a [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) * **key** – a run key * **overwrite** (*True*) – whether to allow overwriting an existing run of the same type * **Raises:** **ValueError** – if the run is invalid ### *class* fiftyone.core.evaluation.EvaluationResults(samples, config, key, backend=None) Bases: [`BaseRunResults`](fiftyone.core.runs.md#fiftyone.core.runs.BaseRunResults) Base class for evaluation results. **Methods:** | [`attributes`](#fiftyone.core.evaluation.EvaluationResults.attributes)() | Returns the list of class attributes that will be serialized by [`serialize()`](#fiftyone.core.evaluation.EvaluationResults.serialize). | |----------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------| | [`base_results_cls`](#fiftyone.core.evaluation.EvaluationResults.base_results_cls)(type) | Returns the results class for the given run type. | | [`copy`](#fiftyone.core.evaluation.EvaluationResults.copy)() | Returns a deep copy of the object. | | [`custom_attributes`](#fiftyone.core.evaluation.EvaluationResults.custom_attributes)([dynamic, private]) | Returns a customizable list of class attributes. | | [`from_dict`](#fiftyone.core.evaluation.EvaluationResults.from_dict)(d, samples, config, key) | Builds a `BaseRunResults` from a JSON dict representation of it. | | [`from_json`](#fiftyone.core.evaluation.EvaluationResults.from_json)(path, \*args, \*\*kwargs) | Constructs a Serializable object from a JSON file. | | [`from_str`](#fiftyone.core.evaluation.EvaluationResults.from_str)(s, \*args, \*\*kwargs) | Constructs a Serializable object from a JSON string. | | [`get_class_name`](#fiftyone.core.evaluation.EvaluationResults.get_class_name)() | Returns the fully-qualified class name string of this object. | | [`get_meta`](#fiftyone.core.evaluation.EvaluationResults.get_meta)() | Small facts that DESCRIBE these results, stored beside the run so callers can read them without loading the results. | | [`save`](#fiftyone.core.evaluation.EvaluationResults.save)() | Saves the results to the database. | | [`save_config`](#fiftyone.core.evaluation.EvaluationResults.save_config)() | Saves these results config to the database. | | [`serialize`](#fiftyone.core.evaluation.EvaluationResults.serialize)([reflective]) | Serializes the object into a dictionary. | | [`to_str`](#fiftyone.core.evaluation.EvaluationResults.to_str)([pretty_print]) | Returns a string representation of this object. | | [`write_json`](#fiftyone.core.evaluation.EvaluationResults.write_json)(path[, pretty_print]) | Serializes the object and writes it to disk. | **Attributes:** | [`backend`](#fiftyone.core.evaluation.EvaluationResults.backend) | The `BaseRun` for these results. | |--------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------| | [`cls`](#fiftyone.core.evaluation.EvaluationResults.cls) | The fully-qualified name of this `BaseRunResults` class. | | [`config`](#fiftyone.core.evaluation.EvaluationResults.config) | The `BaseRunConfig` for these results. | | [`key`](#fiftyone.core.evaluation.EvaluationResults.key) | The run key for these results. | | [`samples`](#fiftyone.core.evaluation.EvaluationResults.samples) | The [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) associated with these results. | #### attributes() Returns the list of class attributes that will be serialized by [`serialize()`](#fiftyone.core.evaluation.EvaluationResults.serialize). * **Returns:** a list of attributes #### *property* backend The `BaseRun` for these results. #### *static* base_results_cls(type) Returns the results class for the given run type. * **Parameters:** **type** – a `BaseRunConfig.type` * **Returns:** a `BaseRunResults` subclass #### *property* cls The fully-qualified name of this `BaseRunResults` class. #### *property* config The `BaseRunConfig` for these results. #### copy() Returns a deep copy of the object. * **Returns:** a Serializable instance #### custom_attributes(dynamic=False, private=False) Returns a customizable list of class attributes. By default, all attributes in vars(self) are returned, minus private attributes (those starting with “_”). * **Parameters:** * **dynamic** – whether to include dynamic properties, e.g., those defined by getter/setter methods or the `@property` decorator. By default, this is False * **private** – whether to include private properties, i.e., those starting with “_”. By default, this is False * **Returns:** a list of class attributes #### *classmethod* from_dict(d, samples, config, key) Builds a `BaseRunResults` from a JSON dict representation of it. * **Parameters:** * **d** – a JSON dict * **samples** – the [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) for the run * **config** – the `BaseRunConfig` for the run * **key** – the run key * **Returns:** a `BaseRunResults` #### *classmethod* from_json(path, \*args, \*\*kwargs) Constructs a Serializable object from a JSON file. Subclasses may override this method, but, by default, this method simply reads the JSON and calls from_dict(), which subclasses must implement. * **Parameters:** * **path** – the path to the JSON file on disk * **\*args** – optional positional arguments for `self.from_dict()` * **\*\*kwargs** – optional keyword arguments for `self.from_dict()` * **Returns:** an instance of the Serializable class #### *classmethod* from_str(s, \*args, \*\*kwargs) Constructs a Serializable object from a JSON string. Subclasses may override this method, but, by default, this method simply parses the string and calls from_dict(), which subclasses must implement. * **Parameters:** * **s** – a JSON string representation of a Serializable object * **\*args** – optional positional arguments for `self.from_dict()` * **\*\*kwargs** – optional keyword arguments for `self.from_dict()` * **Returns:** an instance of the Serializable class #### *classmethod* get_class_name() Returns the fully-qualified class name string of this object. #### get_meta() Small facts that DESCRIBE these results, stored beside the run so callers can read them without loading the results. The results themselves are a blob in GridFS whose arrays can run to hundreds of MB; a count or a path is a few bytes. Anything returned here is written when the results are saved (see `BaseRun.save_run_results()`), so no read path has to load — or write — to answer for it. * **Returns:** a JSON-serializable dict #### *property* key The run key for these results. #### *property* samples The [`fiftyone.core.collections.SampleCollection`](fiftyone.core.collections.md#fiftyone.core.collections.SampleCollection) associated with these results. #### save() Saves the results to the database. #### save_config() Saves these results config to the database. #### serialize(reflective=False) Serializes the object into a dictionary. Serialization is applied recursively to all attributes in the object, including element-wise serialization of lists and dictionary values. * **Parameters:** **reflective** – whether to include reflective attributes when serializing the object. By default, this is False * **Returns:** a JSON dictionary representation of the object #### to_str(pretty_print=True, \*\*kwargs) Returns a string representation of this object. * **Parameters:** * **pretty_print** – whether to render the JSON in human readable format with newlines and indentations. By default, this is True * **\*\*kwargs** – optional keyword arguments for `self.serialize()` * **Returns:** a string representation of the object #### write_json(path, pretty_print=False, \*\*kwargs) Serializes the object and writes it to disk. * **Parameters:** * **path** – the output path * **pretty_print** – whether to render the JSON in human readable format with newlines and indentations. By default, this is False * **\*\*kwargs** – optional keyword arguments for `self.serialize()`