<!-- # hard line break macro for HTML -->

<a id="model-zoo-google-paligemma2-28b-mix-448"></a>

# google/paligemma2-28b-mix-448

<a href="../../plugins/plugins_ecosystem/paligemma2.html" target="_blank">
    <img src="https://img.shields.io/badge/Plugin-paligemma2-orange" alt="From Plugin">
</a>

#### NOTE
This is a [remotely-sourced model](../remote.md#model-zoo-remote) from the
[paligemma2](../../plugins/plugins_ecosystem/paligemma2.html) plugin, maintained by the community.
It is not part of FiftyOne core and may have special installation requirements.
Please review the plugin documentation and license before use.

PaliGemma 2 mix checkpoints are fine-tuned on a diverse set of tasks and are ready to use out of the box. These tasks include short and long captioning, optical character recognition, question answering, object detection and segmentation, and more..

**Details**

- Model name: `google/paligemma2-28b-mix-448`
- Model source: [https://huggingface.co/google/paligemma2-28b-mix-448](https://huggingface.co/google/paligemma2-28b-mix-448)
- Model author: Google DeepMind
- Model license: gemma ([https://ai.google.dev/gemma/terms](https://ai.google.dev/gemma/terms))
- Exposes embeddings? no
- Tags: `detection, segmentation, ocr, VLM, zero-shot`

**Requirements**

- Packages: `huggingface-hub, transformers>=4.50, torch, torchvision, accelerate, jax, flax`
- CPU support
  - yes
- GPU support
  - yes

**Example usage**

```python
import fiftyone as fo
import fiftyone.zoo as foz

foz.register_zoo_model_source("https://github.com/harpreetsahota204/paligemma2")

dataset = foz.load_zoo_dataset(
    "coco-2017",
    split="validation",
    dataset_name=fo.get_default_dataset_name(),
    max_samples=50,
    shuffle=True,
)

model = foz.load_zoo_model("google/paligemma2-28b-mix-448")

dataset.apply_model(model, label_field="predictions")

session = fo.launch_app(dataset)
```
