Datasets:

ArXiv:
Tags:
License:
image
image
world_name
string
character_name
string
character2_name
string
character1_pos
string
character2_pos
string
character_texture
string
character2_texture
string
desert
Anlylosaurus
blank
left
right
Default
Default
desert
Anlylosaurus
Goldfish
left
right
Default
Default
desert
Anlylosaurus
Caribou
left
right
Default
Default
desert
Anlylosaurus
Elephant
left
right
Default
Default
desert
Anlylosaurus
Camel
left
right
Default
Default
desert
Anlylosaurus
Penguin
left
right
Default
Default
desert
Anlylosaurus
Zebra
left
right
Default
Default
desert
Anlylosaurus
Bear
left
right
Default
Default
desert
Anlylosaurus
Beaver
left
right
Default
Default
desert
Anlylosaurus
Cattle
left
right
Default
Default
desert
Anlylosaurus
Armadillo
left
right
Default
Default
desert
Anlylosaurus
Gecko
left
right
Default
Default
desert
Anlylosaurus
Crow
left
right
Default
Default
desert
Anlylosaurus
Scorpion
left
right
Default
Default
desert
Anlylosaurus
GiantTortoise
left
right
Default
Default
desert
Anlylosaurus
Tarantula
left
right
Default
Default
desert
Anlylosaurus
Rhinoceros
left
right
Default
Default
desert
Anlylosaurus
Dolphin
left
right
Default
Default
desert
Anlylosaurus
EarlessSeal
left
right
Default
Default
desert
Anlylosaurus
Goat
left
right
Default
Default
desert
Anlylosaurus
Hippopotamus
left
right
Default
Default
desert
Anlylosaurus
Horse
left
right
Default
Default
desert
Anlylosaurus
Impala
left
right
Default
Default
desert
Anlylosaurus
Lion
left
right
Default
Default
desert
Anlylosaurus
Orca
left
right
Default
Default
desert
Anlylosaurus
Pig
left
right
Default
Default
desert
Anlylosaurus
Rabbit
left
right
Default
Default
desert
Anlylosaurus
Squirrel
left
right
Default
Default
desert
Anlylosaurus
Chicken
left
right
Default
Default
desert
Anlylosaurus
WhiteShark
left
right
Default
Default
desert
Anlylosaurus
Anlylosaurus
left
right
Default
Default
desert
Anlylosaurus
BlackRockFish
left
right
Default
Default
desert
Anlylosaurus
PoisonDartFrog
left
right
Default
Default
arena
Anlylosaurus
blank
left
right
Default
Default
arena
Anlylosaurus
Goldfish
left
right
Default
Default
arena
Anlylosaurus
Caribou
left
right
Default
Default
arena
Anlylosaurus
Elephant
left
right
Default
Default
arena
Anlylosaurus
Camel
left
right
Default
Default
arena
Anlylosaurus
Penguin
left
right
Default
Default
arena
Anlylosaurus
Zebra
left
right
Default
Default
arena
Anlylosaurus
Bear
left
right
Default
Default
arena
Anlylosaurus
Beaver
left
right
Default
Default
arena
Anlylosaurus
Cattle
left
right
Default
Default
arena
Anlylosaurus
Armadillo
left
right
Default
Default
arena
Anlylosaurus
Gecko
left
right
Default
Default
arena
Anlylosaurus
Crow
left
right
Default
Default
arena
Anlylosaurus
Scorpion
left
right
Default
Default
arena
Anlylosaurus
GiantTortoise
left
right
Default
Default
arena
Anlylosaurus
Tarantula
left
right
Default
Default
arena
Anlylosaurus
Rhinoceros
left
right
Default
Default
arena
Anlylosaurus
Dolphin
left
right
Default
Default
arena
Anlylosaurus
EarlessSeal
left
right
Default
Default
arena
Anlylosaurus
Goat
left
right
Default
Default
arena
Anlylosaurus
Hippopotamus
left
right
Default
Default
arena
Anlylosaurus
Horse
left
right
Default
Default
arena
Anlylosaurus
Impala
left
right
Default
Default
arena
Anlylosaurus
Lion
left
right
Default
Default
arena
Anlylosaurus
Orca
left
right
Default
Default
arena
Anlylosaurus
Pig
left
right
Default
Default
arena
Anlylosaurus
Rabbit
left
right
Default
Default
arena
Anlylosaurus
Squirrel
left
right
Default
Default
arena
Anlylosaurus
Chicken
left
right
Default
Default
arena
Anlylosaurus
WhiteShark
left
right
Default
Default
arena
Anlylosaurus
Anlylosaurus
left
right
Default
Default
arena
Anlylosaurus
BlackRockFish
left
right
Default
Default
arena
Anlylosaurus
PoisonDartFrog
left
right
Default
Default
ocean floor
Anlylosaurus
blank
left
right
Default
Default
ocean floor
Anlylosaurus
Goldfish
left
right
Default
Default
ocean floor
Anlylosaurus
Caribou
left
right
Default
Default
ocean floor
Anlylosaurus
Elephant
left
right
Default
Default
ocean floor
Anlylosaurus
Camel
left
right
Default
Default
ocean floor
Anlylosaurus
Penguin
left
right
Default
Default
ocean floor
Anlylosaurus
Zebra
left
right
Default
Default
ocean floor
Anlylosaurus
Bear
left
right
Default
Default
ocean floor
Anlylosaurus
Beaver
left
right
Default
Default
ocean floor
Anlylosaurus
Cattle
left
right
Default
Default
ocean floor
Anlylosaurus
Armadillo
left
right
Default
Default
ocean floor
Anlylosaurus
Gecko
left
right
Default
Default
ocean floor
Anlylosaurus
Crow
left
right
Default
Default
ocean floor
Anlylosaurus
Scorpion
left
right
Default
Default
ocean floor
Anlylosaurus
GiantTortoise
left
right
Default
Default
ocean floor
Anlylosaurus
Tarantula
left
right
Default
Default
ocean floor
Anlylosaurus
Rhinoceros
left
right
Default
Default
ocean floor
Anlylosaurus
Dolphin
left
right
Default
Default
ocean floor
Anlylosaurus
EarlessSeal
left
right
Default
Default
ocean floor
Anlylosaurus
Goat
left
right
Default
Default
ocean floor
Anlylosaurus
Hippopotamus
left
right
Default
Default
ocean floor
Anlylosaurus
Horse
left
right
Default
Default
ocean floor
Anlylosaurus
Impala
left
right
Default
Default
ocean floor
Anlylosaurus
Lion
left
right
Default
Default
ocean floor
Anlylosaurus
Orca
left
right
Default
Default
ocean floor
Anlylosaurus
Pig
left
right
Default
Default
ocean floor
Anlylosaurus
Rabbit
left
right
Default
Default
ocean floor
Anlylosaurus
Squirrel
left
right
Default
Default
ocean floor
Anlylosaurus
Chicken
left
right
Default
Default
ocean floor
Anlylosaurus
WhiteShark
left
right
Default
Default
ocean floor
Anlylosaurus
Anlylosaurus
left
right
Default
Default
ocean floor
Anlylosaurus
BlackRockFish
left
right
Default
Default
ocean floor
Anlylosaurus
PoisonDartFrog
left
right
Default
Default
race track
Anlylosaurus
blank
left
right
Default
Default

PUG: SPAR

PUG: SPAR (Scene, Position, Attribute, Relation) contains 43,560 test samples, with image-caption pairs that evaluate VLMs scene and object recognition, as well as inter-object and object-attribute relationships respectively. We utilize scenes containing up to two objects in 4 unique spatial relationships and 4 different texture variations.

LICENSE

The datasets are distributed under the CC-BY-NC, with the addenda that they should not be used to train Generative AI models.

Citing PUG

If you use one of the PUG datasets, please cite:

@misc{bordes2023pug,
      title={PUG: Photorealistic and Semantically Controllable Synthetic Data for Representation Learning}, 
      author={Florian Bordes and Shashank Shekhar and Mark Ibrahim and Diane Bouchacourt and Pascal Vincent and Ari S. Morcos},
      year={2023},
      eprint={2308.03977},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

To learn more about the PUG datasets:

Please visit the website and the github

Downloads last month
1
Edit dataset card