idx
int64
0
1.42k
task_name
stringclasses
7 values
input_caption
stringlengths
13
121
output_caption
stringlengths
11
138
instruction
stringlengths
9
135
video_path
stringclasses
76 values
0
style
Several goldfish swim in a tank.
Several goldfish swim in a tank, impressionist style.
make the style impressionist
DAVIS_480p/480p_videos/gold-fish.mp4
1
object
Several goldfish swim in a tank.
Several sharks swim in a tank.
change goldfish to sharks.
DAVIS_480p/480p_videos/gold-fish.mp4
2
background
Several goldfish swim in a tank.
Several goldfish swim in a pond.
change the background to pond.
DAVIS_480p/480p_videos/gold-fish.mp4
3
multiple
Several goldfish swim in a tank.
Several koi fish swim in a pond, rainbow color scheme.
change goldfish to koi fish, change the background to pond, change style to rainbow color scheme.
DAVIS_480p/480p_videos/gold-fish.mp4
4
style
A car drifts on a racetrack.
A car drifts on a racetrack, neon lights.
add neon lights effect
DAVIS_480p/480p_videos/drift-turn.mp4
5
object
A car drifts on a racetrack.
A tuk tuk drifts on a racetrack.
Change car to tuk tuk.
DAVIS_480p/480p_videos/drift-turn.mp4
6
background
A car drifts on a racetrack.
A car drifts on a snowy road.
change racetrack to snowy road.
DAVIS_480p/480p_videos/drift-turn.mp4
7
multiple
A car drifts on a racetrack.
A truck drifts on a muddy off-road track, sepia-toned.
change car to truck, change racetrack to muddy off-road track, use sepia-toned style.
DAVIS_480p/480p_videos/drift-turn.mp4
8
style
Several people lindy hop dance in a school gym.
Several people lindy hop dance in a school gym, sepia-toned photo.
Apply sepia-toned style to the photo.
DAVIS_480p/480p_videos/lindy-hop.mp4
9
object
Several people lindy hop dance in a school gym.
Several people breakdance in a school gym.
make the people doing breakdance.
DAVIS_480p/480p_videos/lindy-hop.mp4
10
background
Several people lindy hop dance in a school gym.
Several people lindy hop dance in a fancy marble ballroom.
change background to a fancy marble ballroom.
DAVIS_480p/480p_videos/lindy-hop.mp4
11
multiple
Several people lindy hop dance in a school gym.
Several people breakdance in a marble ballroom, neon lights style.
make the people doing breakdance, change the background to marble ballroom, apply neon lights style.
DAVIS_480p/480p_videos/lindy-hop.mp4
12
style
Several people ride surfboards in the ocean.
Several people ride motorcycles in the pink ocean.
change surfboards to motorcycles, add pink color to the ocean.
DAVIS_480p/480p_videos/miami-surf.mp4
13
object
Several people ride surfboards in the ocean.
Several people ride boogie boards on a concrete skate park.
change surfboards to boogie boards, make the background a concrete skate park.
DAVIS_480p/480p_videos/miami-surf.mp4
14
background
Several people ride surfboards in the ocean.
Several people ride surfboards in a wave pool.
change the background to wave pool.
DAVIS_480p/480p_videos/miami-surf.mp4
15
multiple
Several people ride surfboards in the ocean.
Several people ride kayaks in a river, aerial view.
change surfboards to kayaks, change background to river, aerial view.
DAVIS_480p/480p_videos/miami-surf.mp4
16
style
A person does a trick on a BMX bike at a skatepark.
A person does a trick on a BMX bike at a skatepark, grayscale.
Add grayscale effect to the image.
DAVIS_480p/480p_videos/bmx-rider.mp4
17
object
A person does a trick on a BMX bike at a skatepark.
A person does a trick on a unicycle at a skatepark.
change bike to unicycle.
DAVIS_480p/480p_videos/bmx-rider.mp4
18
background
A person does a trick on a BMX bike at a skatepark.
A person does a trick on a BMX bike at a snow covered park in Antarctica.
change background to snow covered park in Antarctica.
DAVIS_480p/480p_videos/bmx-rider.mp4
19
multiple
A person does a trick on a BMX bike at a skatepark.
A person does a trick on a skateboard at a beach skate park, vintage style.
change bike to skateboard, change background to beach skate park, apply vintage style.
DAVIS_480p/480p_videos/bmx-rider.mp4
20
style
Dog jumps over a bar.
Dog jumps over a bar, high-contrast style.
make the style high-contrast.
DAVIS_480p/480p_videos/dog-competition.mp4
21
object
Dog jumps over a bar.
Rabbit jumps over a bar.
change dog to rabbit.
DAVIS_480p/480p_videos/dog-competition.mp4
22
background
Dog jumps over a bar.
Dog jumps over a bar in outer space.
Change the background to outer space.
DAVIS_480p/480p_videos/dog-competition.mp4
23
multiple
Dog jumps over a bar.
Kangaroo jumps over a bar in a park, black and white.
change Dog to Kangaroo, add black and white effect, and change the background to a park.
DAVIS_480p/480p_videos/dog-competition.mp4
24
style
Women jump over hurdles on a racetrack.
Women jump over hurdles on a racetrack, Claymation style.
Make the style Claymation.
DAVIS_480p/480p_videos/hurdles-race.mp4
25
object
Women jump over hurdles on a racetrack.
Men jump over hurdles on a racetrack.
change women to men.
DAVIS_480p/480p_videos/hurdles-race.mp4
26
background
Women jump over hurdles on a racetrack.
Women jump over hurdles under a flying saucer.
add a flying saucer to the background.
DAVIS_480p/480p_videos/hurdles-race.mp4
27
multiple
Women jump over hurdles on a racetrack.
Teddy bears jump over hurdles on a racetrack, vibrant colors.
change women to teddy bears, use vibrant colors style.
DAVIS_480p/480p_videos/hurdles-race.mp4
28
style
People play hockey on an ice rink.
People play hockey on an ice rink, brightly colored cyberpunk style.
make it brightly colored cyberpunk style
DAVIS_480p/480p_videos/ice-hockey.mp4
29
object
People play hockey on an ice rink.
Cartoon characters play hockey on an ice rink.
make people to cartoon characters.
DAVIS_480p/480p_videos/ice-hockey.mp4
30
background
People play hockey on an ice rink.
People play hockey on the cracked mud floor of the Mojave desert.
change ice rink to cracked mud floor of the Mojave desert.
DAVIS_480p/480p_videos/ice-hockey.mp4
31
multiple
People play hockey on an ice rink.
People play broomball on an ice rink, nighttime lighting.
change hockey to broomball, add nighttime lighting style.
DAVIS_480p/480p_videos/ice-hockey.mp4
32
style
Two people perform judo on a tatami mat.
Two people perform judo on a tatami mat, vintage style.
Make the style vintage.
DAVIS_480p/480p_videos/judo.mp4
33
object
Two people perform judo on a tatami mat.
Two tabby cats perform judo on a tatami mat.
change people to tabby cats.
DAVIS_480p/480p_videos/judo.mp4
34
background
Two people perform judo on a tatami mat.
Two people perform judo in the Grand Canyon.
Change the background to the Grand Canyon.
DAVIS_480p/480p_videos/judo.mp4
35
multiple
Two people perform judo on a tatami mat.
Two people perform jiu-jitsu in the Grand Canyon vintage style.
change judo to jiu-jitsu, change the background to Grand Canyon, add use vintage style.
DAVIS_480p/480p_videos/judo.mp4
36
style
A man juggles in the street.
A robotic man juggles in the street.
make the man robotic.
DAVIS_480p/480p_videos/juggling-selfie.mp4
37
object
A man juggles in the street.
A man juggles watermelons in the street.
change the juggling ball to watermelons
DAVIS_480p/480p_videos/juggling-selfie.mp4
38
background
A man juggles in the street.
A man juggles in Times Square.
Change the location to Times Square.
DAVIS_480p/480p_videos/juggling-selfie.mp4
39
multiple
A man juggles in the street.
A robotic man juggles in Times Square, split-toning effect.
make the man robotic, change the location to Times Square, split-toning effect.
DAVIS_480p/480p_videos/juggling-selfie.mp4
40
style
Two men load a box onto a cart inside a store.
Two men load a box onto a cart inside a store, security camera view.
make the view from a security camera
DAVIS_480p/480p_videos/loading.mp4
41
object
Two men load a box onto a cart inside a store.
Two men load a giant GPU onto a cart inside a store.
replace box with giant Nvidia GPU.
DAVIS_480p/480p_videos/loading.mp4
42
background
Two men load a box onto a cart inside a store.
Two men load a box onto a cart on a snow covered road.
Change the background to a snow covered road.
DAVIS_480p/480p_videos/loading.mp4
43
multiple
Two men load a box onto a cart inside a store.
Two women load a giant GPU onto a cart on a snow-covered road.
change men to women, change box to giant Nvidia GPU, change the background to a snow-covered road.
DAVIS_480p/480p_videos/loading.mp4
44
style
A person on a motorcycle does a burnout on the road.
A person on a motorcycle does a burnout on the road, neon color style.
make the style neon color.
DAVIS_480p/480p_videos/mbike-trick.mp4
45
object
A person on a motorcycle does a burnout on the road.
A person on a bicycle does a wheelie on the road.
make the man doing wheelie on a bicycle.
DAVIS_480p/480p_videos/mbike-trick.mp4
46
background
A person on a motorcycle does a burnout on the road.
A person on a motorcycle does a burnout on a frozen lake.
change road to frozen lake.
DAVIS_480p/480p_videos/mbike-trick.mp4
47
multiple
A person on a motorcycle does a burnout on the road.
A person on a scooter does a burnout on a frozen lake, sepia tone.
change motorcycle to scooter, change road to frozen lake, add sepia tone.
DAVIS_480p/480p_videos/mbike-trick.mp4
48
style
A man does a trick with a scooter at a skatepark.
A man does a trick with a scooter at a skatepark, vermeer painting style.
make the style Vermeer painting style.
DAVIS_480p/480p_videos/stunt.mp4
49
object
A man does a trick with a scooter at a skatepark.
A man does a trick with a skateboard at a skatepark.
change scooter to skateboard.
DAVIS_480p/480p_videos/stunt.mp4
50
background
A man does a trick with a scooter at a skatepark.
A man does a trick with a scooter in a wooded field.
Change the background to a wooded field.
DAVIS_480p/480p_videos/stunt.mp4
51
multiple
A man does a trick with a scooter at a skatepark.
A woman does a trick with a scooter at a skatepark, vermeer painting style.
change man to woman, make the style Vermeer painting style.
DAVIS_480p/480p_videos/stunt.mp4
52
style
A man dives into a pool with tall buildings in the background.
A man dives into a pool with tall buildings in the background, silhouette style.
make the style silhouette.
DAVIS_480p/480p_videos/swimmer.mp4
53
object
A man dives into a pool with tall buildings in the background.
A furry rabbit dives into a pool with tall buildings in the background.
change man to furry rabbit
DAVIS_480p/480p_videos/swimmer.mp4
54
background
A man dives into a pool with tall buildings in the background.
A man dives into a lake in a natural setting.
change pool to lake, make the background natural setting.
DAVIS_480p/480p_videos/swimmer.mp4
55
multiple
A man dives into a pool with tall buildings in the background.
A furry rabbit jumps into a pool with tall buildings in the background, vibrant colors.
change man to furry rabbit, use vibrant colors style
DAVIS_480p/480p_videos/swimmer.mp4
56
style
Trucks drive on a racetrack.
Trucks drive on a racetrack, autumn, fall colors.
Add autumn/fall colors to the racetrack.
DAVIS_480p/480p_videos/trucks-race.mp4
57
object
Trucks drive on a racetrack.
Wooden trucks drive on a racetrack.
make trucks made of wood (wooden style truck)
DAVIS_480p/480p_videos/trucks-race.mp4
58
background
Trucks drive on a racetrack.
Trucks drive on a wooden kitchen table.
change the background to a wooden kitchen table.
DAVIS_480p/480p_videos/trucks-race.mp4
59
multiple
Trucks drive on a racetrack.
Monster trucks race on a dirt track, autumn, fall colors.
change trucks to monster trucks, make road a dirt track, use autumn/fall colors style
DAVIS_480p/480p_videos/trucks-race.mp4
60
style
A varanus lizard walks on a log.
A varanus lizard walks on a log, oil painting.
make the style oil painting.
DAVIS_480p/480p_videos/varanus-cage.mp4
61
object
A varanus lizard walks on a log.
A rainbow colored squirrel walks on a log.
change lizard to a rainbow colored squirrel.
DAVIS_480p/480p_videos/varanus-cage.mp4
62
background
A varanus lizard walks on a log.
A varanus lizard walks on an Arizona rock.
Replace log in the background with Arizona rock.
DAVIS_480p/480p_videos/varanus-cage.mp4
63
multiple
A varanus lizard walks on a log.
A rainbow colored squirrel walks on an Arizona rock, oil painting.
change lizard to a rainbow colored squirrel, change log in the background to Arizona rock, make the style oil painting.
DAVIS_480p/480p_videos/varanus-cage.mp4
64
style
Two basketball players coordinate with each other and score.
Two basketball players coordinate with each other and score, vintage style.
make the style vintage.
youtube_480p/480p_videos/basketball-players-scoring.mp4
65
object
Two basketball players coordinate with each other and score.
Two basketball players coordinate with each other shoot a teddy bear toy into the basket.
replace the ball to a teddy bear toy.
youtube_480p/480p_videos/basketball-players-scoring.mp4
66
background
Two basketball players coordinate with each other and score.
Two basketball players coordinate in a street game.
change the background into a street basketball playground.
youtube_480p/480p_videos/basketball-players-scoring.mp4
67
multiple
Two basketball players coordinate with each other and score.
Two basketball players coordinate in a beach game, black and white.
make people playing a beach game, add black and white effect.
youtube_480p/480p_videos/basketball-players-scoring.mp4
68
style
Tap Nixon shooting a basketball while another man helps him.
Tap Nixon shooting a basketball while another man helps him, claymation style
make the style claymation.
youtube_480p/480p_videos/basketball-shot.mp4
69
object
Tap Nixon shooting a basketball while another man helps him.
Tap Nixon shooting a rocket while another man helps him.
change basketball to rocket.
youtube_480p/480p_videos/basketball-shot.mp4
70
background
Tap Nixon shooting a basketball while another man helps him.
Tap Nixon shooting a basketball on Mars.
Change the location to Mars.
youtube_480p/480p_videos/basketball-shot.mp4
71
multiple
Tap Nixon shooting a basketball while another man helps him.
Tap Nixon shooting a basketball while a woman helps him, high-contrast style.
change man to a woman, make the style high-contrast.
youtube_480p/480p_videos/basketball-shot.mp4
72
style
The squirrel is climbing down a tree in a wooded park.
The squirrel is climbing down a tree in a wooded park, Van Gogh style.
make the style Van Gogh.
youtube_480p/480p_videos/squirrel-climb.mp4
73
object
The squirrel is climbing down a tree in a wooded park.
The cute yellow leopard is climbing down a tree in a wooded park.
change squirrel to cute yellow leopard.
youtube_480p/480p_videos/squirrel-climb.mp4
74
background
The squirrel is climbing down a tree in a wooded park.
The squirrel is climbing down a tree in a forest of cherry blossoms.
change background to forest of cherry blossoms.
youtube_480p/480p_videos/squirrel-climb.mp4
75
multiple
The squirrel is climbing down a tree in a wooded park.
The squirrel is climbing up a tree in a wooded park, soft-focus style.
The squirrel is climbing up a tree in a wooded park, soft-focus style.
youtube_480p/480p_videos/squirrel-climb.mp4
76
style
Man airbrush painting a horse on a wall.
Man airbrush painting a horse on a wall, very realistic.
make the painting very realistic.
youtube_480p/480p_videos/airbrush-painting.mp4
77
object
Man airbrush painting a horse on a wall.
Man airbrush painting a turtle on a wall.
Change horse to turtle.
youtube_480p/480p_videos/airbrush-painting.mp4
78
background
Man airbrush painting a horse on a wall.
Man airbrush painting a horse on a car.
the man is painting a horse on a car.
youtube_480p/480p_videos/airbrush-painting.mp4
79
multiple
Man airbrush painting a horse on a wall.
Man airbrush painting a turtle on a wall, very realistic.
change horse to turtle, make the turtle very realistic.
youtube_480p/480p_videos/airbrush-painting.mp4
80
style
A cat and a dog playing on the street while a girl walks around them.
A cat and a dog playing on the street while a girl walks around them, soft focus style.
make the style soft focus.
youtube_480p/480p_videos/cat-dog-play.mp4
81
object
A cat and a dog playing on the street while a girl walks around them.
A beaver and a skunk playing in the street while a girl walks around them.
change cat to beaver, change dog to skunk.
youtube_480p/480p_videos/cat-dog-play.mp4
82
background
A cat and a dog playing on the street while a girl walks around them.
A cat and a dog playing on the grass while a girl walks around them.
change the background to grass
youtube_480p/480p_videos/cat-dog-play.mp4
83
multiple
A cat and a dog playing on the street while a girl walks around them.
A cat and a dog playing on the beach while a girl walks around them, golden hour lighting.
change street to beach, add golden hour lighting style.
youtube_480p/480p_videos/cat-dog-play.mp4
84
style
Woman street artist plays an musical instrument.
Woman street artist plays a musical instrument, iron man style.
Add iron man style.
youtube_480p/480p_videos/street-instrument.mp4
85
object
Woman street artist plays an musical instrument.
Woman street artist sings a song.
make the woman singing a song.
youtube_480p/480p_videos/street-instrument.mp4
86
background
Woman street artist plays an musical instrument.
Woman plays a musical instrument indoors.
make the background indoors.
youtube_480p/480p_videos/street-instrument.mp4
87
multiple
Woman street artist plays an musical instrument.
Woman street artist plays a musical instrument indoors, iron man style.
Change the location to indoors, add iron man style.
youtube_480p/480p_videos/street-instrument.mp4
88
style
A car driving on the dirt road.
A car driving on the dirt road, dust cloud effect.
add dust cloud effect.
youtube_480p/480p_videos/dirt-road-driving.mp4
89
object
A car driving on the dirt road.
A monster truck driving on the dirt road.
change car to monster truck.
youtube_480p/480p_videos/dirt-road-driving.mp4
90
background
A car driving on the dirt road.
A car driving on a birthday cake
Make the car is driving on a birthday cake.
youtube_480p/480p_videos/dirt-road-driving.mp4
91
multiple
A car driving on the dirt road.
A spaceship driving on the dirt road during a rainy day, dramatic sky.
change car to spaceship, add rainy day and dramatic sky.
youtube_480p/480p_videos/dirt-road-driving.mp4
92
style
Circus man shows a round transparent ball, walking before the audience.
Circus man shows a round transparent ball, walking before the audience, spotlight effect.
add spotlight effect.
youtube_480p/480p_videos/circus-ball-act.mp4
93
object
Circus man shows a round transparent ball, walking before the audience.
Circus man juggles balls, walking before the audience.
make the person juggling balls.
youtube_480p/480p_videos/circus-ball-act.mp4
94
background
Circus man shows a round transparent ball, walking before the audience.
Circus man performs with a transparent ball in a field of orange poppy flowers.
Change the background to a field of orange poppy flowers.
youtube_480p/480p_videos/circus-ball-act.mp4
95
multiple
Circus man shows a round transparent ball, walking before the audience.
Circus panda bear shows a round transparent ball, walking before the audience, claymation style.
change man to a panda, use claymation style.
youtube_480p/480p_videos/circus-ball-act.mp4
96
style
An Audi Q7 goes on a snow trail.
An Audi Q7 goes on a snow trail, anime style.
make it animation style.
youtube_480p/480p_videos/audi-snow-trail.mp4
97
object
An Audi Q7 goes on a snow trail.
A BMW X5 goes on a snow trail
change the car to BMW X5.
youtube_480p/480p_videos/audi-snow-trail.mp4
98
background
An Audi Q7 goes on a snow trail.
An Audi Q7 goes on a desert trail.
make the car drive in desert trail.
youtube_480p/480p_videos/audi-snow-trail.mp4
99
multiple
An Audi Q7 goes on a snow trail.
An Audi Q7 goes on a snow trail, aerial view with snow-capped mountains in the background.
Add aerial view with snow-capped mountains in the background.
youtube_480p/480p_videos/audi-snow-trail.mp4

Dataset Card for the TGVE+ Test Set

Dataset Summary

We extend the widely used Text Guided Video Editing (TGVE) benchmark with additional editing tasks. The dataset now comprises seven editing tasks in total: four from the original TGVE and three new tasks, namely (i) object removal (Remove), (ii) object addition (Add), and (iii) texture alterations (Texture). The new tasks utilize the same 76 videos from the original TGVE benchmark.

Each row in the dataset consists of the instruction, input/output captions, and the relative path of the video in TGVE. For more details please see our paper and project page.

We'd like to thank InstructVid2Vid for creating instructions for the original TGVE tasks.

Licensing Information

Licensed with CC-BY-NC 4.0 License available here.

Citation Information

@inproceedings{Singer2024VideoEV,
  title={Video Editing via Factorized Diffusion Distillation},
  author={Uriel Singer and Amit Zohar and Yuval Kirstain and Shelly Sheynin and Adam Polyak and Devi Parikh and Yaniv Taigman},
  year={2024},
  url={https://api.semanticscholar.org/CorpusID:268385300}
}
Downloads last month
24
Edit dataset card