Datasets:
ArXiv:
Tags:
idx
int64 0
1.42k
| task_name
stringclasses 7
values | input_caption
stringlengths 13
121
| output_caption
stringlengths 11
138
| instruction
stringlengths 9
135
| video_path
stringclasses 76
values |
---|---|---|---|---|---|
0 | style | Several goldfish swim in a tank. | Several goldfish swim in a tank, impressionist style. | make the style impressionist | DAVIS_480p/480p_videos/gold-fish.mp4 |
1 | object | Several goldfish swim in a tank. | Several sharks swim in a tank. | change goldfish to sharks. | DAVIS_480p/480p_videos/gold-fish.mp4 |
2 | background | Several goldfish swim in a tank. | Several goldfish swim in a pond. | change the background to pond. | DAVIS_480p/480p_videos/gold-fish.mp4 |
3 | multiple | Several goldfish swim in a tank. | Several koi fish swim in a pond, rainbow color scheme. | change goldfish to koi fish, change the background to pond, change style to rainbow color scheme. | DAVIS_480p/480p_videos/gold-fish.mp4 |
4 | style | A car drifts on a racetrack. | A car drifts on a racetrack, neon lights. | add neon lights effect | DAVIS_480p/480p_videos/drift-turn.mp4 |
5 | object | A car drifts on a racetrack. | A tuk tuk drifts on a racetrack. | Change car to tuk tuk. | DAVIS_480p/480p_videos/drift-turn.mp4 |
6 | background | A car drifts on a racetrack. | A car drifts on a snowy road. | change racetrack to snowy road. | DAVIS_480p/480p_videos/drift-turn.mp4 |
7 | multiple | A car drifts on a racetrack. | A truck drifts on a muddy off-road track, sepia-toned. | change car to truck, change racetrack to muddy off-road track, use sepia-toned style. | DAVIS_480p/480p_videos/drift-turn.mp4 |
8 | style | Several people lindy hop dance in a school gym. | Several people lindy hop dance in a school gym, sepia-toned photo. | Apply sepia-toned style to the photo. | DAVIS_480p/480p_videos/lindy-hop.mp4 |
9 | object | Several people lindy hop dance in a school gym. | Several people breakdance in a school gym. | make the people doing breakdance. | DAVIS_480p/480p_videos/lindy-hop.mp4 |
10 | background | Several people lindy hop dance in a school gym. | Several people lindy hop dance in a fancy marble ballroom. | change background to a fancy marble ballroom. | DAVIS_480p/480p_videos/lindy-hop.mp4 |
11 | multiple | Several people lindy hop dance in a school gym. | Several people breakdance in a marble ballroom, neon lights style. | make the people doing breakdance, change the background to marble ballroom, apply neon lights style. | DAVIS_480p/480p_videos/lindy-hop.mp4 |
12 | style | Several people ride surfboards in the ocean. | Several people ride motorcycles in the pink ocean. | change surfboards to motorcycles, add pink color to the ocean. | DAVIS_480p/480p_videos/miami-surf.mp4 |
13 | object | Several people ride surfboards in the ocean. | Several people ride boogie boards on a concrete skate park. | change surfboards to boogie boards, make the background a concrete skate park. | DAVIS_480p/480p_videos/miami-surf.mp4 |
14 | background | Several people ride surfboards in the ocean. | Several people ride surfboards in a wave pool. | change the background to wave pool. | DAVIS_480p/480p_videos/miami-surf.mp4 |
15 | multiple | Several people ride surfboards in the ocean. | Several people ride kayaks in a river, aerial view. | change surfboards to kayaks, change background to river, aerial view. | DAVIS_480p/480p_videos/miami-surf.mp4 |
16 | style | A person does a trick on a BMX bike at a skatepark. | A person does a trick on a BMX bike at a skatepark, grayscale. | Add grayscale effect to the image. | DAVIS_480p/480p_videos/bmx-rider.mp4 |
17 | object | A person does a trick on a BMX bike at a skatepark. | A person does a trick on a unicycle at a skatepark. | change bike to unicycle. | DAVIS_480p/480p_videos/bmx-rider.mp4 |
18 | background | A person does a trick on a BMX bike at a skatepark. | A person does a trick on a BMX bike at a snow covered park in Antarctica. | change background to snow covered park in Antarctica. | DAVIS_480p/480p_videos/bmx-rider.mp4 |
19 | multiple | A person does a trick on a BMX bike at a skatepark. | A person does a trick on a skateboard at a beach skate park, vintage style. | change bike to skateboard, change background to beach skate park, apply vintage style. | DAVIS_480p/480p_videos/bmx-rider.mp4 |
20 | style | Dog jumps over a bar. | Dog jumps over a bar, high-contrast style. | make the style high-contrast. | DAVIS_480p/480p_videos/dog-competition.mp4 |
21 | object | Dog jumps over a bar. | Rabbit jumps over a bar. | change dog to rabbit. | DAVIS_480p/480p_videos/dog-competition.mp4 |
22 | background | Dog jumps over a bar. | Dog jumps over a bar in outer space. | Change the background to outer space. | DAVIS_480p/480p_videos/dog-competition.mp4 |
23 | multiple | Dog jumps over a bar. | Kangaroo jumps over a bar in a park, black and white. | change Dog to Kangaroo, add black and white effect, and change the background to a park. | DAVIS_480p/480p_videos/dog-competition.mp4 |
24 | style | Women jump over hurdles on a racetrack. | Women jump over hurdles on a racetrack, Claymation style. | Make the style Claymation. | DAVIS_480p/480p_videos/hurdles-race.mp4 |
25 | object | Women jump over hurdles on a racetrack. | Men jump over hurdles on a racetrack. | change women to men. | DAVIS_480p/480p_videos/hurdles-race.mp4 |
26 | background | Women jump over hurdles on a racetrack. | Women jump over hurdles under a flying saucer. | add a flying saucer to the background. | DAVIS_480p/480p_videos/hurdles-race.mp4 |
27 | multiple | Women jump over hurdles on a racetrack. | Teddy bears jump over hurdles on a racetrack, vibrant colors. | change women to teddy bears, use vibrant colors style. | DAVIS_480p/480p_videos/hurdles-race.mp4 |
28 | style | People play hockey on an ice rink. | People play hockey on an ice rink, brightly colored cyberpunk style. | make it brightly colored cyberpunk style | DAVIS_480p/480p_videos/ice-hockey.mp4 |
29 | object | People play hockey on an ice rink. | Cartoon characters play hockey on an ice rink. | make people to cartoon characters. | DAVIS_480p/480p_videos/ice-hockey.mp4 |
30 | background | People play hockey on an ice rink. | People play hockey on the cracked mud floor of the Mojave desert. | change ice rink to cracked mud floor of the Mojave desert. | DAVIS_480p/480p_videos/ice-hockey.mp4 |
31 | multiple | People play hockey on an ice rink. | People play broomball on an ice rink, nighttime lighting. | change hockey to broomball, add nighttime lighting style. | DAVIS_480p/480p_videos/ice-hockey.mp4 |
32 | style | Two people perform judo on a tatami mat. | Two people perform judo on a tatami mat, vintage style. | Make the style vintage. | DAVIS_480p/480p_videos/judo.mp4 |
33 | object | Two people perform judo on a tatami mat. | Two tabby cats perform judo on a tatami mat. | change people to tabby cats. | DAVIS_480p/480p_videos/judo.mp4 |
34 | background | Two people perform judo on a tatami mat. | Two people perform judo in the Grand Canyon. | Change the background to the Grand Canyon. | DAVIS_480p/480p_videos/judo.mp4 |
35 | multiple | Two people perform judo on a tatami mat. | Two people perform jiu-jitsu in the Grand Canyon vintage style. | change judo to jiu-jitsu, change the background to Grand Canyon, add use vintage style. | DAVIS_480p/480p_videos/judo.mp4 |
36 | style | A man juggles in the street. | A robotic man juggles in the street. | make the man robotic. | DAVIS_480p/480p_videos/juggling-selfie.mp4 |
37 | object | A man juggles in the street. | A man juggles watermelons in the street. | change the juggling ball to watermelons | DAVIS_480p/480p_videos/juggling-selfie.mp4 |
38 | background | A man juggles in the street. | A man juggles in Times Square. | Change the location to Times Square. | DAVIS_480p/480p_videos/juggling-selfie.mp4 |
39 | multiple | A man juggles in the street. | A robotic man juggles in Times Square, split-toning effect. | make the man robotic, change the location to Times Square, split-toning effect. | DAVIS_480p/480p_videos/juggling-selfie.mp4 |
40 | style | Two men load a box onto a cart inside a store. | Two men load a box onto a cart inside a store, security camera view. | make the view from a security camera | DAVIS_480p/480p_videos/loading.mp4 |
41 | object | Two men load a box onto a cart inside a store. | Two men load a giant GPU onto a cart inside a store. | replace box with giant Nvidia GPU. | DAVIS_480p/480p_videos/loading.mp4 |
42 | background | Two men load a box onto a cart inside a store. | Two men load a box onto a cart on a snow covered road. | Change the background to a snow covered road. | DAVIS_480p/480p_videos/loading.mp4 |
43 | multiple | Two men load a box onto a cart inside a store. | Two women load a giant GPU onto a cart on a snow-covered road. | change men to women, change box to giant Nvidia GPU, change the background to a snow-covered road. | DAVIS_480p/480p_videos/loading.mp4 |
44 | style | A person on a motorcycle does a burnout on the road. | A person on a motorcycle does a burnout on the road, neon color style. | make the style neon color. | DAVIS_480p/480p_videos/mbike-trick.mp4 |
45 | object | A person on a motorcycle does a burnout on the road. | A person on a bicycle does a wheelie on the road. | make the man doing wheelie on a bicycle. | DAVIS_480p/480p_videos/mbike-trick.mp4 |
46 | background | A person on a motorcycle does a burnout on the road. | A person on a motorcycle does a burnout on a frozen lake. | change road to frozen lake. | DAVIS_480p/480p_videos/mbike-trick.mp4 |
47 | multiple | A person on a motorcycle does a burnout on the road. | A person on a scooter does a burnout on a frozen lake, sepia tone. | change motorcycle to scooter, change road to frozen lake, add sepia tone. | DAVIS_480p/480p_videos/mbike-trick.mp4 |
48 | style | A man does a trick with a scooter at a skatepark. | A man does a trick with a scooter at a skatepark, vermeer painting style. | make the style Vermeer painting style. | DAVIS_480p/480p_videos/stunt.mp4 |
49 | object | A man does a trick with a scooter at a skatepark. | A man does a trick with a skateboard at a skatepark. | change scooter to skateboard. | DAVIS_480p/480p_videos/stunt.mp4 |
50 | background | A man does a trick with a scooter at a skatepark. | A man does a trick with a scooter in a wooded field. | Change the background to a wooded field. | DAVIS_480p/480p_videos/stunt.mp4 |
51 | multiple | A man does a trick with a scooter at a skatepark. | A woman does a trick with a scooter at a skatepark, vermeer painting style. | change man to woman, make the style Vermeer painting style. | DAVIS_480p/480p_videos/stunt.mp4 |
52 | style | A man dives into a pool with tall buildings in the background. | A man dives into a pool with tall buildings in the background, silhouette style. | make the style silhouette. | DAVIS_480p/480p_videos/swimmer.mp4 |
53 | object | A man dives into a pool with tall buildings in the background. | A furry rabbit dives into a pool with tall buildings in the background. | change man to furry rabbit | DAVIS_480p/480p_videos/swimmer.mp4 |
54 | background | A man dives into a pool with tall buildings in the background. | A man dives into a lake in a natural setting. | change pool to lake, make the background natural setting. | DAVIS_480p/480p_videos/swimmer.mp4 |
55 | multiple | A man dives into a pool with tall buildings in the background. | A furry rabbit jumps into a pool with tall buildings in the background, vibrant colors. | change man to furry rabbit, use vibrant colors style | DAVIS_480p/480p_videos/swimmer.mp4 |
56 | style | Trucks drive on a racetrack. | Trucks drive on a racetrack, autumn, fall colors. | Add autumn/fall colors to the racetrack. | DAVIS_480p/480p_videos/trucks-race.mp4 |
57 | object | Trucks drive on a racetrack. | Wooden trucks drive on a racetrack. | make trucks made of wood (wooden style truck) | DAVIS_480p/480p_videos/trucks-race.mp4 |
58 | background | Trucks drive on a racetrack. | Trucks drive on a wooden kitchen table. | change the background to a wooden kitchen table. | DAVIS_480p/480p_videos/trucks-race.mp4 |
59 | multiple | Trucks drive on a racetrack. | Monster trucks race on a dirt track, autumn, fall colors. | change trucks to monster trucks, make road a dirt track, use autumn/fall colors style | DAVIS_480p/480p_videos/trucks-race.mp4 |
60 | style | A varanus lizard walks on a log. | A varanus lizard walks on a log, oil painting. | make the style oil painting. | DAVIS_480p/480p_videos/varanus-cage.mp4 |
61 | object | A varanus lizard walks on a log. | A rainbow colored squirrel walks on a log. | change lizard to a rainbow colored squirrel. | DAVIS_480p/480p_videos/varanus-cage.mp4 |
62 | background | A varanus lizard walks on a log. | A varanus lizard walks on an Arizona rock. | Replace log in the background with Arizona rock. | DAVIS_480p/480p_videos/varanus-cage.mp4 |
63 | multiple | A varanus lizard walks on a log. | A rainbow colored squirrel walks on an Arizona rock, oil painting. | change lizard to a rainbow colored squirrel, change log in the background to Arizona rock, make the style oil painting. | DAVIS_480p/480p_videos/varanus-cage.mp4 |
64 | style | Two basketball players coordinate with each other and score. | Two basketball players coordinate with each other and score, vintage style. | make the style vintage. | youtube_480p/480p_videos/basketball-players-scoring.mp4 |
65 | object | Two basketball players coordinate with each other and score. | Two basketball players coordinate with each other shoot a teddy bear toy into the basket. | replace the ball to a teddy bear toy. | youtube_480p/480p_videos/basketball-players-scoring.mp4 |
66 | background | Two basketball players coordinate with each other and score. | Two basketball players coordinate in a street game. | change the background into a street basketball playground. | youtube_480p/480p_videos/basketball-players-scoring.mp4 |
67 | multiple | Two basketball players coordinate with each other and score. | Two basketball players coordinate in a beach game, black and white. | make people playing a beach game, add black and white effect. | youtube_480p/480p_videos/basketball-players-scoring.mp4 |
68 | style | Tap Nixon shooting a basketball while another man helps him. | Tap Nixon shooting a basketball while another man helps him, claymation style | make the style claymation. | youtube_480p/480p_videos/basketball-shot.mp4 |
69 | object | Tap Nixon shooting a basketball while another man helps him. | Tap Nixon shooting a rocket while another man helps him. | change basketball to rocket. | youtube_480p/480p_videos/basketball-shot.mp4 |
70 | background | Tap Nixon shooting a basketball while another man helps him. | Tap Nixon shooting a basketball on Mars. | Change the location to Mars. | youtube_480p/480p_videos/basketball-shot.mp4 |
71 | multiple | Tap Nixon shooting a basketball while another man helps him. | Tap Nixon shooting a basketball while a woman helps him, high-contrast style. | change man to a woman, make the style high-contrast. | youtube_480p/480p_videos/basketball-shot.mp4 |
72 | style | The squirrel is climbing down a tree in a wooded park. | The squirrel is climbing down a tree in a wooded park, Van Gogh style. | make the style Van Gogh. | youtube_480p/480p_videos/squirrel-climb.mp4 |
73 | object | The squirrel is climbing down a tree in a wooded park. | The cute yellow leopard is climbing down a tree in a wooded park. | change squirrel to cute yellow leopard. | youtube_480p/480p_videos/squirrel-climb.mp4 |
74 | background | The squirrel is climbing down a tree in a wooded park. | The squirrel is climbing down a tree in a forest of cherry blossoms. | change background to forest of cherry blossoms. | youtube_480p/480p_videos/squirrel-climb.mp4 |
75 | multiple | The squirrel is climbing down a tree in a wooded park. | The squirrel is climbing up a tree in a wooded park, soft-focus style. | The squirrel is climbing up a tree in a wooded park, soft-focus style. | youtube_480p/480p_videos/squirrel-climb.mp4 |
76 | style | Man airbrush painting a horse on a wall. | Man airbrush painting a horse on a wall, very realistic. | make the painting very realistic. | youtube_480p/480p_videos/airbrush-painting.mp4 |
77 | object | Man airbrush painting a horse on a wall. | Man airbrush painting a turtle on a wall. | Change horse to turtle. | youtube_480p/480p_videos/airbrush-painting.mp4 |
78 | background | Man airbrush painting a horse on a wall. | Man airbrush painting a horse on a car. | the man is painting a horse on a car. | youtube_480p/480p_videos/airbrush-painting.mp4 |
79 | multiple | Man airbrush painting a horse on a wall. | Man airbrush painting a turtle on a wall, very realistic. | change horse to turtle, make the turtle very realistic. | youtube_480p/480p_videos/airbrush-painting.mp4 |
80 | style | A cat and a dog playing on the street while a girl walks around them. | A cat and a dog playing on the street while a girl walks around them, soft focus style. | make the style soft focus. | youtube_480p/480p_videos/cat-dog-play.mp4 |
81 | object | A cat and a dog playing on the street while a girl walks around them. | A beaver and a skunk playing in the street while a girl walks around them. | change cat to beaver, change dog to skunk. | youtube_480p/480p_videos/cat-dog-play.mp4 |
82 | background | A cat and a dog playing on the street while a girl walks around them. | A cat and a dog playing on the grass while a girl walks around them. | change the background to grass | youtube_480p/480p_videos/cat-dog-play.mp4 |
83 | multiple | A cat and a dog playing on the street while a girl walks around them. | A cat and a dog playing on the beach while a girl walks around them, golden hour lighting. | change street to beach, add golden hour lighting style. | youtube_480p/480p_videos/cat-dog-play.mp4 |
84 | style | Woman street artist plays an musical instrument. | Woman street artist plays a musical instrument, iron man style. | Add iron man style. | youtube_480p/480p_videos/street-instrument.mp4 |
85 | object | Woman street artist plays an musical instrument. | Woman street artist sings a song. | make the woman singing a song. | youtube_480p/480p_videos/street-instrument.mp4 |
86 | background | Woman street artist plays an musical instrument. | Woman plays a musical instrument indoors. | make the background indoors. | youtube_480p/480p_videos/street-instrument.mp4 |
87 | multiple | Woman street artist plays an musical instrument. | Woman street artist plays a musical instrument indoors, iron man style. | Change the location to indoors, add iron man style. | youtube_480p/480p_videos/street-instrument.mp4 |
88 | style | A car driving on the dirt road. | A car driving on the dirt road, dust cloud effect. | add dust cloud effect. | youtube_480p/480p_videos/dirt-road-driving.mp4 |
89 | object | A car driving on the dirt road. | A monster truck driving on the dirt road. | change car to monster truck. | youtube_480p/480p_videos/dirt-road-driving.mp4 |
90 | background | A car driving on the dirt road. | A car driving on a birthday cake | Make the car is driving on a birthday cake. | youtube_480p/480p_videos/dirt-road-driving.mp4 |
91 | multiple | A car driving on the dirt road. | A spaceship driving on the dirt road during a rainy day, dramatic sky. | change car to spaceship, add rainy day and dramatic sky. | youtube_480p/480p_videos/dirt-road-driving.mp4 |
92 | style | Circus man shows a round transparent ball, walking before the audience. | Circus man shows a round transparent ball, walking before the audience, spotlight effect. | add spotlight effect. | youtube_480p/480p_videos/circus-ball-act.mp4 |
93 | object | Circus man shows a round transparent ball, walking before the audience. | Circus man juggles balls, walking before the audience. | make the person juggling balls. | youtube_480p/480p_videos/circus-ball-act.mp4 |
94 | background | Circus man shows a round transparent ball, walking before the audience. | Circus man performs with a transparent ball in a field of orange poppy flowers. | Change the background to a field of orange poppy flowers. | youtube_480p/480p_videos/circus-ball-act.mp4 |
95 | multiple | Circus man shows a round transparent ball, walking before the audience. | Circus panda bear shows a round transparent ball, walking before the audience, claymation style. | change man to a panda, use claymation style. | youtube_480p/480p_videos/circus-ball-act.mp4 |
96 | style | An Audi Q7 goes on a snow trail. | An Audi Q7 goes on a snow trail, anime style. | make it animation style. | youtube_480p/480p_videos/audi-snow-trail.mp4 |
97 | object | An Audi Q7 goes on a snow trail. | A BMW X5 goes on a snow trail | change the car to BMW X5. | youtube_480p/480p_videos/audi-snow-trail.mp4 |
98 | background | An Audi Q7 goes on a snow trail. | An Audi Q7 goes on a desert trail. | make the car drive in desert trail. | youtube_480p/480p_videos/audi-snow-trail.mp4 |
99 | multiple | An Audi Q7 goes on a snow trail. | An Audi Q7 goes on a snow trail, aerial view with snow-capped mountains in the background. | Add aerial view with snow-capped mountains in the background. | youtube_480p/480p_videos/audi-snow-trail.mp4 |
End of preview. Expand
in Dataset Viewer.
Dataset Card for the TGVE+ Test Set
Dataset Summary
We extend the widely used Text Guided Video Editing (TGVE) benchmark with additional editing tasks. The dataset now comprises seven editing tasks in total: four from the original TGVE and three new tasks, namely (i) object removal (Remove), (ii) object addition (Add), and (iii) texture alterations (Texture). The new tasks utilize the same 76 videos from the original TGVE benchmark.
Each row in the dataset consists of the instruction, input/output captions, and the relative path of the video in TGVE. For more details please see our paper and project page.
We'd like to thank InstructVid2Vid for creating instructions for the original TGVE tasks.
Licensing Information
Licensed with CC-BY-NC 4.0 License available here.
Citation Information
@inproceedings{Singer2024VideoEV,
title={Video Editing via Factorized Diffusion Distillation},
author={Uriel Singer and Amit Zohar and Yuval Kirstain and Shelly Sheynin and Adam Polyak and Devi Parikh and Yaniv Taigman},
year={2024},
url={https://api.semanticscholar.org/CorpusID:268385300}
}
- Downloads last month
- 24