https://github.com/huggingface/diffusers/blob/main/examples/community/instaflow_one_step.py.","text":"Combines the benefits of timestep distillation and faster ODE solver-based sampling. \n\nCustom diffusers pipeline: https://github.com/huggingface/diffusers/blob/main/examples/community/instaflow_one_step.py."},"id":"2309.06380","title":"InstaFlow: One Step is Enough for High-Quality Diffusion-Based\n Text-to-Image Generation","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2309.06380.png","upvotes":31,"publishedAt":"2023-09-12T16:42:09.000Z","isUpvotedByUser":false},{"_id":"659f48c8d8a112a4b99255ac","position":3,"type":"paper","note":{"html":"Introduces a new framework for distillation by learning to map any point in a probability flow ordinary differential equation (ODE )to its origin on the trajectory. CMs also allow for 1-4 step sampling. \n\nPlay with them: https://huggingface.co/docs/diffusers/api/pipelines/consistency_models.\n\nUnconditional consistency model training: https://github.com/huggingface/diffusers/tree/main/examples/research_projects/consistency_training.","text":"Introduces a new framework for distillation by learning to map any point in a probability flow ordinary differential equation (ODE )to its origin on the trajectory. CMs also allow for 1-4 step sampling. \n\nPlay with them: https://huggingface.co/docs/diffusers/api/pipelines/consistency_models.\n\nUnconditional consistency model training: https://github.com/huggingface/diffusers/tree/main/examples/research_projects/consistency_training."},"id":"2303.01469","title":"Consistency Models","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2303.01469.png","upvotes":5,"publishedAt":"2023-03-02T18:30:16.000Z","isUpvotedByUser":false}],"position":1,"theme":"pink","private":false,"shareUrl":"https://huggingface.co/collections/sayakpaul/optimizing-diffusion-models-659f481b2bb9a1311e6f845d","upvotes":12,"isUpvotedByUser":false}],"datasets":[{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/sample-datasets","lastModified":"2024-05-02T03:18:56.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":4,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":4,"gated":false,"id":"sayakpaul/pickapic_v2_webdataset","lastModified":"2024-04-04T09:45:58.000Z","datasetsServerInfo":{"viewer":"viewer-partial","numRows":8700,"tags":["croissant"],"libraries":["datasets","webdataset","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/generated-gemini-responses","lastModified":"2024-04-01T05:37:18.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":115,"tags":["croissant"],"libraries":["datasets","pandas","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":325,"gated":false,"id":"sayakpaul/no_robots_only_coding","lastModified":"2024-03-20T09:09:27.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":350,"tags":["croissant"],"libraries":["datasets","pandas","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/temp-dataset-autotrain-553","lastModified":"2024-03-19T11:29:18.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":18,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/diffusers-qa-chatbot-artifacts","lastModified":"2024-03-09T07:54:05.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":264729,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":1,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/mgie-results","lastModified":"2024-02-16T11:53:25.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":8,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":126,"gated":false,"id":"sayakpaul/coco-30-val-2014","lastModified":"2024-02-05T07:13:16.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":30000,"tags":["croissant"],"libraries":["datasets","dask","mlcroissant"]},"private":false,"repoType":"dataset","likes":2,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/drawbench-sdxl-refiner","lastModified":"2023-10-21T18:39:43.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":200,"tags":["croissant"],"libraries":["datasets","dask","mlcroissant"]},"private":false,"repoType":"dataset","likes":1,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/drawbench-kandinsky-v22","lastModified":"2023-10-21T17:59:14.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":200,"tags":["croissant"],"libraries":["datasets","pandas","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/drawbench-sdxl","lastModified":"2023-10-21T09:08:13.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":200,"tags":["croissant"],"libraries":["datasets","dask","mlcroissant"]},"private":false,"repoType":"dataset","likes":3,"isLikedByUser":false},{"author":"sayakpaul","downloads":7,"gated":false,"id":"sayakpaul/drawbench-upsampled-zephyr-7b-alpha","lastModified":"2023-10-21T07:37:24.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":200,"tags":["croissant"],"libraries":["datasets","pandas","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":22,"gated":false,"id":"sayakpaul/drawbench","lastModified":"2023-10-21T05:25:29.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":200,"tags":["croissant"],"libraries":["datasets","pandas","mlcroissant"]},"private":false,"repoType":"dataset","likes":3,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/hf-codegen-v2","lastModified":"2023-08-03T10:28:58.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":370000,"tags":["croissant"],"libraries":["datasets","dask","mlcroissant"]},"private":false,"repoType":"dataset","likes":16,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/pipe-instructpix2pix","lastModified":"2023-08-02T13:50:34.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":10,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/hf-codegen","lastModified":"2023-07-19T16:09:58.000Z","private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/3725_test","lastModified":"2023-07-19T10:39:05.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":8,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/keras-xla-benchmarks","lastModified":"2023-07-09T06:07:27.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":9,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/xl-base-0.9-parti-prompts-two","lastModified":"2023-06-29T15:25:27.000Z","datasetsServerInfo":{"viewer":"viewer-partial","numRows":902,"tags":["croissant"],"libraries":["datasets","dask","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/xl-base-0.9-refiner-parti-prompts","lastModified":"2023-06-29T04:15:23.000Z","datasetsServerInfo":{"viewer":"viewer-partial","numRows":1001,"tags":["croissant"],"libraries":["datasets","dask","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":5,"gated":false,"id":"sayakpaul/poses-controlnet-dataset","lastModified":"2023-04-05T01:47:49.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":496,"tags":["croissant"],"libraries":["datasets","pandas","mlcroissant"]},"private":false,"repoType":"dataset","likes":3,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/dummy-controlnet-100000-samples","lastModified":"2023-03-29T10:24:14.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":100000,"tags":["croissant"],"libraries":["datasets","dask","mlcroissant"]},"private":false,"repoType":"dataset","likes":1,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/genre-classification-imdb","lastModified":"2023-03-12T11:05:04.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":162614,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":4,"isLikedByUser":false},{"author":"sayakpaul","downloads":43,"gated":false,"id":"sayakpaul/instructpix2pix-demo","lastModified":"2023-02-22T04:38:14.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":5,"tags":["croissant"],"libraries":["datasets","pandas","mlcroissant"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":122,"gated":false,"id":"sayakpaul/pokemon-blip-original-version","lastModified":"2022-12-24T06:09:24.000Z","private":false,"repoType":"dataset","likes":2,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/ReDWeb","lastModified":"2022-12-21T03:26:51.000Z","private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":6,"gated":false,"id":"sayakpaul/ucf101-subset","lastModified":"2022-12-19T09:51:35.000Z","private":false,"repoType":"dataset","likes":2,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/bool-masked-pos","lastModified":"2022-12-14T07:39:48.000Z","private":false,"repoType":"dataset","likes":0,"isLikedByUser":false},{"author":"sayakpaul","downloads":3179,"gated":false,"id":"sayakpaul/nyu_depth_v2","lastModified":"2022-12-12T13:35:31.000Z","datasetsServerInfo":{"viewer":"viewer-partial","numRows":3754,"tags":["croissant"],"libraries":["datasets","mlcroissant"]},"private":false,"repoType":"dataset","likes":22,"isLikedByUser":false},{"author":"sayakpaul","downloads":0,"gated":false,"id":"sayakpaul/diode-subset-train","lastModified":"2022-11-15T06:32:49.000Z","private":false,"repoType":"dataset","likes":0,"isLikedByUser":false}],"hasMoreActivities":false,"models":[{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":7,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.01-beta_inner-500-lr-1e-6","lastModified":"2024-05-05T05:37:26.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":2,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.01-beta_inner-100-lr-1e-6","lastModified":"2024-05-05T05:35:39.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.005-beta_inner-500-lr-1e-6","lastModified":"2024-05-03T15:52:11.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":8,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.005-beta_inner-500-lr-5e-6","lastModified":"2024-05-03T02:45:08.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":12,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.005-beta_inner-500-lr-5e-7-steps-5000-no-warmup","lastModified":"2024-05-02T13:08:26.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":12,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.005-beta_inner-500-lr-5e-7-scaled-steps-5000-no-warmup","lastModified":"2024-05-02T12:52:47.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":10,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.005-beta_inner-500-lr-5e-7-no-decay-steps-5000","lastModified":"2024-05-02T12:50:39.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":14,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.005-beta_inner-500-lr-5e-7-scaled-steps-5000","lastModified":"2024-05-02T12:47:36.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.05-beta_inner-500-lr-5e-7","lastModified":"2024-05-01T12:24:06.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.05-beta_inner-500-lr-5e-7-no-decay","lastModified":"2024-05-01T11:24:24.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":387,"gated":false,"id":"sayakpaul/smol_unet2d","lastModified":"2024-05-01T09:19:02.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":205,"gated":false,"id":"sayakpaul/actual_bigger_transformer","lastModified":"2024-05-01T08:51:13.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.05-beta_inner-250-lr-5e-6-lnoise-0.2","lastModified":"2024-05-01T04:30:50.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.1-beta_inner-500-lr-5e-6","lastModified":"2024-05-01T02:33:21.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/sdxl-orpo-large-beta_orpo-0.05-beta_inner-250-lr-5e-6","lastModified":"2024-05-01T02:15:24.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":87,"gated":false,"id":"sayakpaul/diffusion-sdxl-orpo-wds","lastModified":"2024-03-26T02:07:54.000Z","likes":1,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":463,"gated":false,"id":"sayakpaul/diffusion-sdxl-orpo","lastModified":"2024-03-25T02:49:54.000Z","likes":13,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":190,"gated":false,"id":"sayakpaul/kohya-format-sdxl-lora","lastModified":"2024-03-22T09:03:45.000Z","likes":1,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":31,"gated":false,"id":"sayakpaul/gemma-2b-sft-qlora-no-robots","lastModified":"2024-03-20T09:36:09.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/OpenDiT","lastModified":"2024-02-29T12:56:23.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":173,"gated":false,"id":"sayakpaul/mgie","lastModified":"2024-02-19T01:55:29.000Z","likes":6,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/pixel_peft_model-new","lastModified":"2024-02-16T04:31:03.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/toy_peft_model-new","lastModified":"2024-02-16T04:30:41.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/tiny-sd-pipeline-for-single-file-testing","lastModified":"2024-02-13T14:02:37.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":82,"gated":false,"id":"sayakpaul/lcm-lora-sdxl-base-unet-1.0","lastModified":"2024-01-11T04:07:06.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":81,"gated":false,"id":"sayakpaul/sdxl-base-unet-1.0","lastModified":"2024-01-11T04:03:21.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/instruct-pix2pix-sdxl-emu","lastModified":"2023-12-11T03:06:18.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/candle_lora_peft","lastModified":"2023-12-03T11:56:00.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/berry_bowl_lora_peft","lastModified":"2023-12-03T11:40:51.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/cat2_lora_peft","lastModified":"2023-12-03T11:19:00.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/fancy_boot_lora_peft","lastModified":"2023-12-03T10:52:52.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/custom_pipeline_remote_code","lastModified":"2023-10-27T06:25:40.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/show-1-base-with-code","lastModified":"2023-10-23T11:05:11.000Z","likes":1,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/show-1-base","lastModified":"2023-10-23T10:48:01.000Z","likes":0,"pipeline_tag":"text-to-video","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/myscheduler","lastModified":"2023-10-17T08:56:47.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/sdxl-cartoonization","lastModified":"2023-09-09T04:08:06.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/textual-inversion-cat-kerascv_sd_diffusers_pipeline","lastModified":"2023-08-03T18:14:02.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":119,"gated":false,"id":"sayakpaul/civitai-light-shadow-lora","lastModified":"2023-05-25T05:43:40.000Z","likes":1,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":2,"gated":false,"id":"sayakpaul/masked-lm-tpu","lastModified":"2023-05-23T02:55:40.000Z","likes":0,"pipeline_tag":"fill-mask","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":50293,"gated":false,"id":"sayakpaul/sd-model-finetuned-lora-t4","lastModified":"2023-04-18T09:47:44.000Z","likes":31,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":256,"gated":false,"id":"sayakpaul/custom-diffusion-cat-wooden-pot","lastModified":"2023-04-18T07:16:44.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":178,"gated":false,"id":"sayakpaul/custom-diffusion-cat","lastModified":"2023-04-18T06:32:41.000Z","likes":2,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":5,"gated":false,"id":"sayakpaul/git-base-pokemon","lastModified":"2023-03-26T09:10:01.000Z","likes":1,"pipeline_tag":"image-to-text","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":68,"gated":false,"id":"sayakpaul/whitebox-cartoonizer","lastModified":"2023-03-17T04:17:07.000Z","likes":13,"pipeline_tag":"image-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":4,"gated":false,"id":"sayakpaul/instruct-pix2pix","lastModified":"2023-03-16T06:13:07.000Z","likes":3,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":6,"gated":false,"id":"sayakpaul/mit-b0-scene-parse-150-lora","lastModified":"2023-02-08T03:00:48.000Z","likes":2,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":2,"gated":false,"id":"sayakpaul/segformer-b0-scene-parse-150-lora","lastModified":"2023-02-07T08:23:11.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/segformer-b0-scene-parse-150","lastModified":"2023-02-07T05:53:00.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":419,"gated":false,"id":"sayakpaul/vit-base-patch16-224-in21k-finetuned-lora-food101","lastModified":"2023-02-07T05:27:14.000Z","likes":2,"pipeline_tag":"image-classification","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/textual-inversion-kerasio","lastModified":"2023-01-31T01:40:39.000Z","likes":1,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/text-unet-dogs-kerascv_sd_diffusers_pipeline","lastModified":"2023-01-29T03:39:49.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/unet-dogs-kerascv_sd_diffusers_pipeline","lastModified":"2023-01-28T04:12:30.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/test-kerascv_sd_diffusers_pipeline","lastModified":"2023-01-27T16:11:12.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/dreambooth-keras-dogs-unet","lastModified":"2023-01-26T17:42:47.000Z","likes":0,"pipeline_tag":"text-to-image","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/mit-b0-finetuned-pets","lastModified":"2023-01-24T08:55:19.000Z","likes":1,"pipeline_tag":"image-segmentation","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/kerascv_sd_tflite","lastModified":"2023-01-23T15:38:55.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":2,"gated":false,"id":"sayakpaul/swin-tiny-patch4-window7-224-finetuned-aiornot-test","lastModified":"2023-01-19T15:45:30.000Z","likes":0,"pipeline_tag":"image-classification","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":0,"gated":false,"id":"sayakpaul/kerascv_sd_pokemon_finetuned","lastModified":"2023-01-03T05:11:41.000Z","likes":2,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":5,"gated":false,"id":"sayakpaul/trt_resnet50_keras","lastModified":"2022-12-23T02:20:31.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":4,"gated":false,"id":"sayakpaul/swin-tiny-patch4-window7-224-finetuned-birdsnap","lastModified":"2022-12-21T05:12:55.000Z","likes":0,"pipeline_tag":"image-classification","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":61,"gated":false,"id":"sayakpaul/videomae-base-finetuned-ucf101-subset","lastModified":"2022-11-12T12:28:32.000Z","likes":0,"pipeline_tag":"video-classification","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":20,"gated":false,"id":"sayakpaul/videomae-base-finetuned-kinetics-finetuned-ucf101-subset","lastModified":"2022-11-08T06:26:47.000Z","likes":3,"pipeline_tag":"video-classification","private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":1,"gated":false,"id":"sayakpaul/mit-b0-finetuned-sidewalks","lastModified":"2022-11-03T09:22:56.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":4,"gated":false,"id":"sayakpaul/demo","lastModified":"2022-10-22T04:07:20.000Z","likes":0,"private":false,"repoType":"model","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"downloads":2,"gated":false,"id":"sayakpaul/mit-b0-finetuned-sidewalk-semantic","lastModified":"2022-07-14T03:29:57.000Z","likes":2,"pipeline_tag":"image-segmentation","private":false,"repoType":"model","isLikedByUser":false}],"numberLikes":106,"papers":[{"id":"2404.01197","title":"Getting it Right: Improving Spatial Consistency in Text-to-Image Models","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2404.01197.png","upvotes":29,"publishedAt":"2024-04-01T15:55:25.000Z","isUpvotedByUser":false},{"id":"2402.17412","title":"DiffuseKronA: A Parameter Efficient Fine-tuning Method for Personalized\n Diffusion Model","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2402.17412.png","upvotes":21,"publishedAt":"2024-02-27T11:05:34.000Z","isUpvotedByUser":false},{"id":"2401.05252","title":"PIXART-δ: Fast and Controllable Image Generation with Latent\n Consistency Models","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2401.05252.png","upvotes":43,"publishedAt":"2024-01-10T16:27:38.000Z","isUpvotedByUser":false},{"id":"2401.02677","title":"Progressive Knowledge Distillation Of Stable Diffusion XL Using Layer\n Level Loss","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2401.02677.png","upvotes":21,"publishedAt":"2024-01-05T07:21:46.000Z","isUpvotedByUser":false},{"id":"2107.08369","title":"Flood Segmentation on Sentinel-1 SAR Imagery with Semi-Supervised\n Learning","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2107.08369.png","upvotes":0,"publishedAt":"2021-07-18T05:42:10.000Z","isUpvotedByUser":false},{"id":"2105.08819","title":"Fast and Accurate Quantized Camera Scene Detection on Smartphones,\n Mobile AI 2021 Challenge: Report","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2105.08819.png","upvotes":1,"publishedAt":"2021-05-17T13:55:38.000Z","isUpvotedByUser":false},{"id":"2105.07581","title":"Vision Transformers are Robust Learners","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2105.07581.png","upvotes":1,"publishedAt":"2021-05-17T02:39:22.000Z","isUpvotedByUser":false},{"id":"2009.12007","title":"G-SimCLR : Self-Supervised Contrastive Learning with Guided Projection\n via Pseudo Labelling","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2009.12007.png","upvotes":0,"publishedAt":"2020-09-25T02:25:37.000Z","isUpvotedByUser":false},{"id":"1905.13294","title":"A Review of Deep Learning with Special Emphasis on Architectures,\n Applications and Recent Trends","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/1905.13294.png","upvotes":0,"publishedAt":"2019-05-30T20:38:50.000Z","isUpvotedByUser":false}],"posts":[{"slug":"759843110601726","content":[{"type":"text","value":"Custom pipelines and components in Diffusers 🎸","raw":"Custom pipelines and components in Diffusers 🎸"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"Wanted to use customized pipelines and other components (schedulers, unets, text encoders, etc.) in Diffusers?","raw":"Wanted to use customized pipelines and other components (schedulers, unets, text encoders, etc.) in Diffusers?"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"Found it inflexible? ","raw":"Found it inflexible? "},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"Since the first dawn on earth, we have supported loading custom pipelines via a ","raw":"Since the first dawn on earth, we have supported loading custom pipelines via a "},{"type":"inline_code","code":"custom_pipeline","raw":"`custom_pipeline`"},{"type":"text","value":" argument 🌄","raw":" argument 🌄"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"These pipelines are inference-only, i.e., the assumption is that we're leveraging an existing checkpoint (e.g., runwayml/stable-diffusion-v1-5) and ONLY modifying the pipeline implementation. ","raw":"These pipelines are inference-only, i.e., the assumption is that we're leveraging an existing checkpoint (e.g., runwayml/stable-diffusion-v1-5) and ONLY modifying the pipeline implementation. "},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"We have many cool pipelines, implemented that way. They all share the same benefits available to a ","raw":"We have many cool pipelines, implemented that way. They all share the same benefits available to a "},{"type":"inline_code","code":"DiffusionPipeline","raw":"`DiffusionPipeline`"},{"type":"text","value":", no compromise there 🤗","raw":", no compromise there 🤗"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"Check them here:","raw":"Check them here:"},{"type":"new_line","raw":"\n"},{"type":"link","href":"https://github.com/huggingface/diffusers/tree/main/examples/community","raw":"https://github.com/huggingface/diffusers/tree/main/examples/community"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"Then we might have a requirement of everything customized i.e., custom components along with a custom pipeline. Sure, that's all possible. ","raw":"Then we might have a requirement of everything customized i.e., custom components along with a custom pipeline. Sure, that's all possible. "},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"All you have to do is keep the implementations of those custom components on the Hub repository you're loading your pipeline checkpoint from.","raw":"All you have to do is keep the implementations of those custom components on the Hub repository you're loading your pipeline checkpoint from."},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"SDXL Japanese was implemented like this 🔥","raw":"SDXL Japanese was implemented like this 🔥"},{"type":"new_line","raw":"\n"},{"type":"resource","resource":{"type":"model","id":"stabilityai/japanese-stable-diffusion-xl"},"url":"https://huggingface.co/stabilityai/japanese-stable-diffusion-xl","raw":"https://huggingface.co/stabilityai/japanese-stable-diffusion-xl"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"Full guide is available here ⬇️","raw":"Full guide is available here ⬇️"},{"type":"new_line","raw":"\n"},{"type":"link","href":"https://huggingface.co/docs/diffusers/main/en/using-diffusers/custom_pipeline_overview","raw":"https://huggingface.co/docs/diffusers/main/en/using-diffusers/custom_pipeline_overview"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"And, of course, these share all the benefits that come with ","raw":"And, of course, these share all the benefits that come with "},{"type":"inline_code","code":"DiffusionPipeline","raw":"`DiffusionPipeline`"},{"type":"text","value":". ","raw":". "}],"rawContent":"Custom pipelines and components in Diffusers 🎸\n\nWanted to use customized pipelines and other components (schedulers, unets, text encoders, etc.) in Diffusers?\n\nFound it inflexible? \n\nSince the first dawn on earth, we have supported loading custom pipelines via a `custom_pipeline` argument 🌄\n\nThese pipelines are inference-only, i.e., the assumption is that we're leveraging an existing checkpoint (e.g., runwayml/stable-diffusion-v1-5) and ONLY modifying the pipeline implementation. \n\nWe have many cool pipelines, implemented that way. They all share the same benefits available to a `DiffusionPipeline`, no compromise there 🤗\n\nCheck them here:\nhttps://github.com/huggingface/diffusers/tree/main/examples/community\n\nThen we might have a requirement of everything customized i.e., custom components along with a custom pipeline. Sure, that's all possible. \n\nAll you have to do is keep the implementations of those custom components on the Hub repository you're loading your pipeline checkpoint from.\n\nSDXL Japanese was implemented like this 🔥\nhttps://huggingface.co/stabilityai/japanese-stable-diffusion-xl\n\nFull guide is available here ⬇️\nhttps://huggingface.co/docs/diffusers/main/en/using-diffusers/custom_pipeline_overview\n\nAnd, of course, these share all the benefits that come with `DiffusionPipeline`. ","author":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true,"isFollowing":false},"attachments":[],"mentions":[],"reactions":[{"reaction":"🔥","users":["radames"],"count":1}],"publishedAt":"2024-05-02T09:49:19.000Z","updatedAt":"2024-05-02T09:49:19.966Z","commentators":[],"url":"/posts/sayakpaul/759843110601726","totalUniqueImpressions":974,"numComments":0},{"slug":"155389581108273","content":[{"type":"text","value":"We're introducing experimental support for ","raw":"We're introducing experimental support for "},{"type":"inline_code","code":"device_map","raw":"`device_map`"},{"type":"text","value":" in Diffusers 🤗","raw":" in Diffusers 🤗"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"If you have multiple GPUs you want to use to distribute the pipeline models, you can do so. Additionally, this becomes more useful when you have multiple low-VRAM GPUs.","raw":"If you have multiple GPUs you want to use to distribute the pipeline models, you can do so. Additionally, this becomes more useful when you have multiple low-VRAM GPUs."},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"Documentation:","raw":"Documentation:"},{"type":"new_line","raw":"\n"},{"type":"link","href":"https://huggingface.co/docs/diffusers/main/en/training/distributed_inference#device-placement","raw":"https://huggingface.co/docs/diffusers/main/en/training/distributed_inference#device-placement"},{"type":"new_line","raw":"\n"},{"type":"new_line","raw":"\n"},{"type":"text","value":"🚨 Currently, only \"balanced\" device mapping strategy is supported. ","raw":"🚨 Currently, only \"balanced\" device mapping strategy is supported. "}],"rawContent":"We're introducing experimental support for `device_map` in Diffusers 🤗\n\nIf you have multiple GPUs you want to use to distribute the pipeline models, you can do so. Additionally, this becomes more useful when you have multiple low-VRAM GPUs.\n\nDocumentation:\nhttps://huggingface.co/docs/diffusers/main/en/training/distributed_inference#device-placement\n\n🚨 Currently, only \"balanced\" device mapping strategy is supported. ","author":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true,"isFollowing":false},"attachments":[{"type":"image","url":"https://cdn-uploads.huggingface.co/production/uploads/5f7fbd813e94f16a85448745/xfC4AkW9bWPeLskzsoue9.png"}],"mentions":[],"reactions":[{"reaction":"🔥","users":["ajibawa-2023","clem","osanseviero","Bruno","Paolo16","alvarobartt","ingTikna"],"count":7},{"reaction":"🤗","users":["alvarobartt"],"count":1}],"publishedAt":"2024-04-15T02:48:44.000Z","updatedAt":"2024-04-15T02:48:44.700Z","commentators":[],"url":"/posts/sayakpaul/155389581108273","totalUniqueImpressions":2563,"numComments":0}],"totalPosts":5,"spaces":[{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"indigo","colorTo":"indigo","createdAt":"2022-12-21T12:11:30.000Z","emoji":"📈","id":"sayakpaul/demo-docker-gradio","lastModified":"2024-03-20T01:29:01.000Z","likes":12,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-basic","requested":"cpu-basic"},"storage":null,"gcTimeout":86400,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"sayakpaul-demo-docker-gradio.hf.space","isCustom":false,"stage":"READY"}]},"title":"Demo Docker Gradio","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"purple","colorTo":"indigo","createdAt":"2024-03-08T13:07:53.000Z","emoji":"🧨","id":"sayakpaul/diffusers-docs-qa-chatbot","lastModified":"2024-03-09T10:16:22.000Z","likes":0,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"SLEEPING","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"sayakpaul-diffusers-docs-qa-chatbot.hf.space","isCustom":false,"stage":"READY"}]},"shortDescription":"Ask questions to the Diffusers documentation.","title":"Diffusers Docs QA Chatbot","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"red","colorTo":"red","createdAt":"2023-01-27T12:33:12.000Z","emoji":"🧨","id":"sayakpaul/convert-kerascv-sd-diffusers","lastModified":"2023-05-24T01:27:07.000Z","likes":7,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":86400,"errorMessage":"failed to create containerd task: failed to create shim task: context deadline exceeded: unknown","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Convert Kerascv SD to Diffusers","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"purple","colorTo":"green","createdAt":"2023-05-19T10:35:52.000Z","emoji":"🚀","id":"sayakpaul/inpainting-tool","lastModified":"2023-05-19T12:11:36.000Z","likes":0,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":86400,"errorMessage":"Scheduling failure: not enough hardware capacity","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Inpainting Tool","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"indigo","colorTo":"indigo","createdAt":"2023-01-01T08:11:43.000Z","emoji":"🐶","id":"sayakpaul/pokemon-sd-kerascv","lastModified":"2023-03-12T06:45:07.000Z","likes":13,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"BUILD_ERROR","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":900,"errorMessage":"Build failed with exit code: 1","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Generate Custom Pokemons with Stable Diffusion","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"gray","colorTo":"indigo","createdAt":"2023-02-06T10:55:00.000Z","emoji":"⏰","id":"sayakpaul/evaluate-sd-schedulers","lastModified":"2023-02-08T13:27:16.000Z","likes":8,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"SLEEPING","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":3600,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"sayakpaul-evaluate-sd-schedulers.hf.space","isCustom":false,"stage":"READY"}]},"title":"Evaluate StableDiffusionPipeline with Different Schedulers","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"blue","colorTo":"gray","createdAt":"2023-02-07T11:36:22.000Z","emoji":"📊","id":"sayakpaul/demo-custom-css","lastModified":"2023-02-07T13:35:16.000Z","likes":1,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":86400,"errorMessage":"Space failed. Exit code: ?. Reason: ","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Demo Custom Css","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"yellow","colorTo":"blue","createdAt":"2022-12-07T11:11:38.000Z","emoji":"⚡","id":"sayakpaul/fetch-similar-images","lastModified":"2023-01-05T12:41:41.000Z","likes":5,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":3600,"errorMessage":"Scheduling failure: not enough hardware capacity","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Fetch Similar Beans 🪴","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"pink","colorTo":"blue","createdAt":"2022-12-21T08:30:40.000Z","emoji":"🐬","id":"sayakpaul/tensorrt-tf","lastModified":"2022-12-22T13:52:33.000Z","likes":5,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"SLEEPING","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":3600,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"sayakpaul-tensorrt-tf.hf.space","isCustom":false,"stage":"READY"}]},"title":"TensorRT","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"purple","colorTo":"gray","createdAt":"2022-11-08T02:54:51.000Z","emoji":"📹","id":"sayakpaul/video-classification-ucf101-subset","lastModified":"2022-12-22T06:38:54.000Z","likes":13,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"cpu-upgrade"},"storage":null,"gcTimeout":null,"errorMessage":"Scheduling failure: not enough hardware capacity","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Video Classification UCF101 Subset","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"red","colorTo":"purple","createdAt":"2022-10-27T10:21:21.000Z","emoji":"👀","id":"sayakpaul/maxim-spaces","lastModified":"2022-11-10T07:40:38.000Z","likes":24,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":86400,"errorMessage":"Fetching Space from: https://huggingface.co/spaces/sayakpaul/raindrop-deraining-maxim\nTraceback (most recent call last):\n File \"/home/user/.local/lib/python3.10/site-packages/gradio/external.py\", line 340, in from_spaces\n config = json.loads(result.group(1))\nAttributeError: 'NoneType' object has no attribute 'group'\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/home/user/app/app.py\", line 5, in \n io1 = gr.Interface.load(\n File \"/home/user/.local/lib/python3.10/site-packages/gradio/interface.py\", line 108, in load\n return super().load(name=name, src=src, api_key=api_key, alias=alias)\n File \"/home/user/.local/lib/python3.10/site-packages/gradio/blocks.py\", line 1114, in load\n return external.load_blocks_from_repo(name, src, api_key, alias, **kwargs)\n File \"/home/user/.local/lib/python3.10/site-packages/gradio/external.py\", line 57, in load_blocks_from_repo\n blocks: gradio.Blocks = factory_methods[src](name, api_key, alias, **kwargs)\n File \"/home/user/.local/lib/python3.10/site-packages/gradio/external.py\", line 342, in from_spaces\n raise ValueError(\"Could not load the Space: {}\".format(space_name))\nValueError: Could not load the Space: sayakpaul/raindrop-deraining-maxim\n","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Maxim Spaces","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"red","colorTo":"red","createdAt":"2022-10-18T18:09:39.000Z","emoji":"💻","id":"sayakpaul/lol-enhancement-maxim","lastModified":"2022-11-01T00:53:30.000Z","likes":4,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"SLEEPING","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":3600,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"sayakpaul-lol-enhancement-maxim.hf.space","isCustom":false,"stage":"READY"}]},"title":"LOL Enhancement MAXIM","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"green","colorTo":"green","createdAt":"2022-10-20T05:51:46.000Z","emoji":"🥑","id":"sayakpaul/sots-outdoor-dehazing-maxim","lastModified":"2022-10-31T11:21:36.000Z","likes":2,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":36000,"errorMessage":"Launch timed out, space was not healthy after 30 min","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Sots Outdoor Dehazing MAXIM","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"gray","colorTo":"gray","createdAt":"2022-10-27T05:30:11.000Z","emoji":"💻","id":"sayakpaul/fivek-retouching-maxim","lastModified":"2022-10-31T11:21:12.000Z","likes":5,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":3600,"errorMessage":"Traceback (most recent call last):\n File \"app.py\", line 5, in \n import gradio as gr\n File \"/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/gradio/__init__.py\", line 3, in \n import gradio.components as components\n File \"/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/gradio/components.py\", line 39, in \n from gradio import media_data, processing_utils, utils\n File \"/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/gradio/processing_utils.py\", line 20, in \n from gradio import encryptor, utils\n File \"/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/gradio/utils.py\", line 395, in \n class Request:\n File \"/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/gradio/utils.py\", line 415, in Request\n client = httpx.AsyncClient()\n File \"/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py\", line 1397, in __init__\n self._transport = self._init_transport(\n File \"/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_client.py\", line 1445, in _init_transport\n return AsyncHTTPTransport(\n File \"/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/httpx/_transports/default.py\", line 275, in __init__\n self._pool = httpcore.AsyncConnectionPool(\nTypeError: __init__() got an unexpected keyword argument 'socket_options'\n","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"FiveK Retouching MAXIM","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"blue","colorTo":"blue","createdAt":"2022-10-27T05:18:31.000Z","emoji":"💻","id":"sayakpaul/raindrop-deraining-maxim","lastModified":"2022-10-31T11:20:06.000Z","likes":3,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"BUILD_ERROR","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":3600,"errorMessage":"Build failed with exit code: 1","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"RainDrop Deraining MAXIM","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"blue","colorTo":"blue","createdAt":"2022-10-20T05:43:43.000Z","emoji":"💻","id":"sayakpaul/sots-indoor-dehazing-maxim","lastModified":"2022-10-31T11:19:16.000Z","likes":3,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"BUILD_ERROR","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":36000,"errorMessage":"Build failed with exit code: 1","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Sots Indoor Dehazing MAXIM","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"green","colorTo":"green","createdAt":"2022-10-27T04:50:52.000Z","emoji":"💻","id":"sayakpaul/gopro-deblurring-maxim","lastModified":"2022-10-31T11:18:21.000Z","likes":16,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"PAUSED","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":1800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"GoPro Deblurring MAXIM","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"red","colorTo":"red","createdAt":"2022-10-19T05:05:07.000Z","emoji":"💻","id":"sayakpaul/sidd-denoising-maxim","lastModified":"2022-10-31T09:03:20.000Z","likes":3,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"PAUSED","hardware":{"current":null,"requested":"t4-small"},"storage":null,"gcTimeout":36000,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"SIDD Denoising MAXIM","isLikedByUser":false},{"author":"sayakpaul","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","fullname":"Sayak Paul","name":"sayakpaul","type":"user","isPro":false,"isHf":true},"colorFrom":"green","colorTo":"gray","createdAt":"2022-08-13T21:06:47.000Z","emoji":"🗻","id":"sayakpaul/cartoonizer-demo-onnx","lastModified":"2022-08-14T04:30:32.000Z","likes":64,"pinned":false,"private":false,"repoType":"space","runtime":{"stage":"RUNTIME_ERROR","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":86400,"errorMessage":"","replicas":{"current":1,"requested":1},"devMode":false,"domains":[]},"title":"Cartoonizer Demo ONNX","isLikedByUser":false}],"u":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649681653581-5f7fbd813e94f16a85448745.jpeg","isPro":false,"fullname":"Sayak Paul","user":"sayakpaul","orgs":[{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1583856921041-5dd96eb166059660ed1ee413.png","fullname":"Hugging Face","name":"huggingface","userRole":"write","type":"org","isHf":true},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1653062536500-5e9ecfc04957053f60648a3e.png","fullname":"Hugging Face Internal Testing Organization","name":"hf-internal-testing","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1639410947738-6141a88b3a0ec78603c9e784.png","fullname":"Keras","name":"keras-io","userRole":"write","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/7dca2b39e1373c453507da179f5bd107?d=retro&size=100","fullname":"Carted","name":"carted","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/ce7578bbeab5cc46cc9f6a3fdfa56453?d=retro&size=100","fullname":"Probing ViTs","name":"probing-vits","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1653293027683-5f0c746619cb630495b814fd.png","fullname":"Evaluation on the Hub","name":"autoevaluate","userRole":"read","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1654000604623-5dfcb1aada6d0311fd3d5448.png","fullname":"(De)fusing","name":"fusing","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1655315569655-6064e095abd8d3692e3e2ed6.png","fullname":"Huggingface Projects","name":"huggingface-projects","userRole":"write","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1664215365576-5e3aec01f55e2b62848a5217.png","fullname":"Hugging Face OSS Metrics","name":"open-source-metrics","userRole":"write","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/1d4cc1ea6b1b75decd2804bf34ad6fe8?d=retro&size=100","fullname":"Deploy HF TF ViTs","name":"deploy-hf-tf-vit","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1668178606778-602e6dee60e3dd96631c906e.jpeg","fullname":"🧨Diffusers","name":"diffusers","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1675366649660-6141a88b3a0ec78603c9e784.png","fullname":"Keras Dreambooth Event","name":"keras-dreambooth","userRole":"write","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/4e02f2e3d3d768398784de811b9b9e2d?d=retro&size=100","fullname":"Deprem Private","name":"deprem-private","userRole":"read","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1676518945578-5f7fbd813e94f16a85448745.png","fullname":"TensorFlow TPU","name":"tf-tpu","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/24fcdab3af50907ff0c3c7b6107b42f8?d=retro&size=100","fullname":"All Things ViTs","name":"all-things-vits","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/774c7a66a86daf1586ba46ed68ed814a?d=retro&size=100","fullname":"Instruction-tuned Diffusion Models","name":"instruction-tuning-sd","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1679409679081-6141a88b3a0ec78603c9e784.png","fullname":"JAX ♥️ Diffusers 🧨","name":"jax-diffusers-event","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/42278a53465644c630e9fadd1229c15b?d=retro&size=100","fullname":"ControlNet 1.1 Preview","name":"ControlNet-1-1-preview","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/3a104ecbea0403261a23f3b61650fc71?d=retro&size=100","fullname":"Amazon ML","name":"amazonml","userRole":"write","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/4ca5911c446c92704c750d9ce8e5ecf5?d=retro&size=100","fullname":"Parti Prompts Diffusers","name":"diffusers-parti-prompts","userRole":"write","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/551c3c91d98f5aff9d7ffff00f35ccb0?d=retro&size=100","fullname":"UniDiffuser Testing","name":"unidiffuser-testing","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5dfcb1aada6d0311fd3d5448/rETvCyoUD5Mr9wm6OxUhe.png","fullname":"Kandinsky Community","name":"kandinsky-community","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60d3b57ad7b174177faabd6e/dQ07CG-GnKmcUnQhJ0NyT.png","fullname":"Personal Coding Assistant","name":"coding-assistant-custom","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/5bd999e7a4a237937fa613cd0368778d?d=retro&size=100","fullname":"diffusers-adapter","name":"diffusers-adapter","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/ef4ee7a58d260d39a69a6564a29496a1?d=retro&size=100","fullname":"Diffusers Demo at ICCV 2023","name":"iccv23-diffusers-demo","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/eb364a1061260c65c502927d1dbeb4b0?d=retro&size=100","fullname":"xin-ic sayak-hf","name":"Xin-Sayak","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/650c74e5d439bbbbadfcfbbe/A4HUNyWJSblicluNFTptt.jpeg","fullname":"PixArt","name":"PixArt-alpha","userRole":"read","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/3s4vnB6_xPaPPWcZkF6jT.jpeg","fullname":"huggingPartyParis","name":"HuggingPartyParis","userRole":"read","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5dfcb1aada6d0311fd3d5448/uoglawGgkgjSg730Z-p5Y.png","fullname":"Latent Consistency","name":"latent-consistency","userRole":"write","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/551ee7800fb9e5304ca5f39594415fa9?d=retro&size=100","fullname":"Spatial-T2I","name":"ASU-HF","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5f17f0a0925b9863e28ad517/33rvDIrCmr6wpK3_W6RGz.png","fullname":"ZeroGPU Explorers","name":"zero-gpu-explorers","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5f5006390bcb0e71543cec17/MS-FNCjJ1CycH0feIYTzL.png","fullname":"PEFT","name":"PEFT","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5f17f0a0925b9863e28ad517/nxmdd6m86cxu55UZBlQeg.jpeg","fullname":"Social Post Explorers","name":"social-post-explorers","userRole":"read","type":"org","isHf":false},{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6320c537a023aad6a7680c8b/ccyONqDXP6eOBiPPRKEGJ.png","fullname":"SPRIGHT","name":"SPRIGHT-T2I","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/c67779198fe938898db6e363943a09d9?d=retro&size=100","fullname":"Diffusion ORPO","name":"diffusion-orpo","userRole":"admin","type":"org","isHf":false},{"avatarUrl":"https://www.gravatar.com/avatar/526387de98bd7d5b70e7b142c5bb63bf?d=retro&size=100","fullname":"diffusers-internal-dev","name":"diffusers-internal-dev","userRole":"write","type":"org","isHf":false}],"signup":{"github":"sayakpaul","homepage":"https://sayak.dev","twitter":"RisingSayak","details":"Diffusion models, representation learning"},"isHf":true,"type":"user"},"upvotes":11,"repoFilterModels":{"sortKey":"modified"},"repoFilterDatasets":{"sortKey":"modified"},"repoFilterSpaces":{"sortKey":"modified"},"numFollowers":265,"numFollowing":0,"isFollowing":false,"isFollower":false,"sampleFollowers":[{"user":"joyalkenvor","fullname":"joyal kenus","type":"user","isPro":false,"avatarUrl":"/avatars/c42dfba7772ff786a77567c5765728f5.svg"},{"user":"jaroos","fullname":"jar oos ","type":"user","isPro":false,"avatarUrl":"/avatars/1e36ed179663fa94249ae9dd48d5b85b.svg"},{"user":"mineshj1291","fullname":"Minesh Jethva","type":"user","isPro":false,"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1591565751512-noauth.jpeg"},{"user":"mehdi-elion","fullname":"Mehdi Elion","type":"user","isPro":false,"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6251a4c55437c1e36745da8c/jWID8repK_EcDQc-o2c2G.png"}],"isWatching":false}">

Sayak Paul

sayakpaul

AI & ML interests

Diffusion models, representation learning

Articles

Organizations

Posts 5

view post
Post
974
Custom pipelines and components in Diffusers 🎸

Wanted to use customized pipelines and other components (schedulers, unets, text encoders, etc.) in Diffusers?

Found it inflexible?

Since the first dawn on earth, we have supported loading custom pipelines via a custom_pipeline argument 🌄

These pipelines are inference-only, i.e., the assumption is that we're leveraging an existing checkpoint (e.g., runwayml/stable-diffusion-v1-5) and ONLY modifying the pipeline implementation.

We have many cool pipelines, implemented that way. They all share the same benefits available to a DiffusionPipeline, no compromise there 🤗

Check them here:
https://github.com/huggingface/diffusers/tree/main/examples/community

Then we might have a requirement of everything customized i.e., custom components along with a custom pipeline. Sure, that's all possible.

All you have to do is keep the implementations of those custom components on the Hub repository you're loading your pipeline checkpoint from.

SDXL Japanese was implemented like this 🔥
stabilityai/japanese-stable-diffusion-xl

Full guide is available here ⬇️
https://huggingface.co/docs/diffusers/main/en/using-diffusers/custom_pipeline_overview

And, of course, these share all the benefits that come with DiffusionPipeline.