{"version":"4.36.1","mode":"blocks","app_id":12301966512096231891,"dev_mode":false,"analytics_enabled":true,"components":[{"id":1,"type":"markdown","props":{"value":"# VBench Leaderboard\n\n*\"Which Video Generation Model is better?\"*  \n🏆 Welcome to the leaderboard of the **VBench**! 🎦 *A Comprehensive Benchmark Suite for Video Generative Models* (**CVPR 2024 Spotlight**)   [![Code](https://img.shields.io/github/stars/Vchitect/VBench.svg?style=social&label=Official)](https://github.com/Vchitect/VBench) \n<div style=\"display: flex; flex-wrap: wrap; align-items: center; gap: 10px;\">\n<a href='https://arxiv.org/abs/2311.17982'><img src='https://img.shields.io/badge/cs.CV-Paper-b31b1b?logo=arxiv&logoColor=red'></a>\n<a href='https://vchitect.github.io/VBench-project/'><img src='https://img.shields.io/badge/VBench-Website-green?logo=googlechrome&logoColor=green'></a>\n<a href='https://pypi.org/project/vbench/'><img src='https://img.shields.io/pypi/v/vbench'></a>\n<a href='https://www.youtube.com/watch?v=7IhCC8Qqn8Y'><img src='https://img.shields.io/badge/YouTube-Video-c4302b?logo=youtube&logoColor=red'></a>\n<a href='https://hits.seeyoufarm.com'><img src='https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2FVchitect%2FVBench&count_bg=%23FFA500&title_bg=%23555555&icon=&icon_color=%23E7E7E7&title=visitors&edge_flat=false'></a>\n</div>\n\n- **Comprehensive Dimensions:** We carefully decompose video generation quality into 16 comprehensive dimensions to reveal individual model's strengths and weaknesses.\n- **Human Alignment:** We conducted extensive experiments and human annotations to validate robustness of VBench.\n- **Valuable Insights:** VBench provides multi-perspective insights useful for the community.  \n\n**Join Leaderboard**: Please see the [instructions](https://github.com/Vchitect/VBench/tree/master?tab=readme-ov-file#trophy-leaderboard) for 3 options to participate. One option is to follow [VBench Usage info](https://github.com/Vchitect/VBench?tab=readme-ov-file#usage), and upload the generated `result.json` file here. After clicking the `Submit here!` button, click the `Refresh` button.\n**Get VBench Certified: Gold & Silver & Bronze Tiers**： \nWe encourage developers of closed-source models to provide API access to us for evaluation via VBench.\nModels are certified under VBench based on the transparency and rigor of the evaluation process:\n🥇 Gold – Sampled and evaluated by the VBench team\n🥈 Silver – Sampled by a partner team, evaluated by the VBench team\n🥉 Bronze – Sampled by the model’s own team, evaluated by the VBench team\nThis certification helps ensure fair, consistent, and reproducible comparisons across models — making it easier for the community to track progress and identify strengths and weaknesses.\n\n**Ready to participate?**: Contact the VBench Team at ZIQI002@e.ntu.edu.sg to submit your work and earn your certification.\n\n**Model Information**: What are the details of these Video Generation Models? See [HERE](https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)\n\n**Credits**: This leaderboard is updated and maintained by the team of [VBench Contributors](https://github.com/Vchitect/VBench?tab=readme-ov-file#muscle-vbench-contributors).","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":2,"type":"tabs","props":{"visible":true,"elem_classes":["tab-buttons"],"name":"tabs"},"skip_api":true,"component_class_id":"f3d59c8c8bb50b167719d17fca7ef9ae","key":null},{"id":3,"type":"tabitem","props":{"label":"📊 VBench 1.0","visible":true,"interactive":true,"id":1,"elem_id":"vbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":4,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":5,"type":"accordion","props":{"label":"Citation","open":false,"visible":true,"name":"accordion"},"skip_api":true,"component_class_id":"0df114fd8de6af8172659b1981001379","key":null},{"id":6,"type":"textbox","props":{"value":"@inproceedings{huang2023vbench,\n     title={{VBench}: Comprehensive Benchmark Suite for Video Generative Models},\n     author={Huang, Ziqi and He, Yinan and Yu, Jiashuo and Zhang, Fan and Si, Chenyang and Jiang, Yuming and Zhang, Yuanhan and Wu, Tianxing and Jin, Qingyang and Chanpaisit, Nattapol and Wang, Yaohui and Chen, Xinyuan and Wang, Limin and Lin, Dahua and Qiao, Yu and Liu, Ziwei},\n     booktitle={Proceedings of the IEEE/CVF conference on computer vision and pattern recognition},\n     year={2024}\n}","lines":14,"max_lines":20,"label":"Copy the following snippet to cite these results","show_label":true,"container":true,"min_width":160,"visible":true,"elem_id":"citation-button","autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":7,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":8,"type":"markdown","props":{"value":"    ","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":9,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":10,"type":"column","props":{"scale":0.2,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":11,"type":"button","props":{"value":"Select Quality Dimensions","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":12,"type":"button","props":{"value":"Select Semantic Dimensions","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":13,"type":"button","props":{"value":"Deselect All","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":14,"type":"column","props":{"scale":0.8,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":15,"type":"checkbox","props":{"value":false,"label":"Sampled by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":16,"type":"checkbox","props":{"value":true,"label":"Evaluated by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":17,"type":"checkbox","props":{"value":false,"label":"Only show 🥇 Gold","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":18,"type":"checkboxgroup","props":{"choices":[["subject consistency","subject consistency"],["background consistency","background consistency"],["temporal flickering","temporal flickering"],["motion smoothness","motion smoothness"],["dynamic degree","dynamic degree"],["aesthetic quality","aesthetic quality"],["imaging quality","imaging quality"],["object class","object class"],["multiple objects","multiple objects"],["human action","human action"],["color","color"],["spatial relationship","spatial relationship"],["scene","scene"],["appearance style","appearance style"],["temporal style","temporal style"],["overall consistency","overall consistency"]],"value":["subject consistency","background consistency","temporal flickering","motion smoothness","dynamic degree","aesthetic quality","imaging quality","object class","multiple objects","human action","color","spatial relationship","scene","appearance style","temporal style","overall consistency"],"type":"value","label":"Evaluation Dimension","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkboxgroup","_selectable":false},"skip_api":false,"component_class_id":"f3c90df7ca414d587f1946e7c68c8f37","key":null,"api_info":{"items":{"enum":["subject consistency","background consistency","temporal flickering","motion smoothness","dynamic degree","aesthetic quality","imaging quality","object class","multiple objects","human action","color","spatial relationship","scene","appearance style","temporal style","overall consistency"],"type":"string"},"title":"Checkbox Group","type":"array"},"example_inputs":["subject consistency"]},{"id":19,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":20,"type":"dataframe","props":{"value":{"headers":["Model Name (clickable)","Certification","Sampled by","Evaluated by","Accessibility","Date","Total Score","Quality Score","Semantic Score","Selected Score","subject consistency","background consistency","temporal flickering","motion smoothness","dynamic degree","aesthetic quality","imaging quality","object class","multiple objects","human action","color","spatial relationship","scene","appearance style","temporal style","overall consistency"],"data":[["[IPOW](https://github.com/SAIS-FUXI/IPO)","🥈 Silver ","[IPOW](https://drive.google.com/drive/u/0/folders/1A47N1-CahUwy3pu_KwULiNXsEfqIgOQP)","VBench Team","[Open Source](https://github.com/SAIS-FUXI/IPO)","2025-08-06","88.26%","87.83%","90.01%","88.26%","97.31%","97.67%","99.76%","97.94%","95.56%","67.42%","68.86%","97.43%","95.96%","97.00%","97.15%","97.80%","76.32%","23.60%","27.59%","26.77%"],["[Vidu Q1 (2025-04-17)](https://www.vidu.studio/)","🥈 Silver ","[ShengShu Team](https://drive.google.com/drive/folders/15MntPOIUZXER4cCTZK8Yq97202PAlz10?usp=sharing)","VBench Team"," [API](https://www.vidu.studio/zh)","2025-04-21","87.41%","87.28%","87.94%","87.41%","95.80%","97.11%","99.34%","98.47%","91.85%","67.32%","69.07%","97.40%","93.89%","99.60%","99.04%","93.74%","67.41%","22.37%","26.46%","27.24%"],["[IPOC (2025-04-14)](https://yangxlarge.github.io/ipoc/)","🥈 Silver ","[IPOC Team](https://drive.google.com/file/d/1YFSVvcEUfejmXZxHRuYh723R2Iv_NCU5/view?usp=sharing)","VBench Team"," [Open Source](https://yangxlarge.github.io/ipoc/)","2025-04-14","86.57%","87.00%","84.84%","86.57%","96.60%","97.57%","99.78%","97.60%","93.06%","65.22%","69.02%","92.41%","87.25%","98.00%","86.79%","95.46%","61.45%","24.01%","25.87%","26.85%"],["[JT3.5](https://jiutiancv.github.io/JV-CV-T2V/)","🥈 Silver ","[JiuTianCV](https://drive.google.com/drive/folders/1Qqb0OGgSxIRl1HSIT5i93NRcuhXNxGar)","VBench Team","[Close Source](https://jiutiancv.github.io/JV-CV-T2V/)","2025-07-30","86.47%","87.04%","84.19%","86.47%","95.11%","96.47%","97.83%","98.64%","99.72%","65.97%","70.09%","96.34%","81.51%","97.40%","92.79%","83.67%","59.45%","24.98%","26.14%","27.09%"],["[Wan2.1 (2025-02-24)](https://tongyi.aliyun.com/wanxiang/videoCreation)","🥈 Silver ","[Wan Team](https://drive.google.com/drive/folders/1c3RgpkQ5AMuYTZbCk7gkIVYvusjfrs_a)","VBench Team"," [API](https://bailian.console.aliyun.com/model-market/detail/wanx2.1-t2v-plus/model-market/detail/wanx2.1-t2v-plus)","2025-02-24","86.22%","86.67%","84.44%","86.22%","96.62%","97.58%","99.38%","97.42%","94.26%","63.45%","69.63%","96.64%","86.59%","99.20%","94.39%","85.70%","61.24%","21.59%","26.18%","27.49%"],["[IPOC](https://yangxlarge.github.io/ipoc/)","🥈 Silver ","[IPOC Team](https://drive.google.com/file/d/1yG4Rb6x6ij2E_0I-5eoZ0v-KSk0cgriQ/view?usp=drive_link)","VBench Team"," [Close Source](https://yangxlarge.github.io/ipoc/)","2025-02-28","85.71%","86.12%","84.09%","85.71%","96.68%","97.21%","99.11%","97.12%","92.59%","64.11%","68.43%","94.14%","85.73%","99.40%","88.64%","90.55%","54.01%","24.59%","25.79%","27.56%"],["[MiracleVision V5](https://www.miraclevision.com/)","🥈 Silver ","[MVV Team](https://drive.google.com/file/d/18gen90zZOaRBe7IuukqaJOj60Aedl8Vb/view?usp=drive_link)","VBench Team"," [API](https://www.miraclevision.com/)","2025-01-21","85.23%","86.68%","79.43%","85.23%","97.32%","96.35%","98.62%","99.02%","93.52%","65.28%","65.67%","93.04%","81.60%","98.00%","89.92%","76.22%","46.80%","21.72%","25.16%","26.94%"],["[Veo 3](https://cloud.google.com/vertex-ai/generative-ai/docs/models/veo/3-0-generate-001?hl=zh-cn)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/16EWQAHzQtozM9tezyBGQrzMsWZCS-LkM)","VBench Team","[API](https://cloud.google.com/vertex-ai/generative-ai/docs/video/generate-videos#text-video-gen)","2025-08-06","85.06%","85.70%","82.49%","85.06%","97.36%","96.89%","99.30%","99.16%","72.43%","63.81%","68.23%","93.89%","82.20%","99.40%","82.48%","84.26%","57.43%","23.55%","25.97%","27.88%"],["[LanDiff](https://landiff.github.io/)","🥈 Silver ","[LanDiff Team](https://drive.google.com/drive/folders/1acFlUVpmk7I_kHyJlUAkFnzhC7Z6sXsL)","VBench Team","[Open Source](https://github.com/LanDiff/LanDiff)","2025-08-06","84.87%","85.41%","82.72%","84.87%","91.86%","98.24%","99.42%","97.11%","93.33%","65.24%","65.78%","94.86%","87.13%","96.60%","91.22%","73.58%","54.84%","25.60%","25.28%","27.43%"],["[Wan2.1](https://tongyi.aliyun.com/wanxiang/videoCreation)","🥈 Silver ","[Wan Team](https://drive.google.com/drive/u/1/folders/1GHH7xOQCPb0kRjlyzH9APaddAw_hFRla)","VBench Team"," [API](https://tongyi.aliyun.com/wanxiang/)","2025-01-08","84.70%","85.64%","80.95%","84.70%","95.92%","97.39%","99.53%","96.92%","94.35%","61.53%","67.28%","94.24%","81.44%","98.80%","87.79%","81.08%","53.67%","21.13%","25.69%","27.44%"],["[Open-Sora-2.0 (2025-03-18)](https://github.com/hpcaitech/Open-Sora)","🥈 Silver ","[Open-Sora Team](https://drive.google.com/file/d/1iNBcAGakVLZge9BtIFgwccR0RD9w52it/view?usp=drive_link)","VBench Team"," [Open Source](https://hpcaitech.github.io/Open-Sora/)","2025-03-31","84.34%","85.40%","80.12%","84.34%","97.71%","98.00%","99.40%","98.69%","71.39%","64.39%","65.66%","94.50%","77.72%","95.40%","85.98%","76.18%","52.71%","22.98%","25.91%","27.50%"],["[Sora](https://openai.com/sora/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/1/folders/1ZxANm9HssrOY7aPAKRi579eJaQV6fsbk)","VBench Team"," [API](https://openai.com/sora/)","2025-01-14","84.28%","85.51%","79.35%","84.28%","96.23%","96.35%","98.87%","98.74%","79.91%","63.46%","68.28%","93.93%","70.85%","98.20%","80.11%","74.29%","56.95%","24.76%","25.01%","26.26%"],["[CausVid(2025-01-02 5s)](https://causvid.github.io/)","🥈 Silver ","[CausVid Team](https://drive.google.com/drive/u/1/folders/1SHD4CFuzBXLrsk1_fmQFBz7wvUvedY2O)","VBench Team","[Close Source](https://causvid.github.io/)","2025-01-02","84.27%","85.65%","78.75%","84.27%","97.53%","97.19%","96.24%","98.05%","92.69%","64.15%","68.88%","92.99%","72.15%","99.80%","80.17%","64.65%","56.58%","24.27%","25.33%","27.51%"],["[Wan2.1-T2V-1.3B](https://github.com/Wan-Video/Wan2.1/tree/main)","🥈 Silver ","[Wan Team](https://drive.google.com/drive/folders/1asyr8ytkumWh3qXWlPMm89Fq3tCdJxaA?usp=drive_link)","VBench Team"," [Open Source](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)","2025-03-13","84.26%","85.30%","80.09%","84.26%","96.34%","97.29%","99.49%","97.44%","85.56%","62.43%","66.51%","94.30%","79.74%","98.20%","89.58%","76.46%","52.73%","21.28%","25.32%","27.07%"],["[Wan2.2-T2V-A14B (Qwen prompt-optimized)](https://github.com/Wan-Video/Wan2.2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1ZOzQDrMWpdMXfG6CLSjJFGqUdkspXBwq)","VBench Team","[Open Source](https://github.com/Wan-Video/Wan2.2)","2026-02-18","84.23%","85.42%","79.50%","84.23%","97.29%","97.39%","99.22%","98.16%","61.02%","67.22%","71.75%","94.06%","82.10%","96.40%","87.43%","78.39%","56.80%","20.39%","23.64%","26.12%"],["[CausVid](https://causvid.github.io/)","🥈 Silver ","[CausVid Team](https://drive.google.com/drive/u/1/folders/1mmitg-4f6OWDZIdmSu2iNXrkcsVCT_5B)","VBench Team","[Close Source](https://causvid.github.io/)","2024-12-07","83.88%","85.21%","78.57%","83.88%","98.09%","97.41%","96.89%","97.81%","80.60%","64.70%","69.67%","92.80%","71.68%","99.80%","80.34%","64.77%","55.84%","24.18%","25.29%","27.53%"],["[Wan2.1-T2V-14B](https://github.com/Wan-Video/Wan2.1/tree/main)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/0/folders/1vbsu4MNGrWbJSiw5AKfvtWpJz6MOJ0-1)","VBench Team"," [Open Source](https://huggingface.co/Wan-AI/Wan2.1-T2V-14B)","2025-07-25","83.69%","85.59%","76.11%","83.69%","97.52%","98.09%","99.46%","98.30%","65.46%","66.07%","69.43%","86.28%","69.58%","95.40%","88.59%","75.39%","45.75%","22.64%","23.19%","25.91%"],["[Luma](https://lumalabs.ai/dream-machine)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1NuL9oRIMPuPk98PfI0lA34LL6XLtjMnr/view?usp=drive_link)","VBench Team"," [API](https://lumalabs.ai/dream-machine/api)","2025-01-14","83.61%","83.47%","84.17%","83.61%","97.33%","97.43%","98.64%","99.35%","44.26%","65.51%","66.55%","94.95%","82.63%","96.40%","92.33%","83.67%","58.98%","24.66%","26.29%","28.13%"],["[Hunyuan Video (2025-05-22)](https://github.com/Tencent/HunyuanVideo)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1TFBwX9BFt75DSpbrYARfo5w92wf1Vy8X)","VBench Team"," [API](https://github.com/Tencent/HunyuanVideo)","2025-05-22","83.43%","85.07%","76.88%","83.43%","97.22%","97.60%","99.39%","99.05%","71.94%","60.28%","67.24%","83.48%","66.71%","94.40%","89.79%","72.13%","54.46%","22.21%","24.52%","26.95%"],["[EasyAnimateV5.1](https://github.com/aigc-apps/EasyAnimate)","🥈 Silver ","[EasyAnimate Team](https://drive.google.com/file/d/1prDDDov2rRObcTvnq6jNvmSjfNm5jUe7/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/aigc-apps/EasyAnimate)","2025-01-22","83.42%","85.03%","77.01%","83.42%","98.00%","97.41%","99.19%","98.02%","57.15%","69.48%","68.61%","89.57%","66.85%","95.60%","77.86%","76.11%","54.31%","23.06%","24.61%","26.47%"],["[MiniMax-Video-01](https://platform.minimaxi.com/)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/16U3ANjXcRhFaC78zqF9pVL1B-H-PIV5c/view?usp=drive_link)","VBench Team"," [API](https://www.minimaxi.com/en/news/video-generation-api) ","2024-10-01","83.41%","84.85%","77.65%","83.41%","97.51%","97.05%","99.10%","99.22%","64.91%","63.03%","67.17%","87.83%","76.04%","92.40%","90.36%","75.50%","50.68%","20.06%","25.63%","27.10%"],["[Kling 1.6](https://klingai.kuaishou.com/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/0/folders/1DGnYY6yu_0DwtLevxYuNDcP69egQSWva)","VBench Team"," [API](https://klingai.kuaishou.com/)","2025-05-08","83.40%","85.00%","76.99%","83.40%","97.40%","96.84%","98.64%","99.13%","62.22%","64.81%","69.70%","93.34%","63.99%","96.20%","81.26%","79.08%","55.57%","20.75%","24.51%","26.04%"],["[STIV (Apple)](https://huggingface.co/papers/2412.07730)","🥈 Silver ","[Apple Team](https://drive.google.com/file/d/19ENw3mbyhz-JjW4ddWypJ8x6xvWOHsyr/view?usp=drive_link)","VBench Team"," [Close Source](https://huggingface.co/papers/2412.07730)","2024-12-19","83.35%","84.80%","77.57%","83.35%","95.94%","96.63%","99.24%","99.44%","68.33%","64.03%","65.43%","91.74%","64.62%","95.60%","89.33%","52.76%","55.03%","24.30%","26.71%","28.65%"],["[Wan2.1-T2V-1.3B (2025-05-03)](https://github.com/Wan-Video/Wan2.1/tree/main)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1jJmhAzgg_p0mhp5TNPgVT3hUUUaSX1Xo?usp=drive_link)","VBench Team"," [Open Source](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)","2025-05-03","83.31%","85.23%","75.65%","83.31%","97.56%","97.93%","99.55%","98.52%","65.19%","65.46%","67.01%","88.81%","74.83%","94.00%","89.20%","73.04%","41.96%","21.81%","23.13%","25.50%"],["[AccVideo](https://aejion.github.io/accvideo/)","🥈 Silver ","[AccVideo Team](https://drive.google.com/drive/folders/1GN6x-jKvZjW_UK87McJwZw8jexaRH23S?usp=drive_link)","VBench Team"," [Open Source](https://github.com/aejion/AccVideo)","2025-03-31","83.28%","84.58%","78.06%","83.28%","94.47%","97.43%","99.19%","98.79%","75.00%","62.08%","65.65%","92.99%","67.39%","95.60%","94.11%","75.73%","55.32%","19.88%","23.71%","27.21%"],["[HunyuanVideo (Open-Source Version)](https://github.com/Tencent/HunyuanVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1gjg9fO6_k5OIRAZtqIIxXd6-k4c1Tjb4/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/Tencent/HunyuanVideo)","2024-12-16","83.24%","85.09%","75.82%","83.24%","97.37%","97.76%","99.44%","98.99%","70.83%","60.36%","67.56%","86.10%","68.55%","94.40%","91.60%","68.68%","53.88%","19.80%","23.89%","26.44%"],["[Wan2.2-T2V-A14B (w/o prompt-optimized)](https://github.com/Wan-Video/Wan2.2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1Zb3YQr2YKXY2WqxcI_s0uSeup7Lw5klL)","VBench Team","[Open Source](https://github.com/Wan-Video/Wan2.2)","2026-02-18","82.61%","85.03%","72.92%","82.61%","97.46%","96.67%","98.92%","97.93%","68.24%","63.52%","71.69%","85.04%","74.61%","83.40%","88.93%","80.22%","34.38%","20.27%","23.13%","24.68%"],["[Gen-3 (2024-07)](https://runwayml.com/research/introducing-gen-3-alpha)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/0/folders/1AFV48EOAXydz2ZB-q2ml7b0ojYrAsl-K)","VBench Team"," [API](https://runwayml.com/research/introducing-gen-3-alpha)","2024-07-25","82.32%","84.11%","75.17%","82.32%","97.10%","96.62%","98.61%","99.23%","60.14%","63.34%","66.82%","87.81%","53.64%","96.40%","80.90%","65.09%","54.57%","24.31%","24.71%","26.69%"],["[Vchitect-2.0 (VEnhancer)](https://github.com/Vchitect/Vchitect-2.0)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1G7M_cz1VoigVQLCuSL9lPSX_Yv6N8Vb_?usp=drive_link)","VBench Team"," [Open Source](https://github.com/Vchitect/Vchitect-2.0)","2024-09-20","82.24%","83.54%","77.06%","82.24%","96.83%","96.66%","98.57%","98.98%","63.89%","60.41%","65.35%","86.61%","68.84%","97.20%","87.04%","57.55%","56.57%","23.73%","25.01%","27.57%"],["[CogVideoX1.5-5B (5s SAT prompt-optimized)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/13beSJsoQiJpjS5LiIqeZP3X7TXs2CJRe/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2024-11-15","82.17%","82.78%","79.76%","82.17%","96.87%","97.35%","98.88%","98.31%","50.93%","62.79%","65.02%","87.47%","69.65%","97.20%","87.55%","80.25%","52.91%","24.89%","25.19%","27.30%"],["[CogVideoX1.5-5B](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1v2UBa8XdUlpWwHwSDpNRVWad_pJfAtWR?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2025-04-21","82.01%","82.72%","79.17%","82.01%","96.56%","96.81%","98.53%","98.15%","56.16%","62.07%","65.34%","83.42%","67.28%","97.60%","88.40%","79.43%","53.28%","24.68%","25.42%","27.42%"],["[Jimeng](https://jimeng.jianying.com/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1lPJp8qspt5h6H6OTX37-BSl73DlLezOL?usp=drive_link)","VBench Team"," [API](https://jimeng.jianying.com/)","2024-11-15","81.97%","83.29%","76.69%","81.97%","97.25%","98.39%","99.03%","98.09%","38.43%","68.80%","67.09%","89.62%","69.08%","90.10%","89.05%","77.45%","44.94%","22.27%","24.70%","27.10%"],["[RepVideo](https://vchitect.github.io/RepVid-Webpage)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1H4eL4SOgidlOZeFPhX_4nzef7OGqpOQM/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/Vchitect/RepVideo)","2025-01-16","81.94%","82.70%","78.91%","81.94%","96.25%","96.56%","99.16%","98.13%","57.78%","62.40%","63.16%","87.83%","71.18%","98.00%","82.51%","74.74%","52.96%","25.12%","25.31%","26.96%"],["[CogVideoX-5B (Diffusers)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1FSAccPXyJR_uw5ldkQJAMzIVphLRuh39/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2025-03-04","81.91%","83.05%","77.33%","81.91%","96.45%","96.71%","98.97%","97.20%","69.51%","61.88%","63.33%","85.07%","63.94%","98.60%","83.03%","68.91%","51.96%","24.98%","25.42%","27.65%"],["[Vidu](https://www.vidu.studio/)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1s_kH08rHeHxTcNH07cyWCiv48_vhDxFc/view?usp=drive_link)","VBench Team"," [API](https://www.vidu.studio/zh)","2024-11-15","81.89%","83.85%","74.04%","81.89%","94.63%","96.55%","99.08%","97.71%","82.64%","60.87%","63.32%","88.43%","61.68%","97.40%","83.24%","66.18%","46.07%","21.54%","23.79%","26.47%"],["[Kling (2024-07 high-performance mode)](https://klingai.kuaishou.com/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/1/folders/1g5Y9j2gb9I5FUg4Ql28jSCCPH-Pv-HDg)","VBench Team"," [API](https://klingai.kuaishou.com/)","2024-08-01","81.85%","83.39%","75.68%","81.85%","98.33%","97.60%","99.30%","99.40%","46.94%","61.21%","65.62%","87.24%","68.05%","93.40%","89.90%","73.03%","50.86%","19.62%","24.17%","26.42%"],["[Step-Video-T2V](https://yuewen.cn/videos)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/124XdmyfZOjnrHy9DPMTwvdVANOgVJJBQ/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/stepfun-ai/Step-Video-T2V)","2025-03-13","81.83%","84.46%","71.28%","81.83%","98.05%","97.67%","99.40%","99.08%","53.06%","61.23%","70.63%","80.56%","50.55%","94.00%","88.25%","71.47%","24.38%","23.17%","26.01%","27.12%"],["[MAGI-T2V-24B-distill](https://github.com/SandAI-org/MAGI-1)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1B_mf_2xOozMrEoKjZgQwDFotUqlTuD_Z)","VBench Team","[Open Source](https://github.com/SandAI-org/MAGI-1)","2025-08-06","81.83%","84.69%","70.37%","81.83%","97.26%","97.67%","99.68%","98.84%","72.50%","59.33%","65.27%","84.10%","50.61%","88.20%","87.54%","72.95%","28.91%","21.69%","24.24%","26.31%"],["[Open-Sora-2.0](https://hpcaitech.github.io/Open-Sora/)","🥈 Silver ","[Open-Sora Team](https://drive.google.com/drive/folders/1TnABYBauOJicjpYkxW2ixr_t_klD0S67?usp=drive_link)","VBench Team"," [Open Source](https://hpcaitech.github.io/Open-Sora/)","2025-03-14","81.71%","82.10%","80.14%","81.71%","98.75%","98.00%","99.40%","99.49%","20.74%","64.33%","65.62%","94.50%","77.72%","95.40%","85.98%","76.18%","52.71%","22.98%","25.91%","27.57%"],["[CogVideoX-5B (SAT prompt-optimized)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/11KOdeSHxjRqplpy3sYNsQtJyYm416sTk/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2024-09-02","81.61%","82.75%","77.04%","81.61%","96.23%","96.52%","98.66%","96.92%","70.97%","61.98%","62.90%","85.23%","62.11%","99.40%","82.81%","66.35%","53.20%","24.91%","25.38%","27.59%"],["[Vchitect-2.0-2B](https://github.com/Vchitect/Vchitect-2.0)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1wy52woeJ3Tf3G54TyrjHtFP94oRVYFdF/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/Vchitect/Vchitect-2.0)","2024-09-16","81.57%","82.51%","77.79%","81.57%","96.42%","96.53%","98.45%","97.76%","58.33%","61.47%","65.60%","87.81%","69.35%","97.00%","86.87%","54.64%","57.51%","24.93%","25.56%","28.01%"],["[CogVideoX-2B (Diffusers)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1qFf0GAYFZ4aF5jAI_n4HsNP5tMN3l1y2/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2025-03-03","81.55%","82.48%","77.81%","81.55%","96.52%","96.39%","98.85%","97.51%","64.79%","61.07%","62.37%","86.48%","66.59%","97.80%","83.01%","74.27%","50.04%","24.94%","25.08%","27.33%"],["[CogVideoX-2B (SAT prompt-optimized)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1zuQ47Uvze4157o4YMta0Zqz9G8TdHcXZ/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2024-08-19","80.91%","82.18%","75.83%","80.91%","96.78%","96.63%","98.89%","97.73%","59.86%","60.82%","61.68%","83.37%","62.63%","98.00%","79.41%","69.90%","51.14%","24.80%","24.36%","26.66%"],["[Pika-1.0 (2024-06)](https://pika.art)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1FH157pt3KSy7O9HqSF6V9_CxMXijbAXK/view?usp=drive_link)","VBench Team"," [API](https://pika.art)","2024-07-29","80.69%","82.92%","71.77%","80.69%","96.94%","97.36%","99.74%","99.50%","47.50%","62.04%","61.87%","88.72%","43.08%","86.20%","90.57%","61.03%","49.83%","22.26%","24.22%","25.94%"],["[Gen-2 (2023-12)](https://runwayml.com/research/gen-2)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1tPL_PMmnBM4518UNiu52nhQCbUmF0A8q/view?usp=drive_link)","VBench Team"," [API](https://runwayml.com/research/gen-2)","2024-01-19","80.58%","82.47%","73.03%","80.58%","97.61%","97.61%","99.56%","99.58%","18.89%","66.96%","67.42%","90.92%","55.47%","89.20%","89.49%","66.91%","48.91%","19.34%","24.12%","26.17%"],["[VideoCrafter-2.0](https://github.com/AILab-CVC/VideoCrafter)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/17podJKS0tbfUS8dVAPNyDv4vYo4dIDqL/view?usp=sharing)","VBench Team"," [Open Source](https://github.com/AILab-CVC/VideoCrafter)","2024-04-19","80.44%","82.20%","73.42%","80.44%","96.85%","98.22%","98.41%","97.73%","42.50%","63.13%","67.22%","92.55%","40.66%","95.00%","92.92%","35.86%","55.29%","25.13%","25.84%","28.23%"],["[Pika Beta (2023-12)](https://pika.art)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1G2VVD5ArLxYtKeAVdANnxNNAPlP2bbZO/view?usp=drive_link)","VBench Team"," [API](https://pika.art)","2024-01-19","80.40%","82.68%","71.26%","80.40%","96.76%","98.95%","99.77%","99.51%","37.22%","63.15%","62.33%","87.45%","46.69%","88.00%","85.31%","65.65%","44.80%","21.89%","24.44%","25.47%"],["[AnimateDiff-V2](https://github.com/guoyww/AnimateDiff)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1a9dPyArEWt61NS3E2VDws8wMAXI-MX04/view?usp=sharing)","VBench Team"," [Open Source](https://github.com/guoyww/AnimateDiff)","2024-06-03","80.27%","82.90%","69.75%","80.27%","95.30%","97.68%","98.75%","97.76%","40.83%","67.16%","70.10%","90.90%","36.88%","92.60%","87.47%","34.60%","50.19%","22.42%","26.03%","27.04%"],["[Mochi-1](https://github.com/genmoai/models)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1H-iSGNs9l9FGIsc-8iFHqAguNol26-bz/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/genmoai/models)","2024-11-07","80.13%","82.64%","70.08%","80.13%","96.99%","97.28%","99.40%","99.02%","61.85%","56.94%","60.64%","86.51%","50.47%","94.60%","79.73%","69.24%","36.99%","20.33%","23.65%","25.15%"],["[LTX-Video (5s 768×512)](https://github.com/Lightricks/LTX-Video)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1eWFEars7HIL3Vkf0dFGolsWADE8tNA2n/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/Lightricks/LTX-Video)","2024-12-02","80.00%","82.30%","70.79%","80.00%","96.56%","97.20%","99.34%","98.96%","54.35%","59.81%","60.28%","83.45%","45.43%","92.80%","81.45%","65.43%","51.07%","21.47%","22.62%","25.19%"],["[OpenSora V1.2 (8s)](https://github.com/hpcaitech/Open-Sora)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1NMIKt3v01xsR6C32hTMt9ZRmRtSHo-uz/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/hpcaitech/Open-Sora)","2024-09-02","79.76%","81.35%","73.39%","79.76%","96.75%","97.61%","99.53%","98.50%","42.39%","56.85%","63.34%","82.22%","51.83%","91.20%","90.08%","68.56%","42.44%","23.95%","24.54%","26.85%"],["[VideoCrafter-1.0](https://github.com/AILab-CVC/VideoCrafter)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1FCRj48-Yv7LM7XGgfDCvIo7Kb9EId5KX/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/AILab-CVC/VideoCrafter)","2024-01-19","79.72%","81.59%","72.22%","79.72%","95.10%","98.04%","98.93%","95.67%","55.00%","62.67%","65.46%","78.18%","45.66%","91.60%","93.32%","58.86%","43.75%","24.41%","25.54%","26.76%"],["[AnimateLCM](https://github.com/G-U-N/AnimateLCM)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/101RjKgdAaLOHgk9kxleCCjdW8Wh3ccM0/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/G-U-N/AnimateLCM)","2024-06-28","79.42%","82.36%","67.65%","79.42%","95.76%","96.86%","98.52%","98.16%","40.56%","67.01%","66.74%","91.41%","29.76%","91.00%","84.24%","37.14%","50.36%","20.97%","25.16%","26.07%"],["[LTX-2 (Diffusers) (w/o prompt-optimized)](https://huggingface.co/docs/diffusers/main/en/api/pipelines/ltx2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/14UgMZ-e9_PYgEeOmlpGvYHFFnY7bFHi1)","VBench Team","[Open Source](https://github.com/Lightricks/LTX-2/tree/main)","2026-02-04","79.35%","84.10%","60.34%","79.35%","97.10%","97.52%","98.42%","98.60%","67.22%","60.55%","67.48%","58.02%","45.04%","76.20%","91.35%","58.80%","15.90%","20.79%","21.36%","22.90%"],["[Show-1](https://github.com/showlab/Show-1)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1QOInCcCI04LQ38BiY0o4oLehAFQfiVh2/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/showlab/Show-1)","2024-01-19","78.93%","80.42%","72.98%","78.93%","95.53%","98.02%","99.12%","98.24%","44.44%","57.35%","58.66%","93.07%","45.47%","95.60%","86.35%","53.50%","47.03%","23.06%","25.28%","27.46%"],["[OpenSoraPlan V1.1](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1zsg-HPiqYZJoryTXw6cG_9deBlIbZN87/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","2024-07-17","78.00%","80.91%","66.38%","78.00%","95.73%","96.73%","99.03%","98.28%","47.72%","56.85%","62.28%","76.30%","40.35%","86.80%","89.19%","53.11%","27.17%","22.90%","23.87%","26.52%"],["[MAGI-T2V-4.5B-distill](https://github.com/SandAI-org/MAGI-1)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/0/folders/1Bt6pDZ5V8IozbpNxPp3GQqItjZRGC2JC)","VBench Team","[Open Source](https://github.com/SandAI-org/MAGI-1)","2025-06-10","77.92%","80.98%","65.68%","77.92%","97.24%","98.21%","99.71%","99.48%","20.28%","62.42%","61.16%","82.37%","35.08%","84.20%","87.07%","57.76%","26.28%","22.62%","23.03%","25.56%"],["[AnimateDiff-V1](https://github.com/guoyww/AnimateDiff)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1S8ObJUtq0ETbR9sJ6nhnPCsQfr26JM9D/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/guoyww/AnimateDiff)","2024-08-02","77.46%","80.24%","66.32%","77.46%","96.74%","96.66%","97.92%","98.11%","15.00%","63.08%","70.58%","85.03%","38.31%","82.20%","83.91%","44.28%","41.40%","21.38%","24.53%","25.71%"],["[HiGen](https://github.com/ali-vilab/VGen?tab=readme-ov-file#3-run-the-higen-model)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1Y1rgLfXe5bC8IJwU5RErbOlCO4OyPqFU/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/ali-vilab/VGen?tab=readme-ov-file#3-run-the-higen-model)","2024-06-20","77.34%","80.35%","65.27%","77.34%","90.07%","93.99%","93.24%","96.69%","99.17%","57.30%","63.92%","86.06%","22.39%","86.20%","86.22%","22.43%","44.88%","24.54%","25.14%","27.14%"],["[Latte-1](https://github.com/Vchitect/Latte)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1plPbWcX2UGX0eA3S1BwFFtPtk0sv7JUf/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/Vchitect/Latte)","2024-06-05","77.29%","79.72%","67.58%","77.29%","88.88%","95.40%","98.89%","94.63%","68.89%","61.59%","61.92%","86.53%","34.53%","90.00%","85.31%","41.53%","36.26%","23.74%","24.76%","27.33%"],["[OpenSoraPlan V1.3](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1VHqTvac__eWeX4PBCxoYoaWwx5UGHkuy/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","2024-11-07","77.23%","80.14%","65.62%","77.23%","97.79%","97.24%","99.20%","99.05%","30.28%","60.42%","56.21%","85.56%","43.58%","86.80%","79.30%","51.61%","36.73%","20.03%","22.47%","24.47%"],["[LaVie-Interpolation](https://github.com/Vchitect/LaVie)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1Tbw6FBYp_VxeFGoChebFhBr7ewSc9uFv/view?usp=sharing)","VBench Team"," [Open Source](https://github.com/Vchitect/LaVie)","2024-02-17","77.11%","79.06%","69.28%","77.11%","92.00%","97.33%","98.77%","97.82%","46.11%","54.00%","59.78%","90.68%","30.93%","95.80%","85.69%","30.06%","52.62%","23.53%","26.01%","26.42%"],["[LaVie](https://github.com/Vchitect/LaVie)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1hviZzsInIgJA96ppVj4B2DHhTZWeM4nc/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/Vchitect/LaVie)","2023-11-23","77.08%","78.78%","70.31%","77.08%","91.41%","97.47%","98.30%","96.38%","49.72%","54.94%","61.90%","91.82%","33.32%","96.80%","86.39%","34.09%","52.69%","23.56%","25.93%","26.41%"],["[InstructVideo (ModelScope)](https://github.com/ali-vilab/VGen/blob/main/doc/InstructVideo.md)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1OiDttO6_xEqHweyjPmiq1JiibZfmIKSw/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/ali-vilab/VGen/blob/main/doc/InstructVideo.md)","2024-07-09","76.61%","81.56%","56.81%","76.61%","95.30%","96.97%","98.19%","96.62%","69.72%","52.55%","68.01%","73.26%","21.57%","85.20%","77.14%","43.49%","22.21%","20.16%","21.26%","19.91%"],["[OpenSoraPlan V1.2](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1HLiO-_OhKGElfxgIQwXhzlSa8XqVrGQr/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","2024-10-29","75.98%","81.51%","53.88%","75.98%","97.27%","96.24%","99.12%","99.17%","35.28%","59.10%","65.73%","61.53%","24.91%","58.20%","90.90%","49.64%","17.28%","20.04%","19.14%","20.39%"],["[Open-Sora](https://github.com/hpcaitech/Open-Sora)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1LCyTaVT_N_sM3HkSF1lPIPC0w80fqkEe/view?usp=sharing)","VBench Team"," [Open Source](https://github.com/hpcaitech/Open-Sora)","2024-04-20","75.91%","78.82%","64.28%","75.91%","92.09%","97.39%","98.41%","95.61%","48.61%","57.76%","61.51%","74.98%","33.64%","85.00%","78.15%","43.95%","37.33%","21.58%","25.46%","26.18%"],["[ModelScope](https://huggingface.co/damo-vilab/modelscope-damo-text-to-video-synthesis)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1UH2-lALFShjBywyImjDPPHTpE43eoMQE/view?usp=drive_link)","VBench Team"," [Open Source](https://huggingface.co/damo-vilab/modelscope-damo-text-to-video-synthesis)","2023-11-23","75.75%","78.05%","66.54%","75.75%","89.87%","95.29%","98.28%","95.79%","66.39%","52.06%","58.57%","82.25%","38.98%","92.40%","81.72%","33.68%","39.26%","23.39%","25.37%","25.67%"],["[OpenSora V1.1](https://github.com/hpcaitech/Open-Sora)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1mGxjDIf7IT_mNibG8Nmg3E1WcXYRVDoo/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/hpcaitech/Open-Sora)","2024-07-17","75.66%","77.74%","67.36%","75.66%","92.35%","97.52%","98.31%","92.78%","82.14%","50.12%","54.90%","86.76%","40.97%","84.20%","74.56%","52.47%","38.63%","23.50%","23.86%","26.37%"],["[TF-T2V](https://github.com/ali-vilab/VGen?tab=readme-ov-file#5-run-the-tf-t2v-cvpr-2024-model)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/125O9CIZrFcgFGwBHzXhEGn5RysSLNbcv/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/ali-vilab/VGen?tab=readme-ov-file#5-run-the-tf-t2v-cvpr-2024-model)","2024-06-20","75.38%","80.05%","56.69%","75.38%","95.63%","97.40%","98.79%","98.17%","36.94%","54.38%","64.78%","72.31%","18.09%","79.00%","74.00%","21.55%","35.87%","20.65%","23.68%","23.42%"],["[VideoCrafter-0.9](https://github.com/AILab-CVC/VideoCrafter/tree/30048d49873cbcd21077a001e6a3232e0909d254)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1VoNPAttMFOV_6FIYCGW4fzFE9m18Ry22/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/AILab-CVC/VideoCrafter/tree/30048d49873cbcd21077a001e6a3232e0909d254)","2023-11-23","73.02%","74.91%","65.46%","73.02%","86.24%","92.88%","97.60%","91.79%","89.72%","44.41%","57.22%","87.34%","25.93%","93.00%","78.84%","36.74%","43.36%","21.57%","25.42%","25.21%"],["[Mira](https://github.com/mira-space/Mira)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1lx0evF0HN0jY3FQ41RhQL9UJbOa-gve6/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/mira-space/Mira)","2024-07-17","71.87%","78.78%","44.21%","71.87%","96.23%","96.92%","98.29%","97.54%","60.33%","42.51%","60.16%","52.06%","12.52%","63.80%","42.24%","27.83%","16.34%","21.89%","18.77%","18.72%"],["[CogVideo](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1-oAHf6inm4CFeldKktWerXkjwQ_q26Ic/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2023-11-23","67.01%","72.06%","46.83%","67.01%","92.19%","96.20%","97.64%","96.47%","42.22%","38.18%","41.03%","73.40%","18.11%","78.20%","79.57%","18.24%","28.24%","22.01%","07.80%","07.70%"]],"metadata":null},"headers":["Model Name (clickable)","Certification","Sampled by","Evaluated by","Accessibility","Date","Total Score","Quality Score","Semantic Score","Selected Score","subject consistency","background consistency","temporal flickering","motion smoothness","dynamic degree","aesthetic quality","imaging quality","object class","multiple objects","human action","color","spatial relationship","scene","appearance style","temporal style","overall consistency"],"row_count":[1,"dynamic"],"col_count":[26,"dynamic"],"datatype":["markdown","markdown","markdown","markdown","markdown","markdown","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number"],"type":"pandas","latex_delimiters":[{"left":"$$","right":"$$","display":true}],"show_label":true,"height":500,"min_width":160,"interactive":false,"visible":true,"elem_classes":[],"wrap":false,"line_breaks":true,"column_widths":[],"name":"dataframe","_selectable":false},"skip_api":false,"component_class_id":"2f74a641e325b504d0304a93a36d57b1","key":null,"api_info":{"properties":{"headers":{"items":{"type":"string"},"title":"Headers","type":"array"},"data":{"items":{"items":{},"type":"array"},"title":"Data","type":"array"},"metadata":{"anyOf":[{"additionalProperties":{"anyOf":[{"items":{},"type":"array"},{"type":"null"}]},"type":"object"},{"type":"null"}],"default":null,"title":"Metadata"}},"required":["headers","data"],"title":"DataframeData","type":"object"},"example_inputs":{"headers":["a","b"],"data":[["foo","bar"]]}},{"id":21,"type":"tabitem","props":{"label":"⭐ VBench 2.0","visible":true,"interactive":true,"id":2,"elem_id":"vbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":22,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":23,"type":"accordion","props":{"label":"Citation","open":false,"visible":true,"name":"accordion"},"skip_api":true,"component_class_id":"0df114fd8de6af8172659b1981001379","key":null},{"id":24,"type":"textbox","props":{"value":"@article{zheng2025vbench2,\n        title={VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness},\n        author={Zheng, Dian and Huang, Ziqi and Liu, Hongbo and Zou, Kai and He, Yinan and Zhang, Fan and Zhang, Yuanhan and He, Jingwen and Zheng, Wei-Shi and Qiao, Yu and Liu, Ziwei},\n        journal={arXiv preprint arXiv:2503.21755},\n        year={2025}\n}","lines":14,"max_lines":20,"label":"Copy the following snippet to cite these results","show_label":true,"container":true,"min_width":160,"visible":true,"elem_id":"citation-button","autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":25,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":26,"type":"markdown","props":{"value":"    ","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":27,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":28,"type":"checkbox","props":{"value":false,"label":"Sampled by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":29,"type":"checkbox","props":{"value":true,"label":"Evaluated by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":30,"type":"checkbox","props":{"value":false,"label":"Only show 🥇 Gold","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":31,"type":"form","props":{"scale":3,"min_width":480,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":32,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":33,"type":"button","props":{"value":"Show Creativity Score","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":34,"type":"button","props":{"value":"Show Commonsense Score","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":35,"type":"button","props":{"value":"Show Controllability Score","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":36,"type":"button","props":{"value":"Show Human Fidelity Score","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":37,"type":"button","props":{"value":"Show Physics Score","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":38,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":39,"type":"checkboxgroup","props":{"choices":[["Human Anatomy","Human Anatomy"],["Human Clothes","Human Clothes"],["Human Identity","Human Identity"],["Composition","Composition"],["Diversity","Diversity"],["Mechanics","Mechanics"],["Material","Material"],["Thermotics","Thermotics"],["Multi-View Consistency","Multi-View Consistency"],["Dynamic Spatial Relationship","Dynamic Spatial Relationship"],["Dynamic Attribute","Dynamic Attribute"],["Motion Order Understanding","Motion Order Understanding"],["Human Interaction","Human Interaction"],["Complex Landscape","Complex Landscape"],["Complex Plot","Complex Plot"],["Camera Motion","Camera Motion"],["Motion Rationality","Motion Rationality"],["Instance Preservation","Instance Preservation"]],"value":["Human Anatomy","Human Clothes","Human Identity","Composition","Diversity","Mechanics","Material","Thermotics","Multi-View Consistency","Dynamic Spatial Relationship","Dynamic Attribute","Motion Order Understanding","Human Interaction","Complex Landscape","Complex Plot","Camera Motion","Motion Rationality","Instance Preservation"],"type":"value","label":"Evaluation Dimension","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkboxgroup","_selectable":false},"skip_api":false,"component_class_id":"f3c90df7ca414d587f1946e7c68c8f37","key":null,"api_info":{"items":{"enum":["Human Anatomy","Human Clothes","Human Identity","Composition","Diversity","Mechanics","Material","Thermotics","Multi-View Consistency","Dynamic Spatial Relationship","Dynamic Attribute","Motion Order Understanding","Human Interaction","Complex Landscape","Complex Plot","Camera Motion","Motion Rationality","Instance Preservation"],"type":"string"},"title":"Checkbox Group","type":"array"},"example_inputs":["Human Anatomy"]},{"id":40,"type":"form","props":{"scale":1,"min_width":160,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":41,"type":"dataframe","props":{"value":{"headers":["Model (alphabetical order)","Certification","Sampled by","Evaluated by","Accessibility","Date","Total Score","Creativity Score","Commonsense Score","Controllability Score","Human Fidelity Score","Physics Score","Human Anatomy","Human Clothes","Human Identity","Composition","Diversity","Mechanics","Material","Thermotics","Multi-View Consistency","Dynamic Spatial Relationship","Dynamic Attribute","Motion Order Understanding","Human Interaction","Complex Landscape","Complex Plot","Camera Motion","Motion Rationality","Instance Preservation"],"data":[["[Veo 3](https://cloud.google.com/vertex-ai/generative-ai/docs/models/veo/3-0-generate-001?hl=zh-cn)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1ULr1sIMNuDATK1SlMpq73wIQjdsDiYZ7)","VBench Team"," [API](https://cloud.google.com/vertex-ai/generative-ai/docs/video/overview#text-video-gen)","2025-09-04","66.72%","60.85%","69.48%","47.04%","86.88%","69.35%","90.26%","99.53%","70.84%","68.57%","53.13%","81.82%","84.11%","75.51%","35.95%","45.89%","63.74%","40.40%","80.67%","21.78%","21.87%","54.94%","45.98%","92.98%"],["[JT-CV](https://github.com/jiutiancv/)","","JiuTianCV","JiuTianCV",null,"2026-04-01","64.60%","51.80%","66.94%","45.47%","83.53%","75.23%","93.64%","92.44%","64.51%","58.75%","44.86%","76.69%","81.25%","66.21%","76.78%","44.05%","54.21%","35.35%","84.67%","19.11%","14.87%","66.05%","60.34%","73.53%"],["[ABot-World v0.1](https://github.com/amap-cvlab)","","Amap CV Lab","Amap CV Lab",null,"2026-03-21","64.47%","55.29%","72.93%","44.13%","85.36%","64.61%","91.77%","98.05%","66.27%","55.06%","55.52%","68.42%","85.34%","73.97%","30.72%","31.88%","61.90%","39.39%","80.67%","21.33%","12.01%","61.73%","52.87%","92.98%"],["[Vidu Q1 (2025-04-17)](https://www.vidu.studio/)","🥈 Silver ","[ShengShu Team](https://drive.google.com/drive/folders/1ZP6kgldD0akcqfu_IANdZIiNJGAFiGet)","VBench Team","[API](https://www.vidu.studio/zh)","2025-04-21","62.70%","56.54%","65.98%","38.13%","81.24%","71.63%","88.87%","81.54%","73.31%","60.94%","52.14%","81.75%","72.82%","64.03%","67.92%","15.46%","55.68%","34.01%","73.67%","17.56%","10.67%","59.88%","45.40%","86.55%"],["[ToMoviee 2.0](https://www.tomoviee.ai/)","🥈 Silver "," Wondershare Team","VBench Team","[API](https://www.tomoviee.ai/)"," 2025-09-18","61.78%","45.96%","67.41%","45.37%","80.68%","69.47%","76.78%","90.10%","75.16%","51.78%","40.13%","74.24%","82.46%","67.35%","53.84%","40.10%","61.17%","37.71%","75.33%","17.78%","15.46%","70.06%","48.85%","85.96%"],["[Wan2.1](https://github.com/Wan-Video/Wan2.1/tree/main)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1ZLK7Naq9jH0f9cbnpvo_s5IOpJzQn-w3)","VBench Team"," [Open Source](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)","2025-03-28","60.20%","55.25%","63.98%","37.32%","81.60%","62.84%","82.59%","96.48%","65.73%","54.51%","56.00%","71.74%","75.68%","67.16%","36.79%","31.40%","45.42%","35.35%","80.00%","16.44%","13.14%","39.51%","39.08%","88.89%"],["[Seedance 1.0 Pro (2025-05-28)](https://arxiv.org/abs/2506.09113)","","Joyme Team","Joyme Team","[API](https://www.volcengine.com/docs/82379/1520757)","2025-06-26","59.81%","53.04%","64.31%","39.84%","77.06%","64.81%","64.05%","100.00%","67.13%","51.91%","54.18%","63.16%","77.38%","64.34%","54.37%","37.20%","44.32%","29.63%","79.67%","16.67%","13.98%","57.41%","47.70%","80.92%"],["[Kling 1.6](https://klingai.kuaishou.com/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1VhlbBXQ_P9unUkxP8xsOhCAf3_9Iu1pn)","VBench Team","  [API](https://klingai.kuaishou.com/)","2025-03-28","59.00%","48.58%","65.45%","33.05%","83.56%","64.35%","86.99%","91.75%","71.95%","43.89%","53.26%","65.55%","68.00%","59.46%","64.38%","20.77%","19.41%","29.29%","72.00%","17.33%","10.83%","61.73%","38.51%","92.40%"],["[Sora-480p](https://openai.com/sora/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1yK3xiD7HhpGjMKMFddcgouaV1bymSqSw)","VBench Team"," [API](https://openai.com/sora/)","2025-03-28","58.38%","60.57%","64.32%","22.09%","87.72%","57.18%","86.45%","98.15%","78.57%","53.65%","67.48%","62.22%","64.94%","43.36%","58.22%","19.81%","08.06%","15.15%","58.00%","15.33%","11.11%","27.16%","34.48%","94.15%"],["[StepVideo](https://yuewen.cn/videos)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1BeQ1iGspQ3bSCW9VLaeXyuOKjwtJSLTF)","VBench Team"," [Open Source](https://github.com/stepfun-ai/Step-Video-T2V)","2025-03-28","55.78%","51.26%","60.78%","17.22%","88.18%","61.44%","85.62%","96.04%","82.87%","35.48%","67.05%","60.48%","57.89%","55.38%","71.98%","14.98%","08.06%","06.83%","54.67%","07.11%","07.29%","21.60%","37.36%","84.21%"],["[HunyuanVideo](https://github.com/Tencent/HunyuanVideo)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1OmL7HComkNWqhV6Yr9CA8YufAAErK4gu)","VBench Team"," [Open Source](https://github.com/Tencent/HunyuanVideo)","2025-03-28","55.30%","41.84%","63.44%","28.60%","82.41%","60.20%","88.58%","82.97%","75.67%","43.96%","39.73%","76.09%","64.37%","56.52%","43.80%","21.26%","22.71%","26.94%","66.67%","18.89%","09.78%","33.95%","34.48%","92.40%"],["[CogVideoX-1.5](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1Cy_M_hTmkWI6cLyBMRx7Y7mhSdNyKlxe)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2025-03-28","53.35%","43.65%","58.18%","29.57%","72.14%","63.23%","59.72%","87.18%","69.51%","44.70%","42.61%","80.80%","83.19%","67.13%","21.79%","19.32%","24.18%","26.60%","72.33%","20.00%","11.21%","33.33%","33.91%","82.46%"]],"metadata":null},"headers":["Model (alphabetical order)","Certification","Sampled by","Evaluated by","Accessibility","Date","Total Score","Creativity Score","Commonsense Score","Controllability Score","Human Fidelity Score","Physics Score","Human Anatomy","Human Clothes","Human Identity","Composition","Diversity","Mechanics","Material","Thermotics","Multi-View Consistency","Dynamic Spatial Relationship","Dynamic Attribute","Motion Order Understanding","Human Interaction","Complex Landscape","Complex Plot","Camera Motion","Motion Rationality","Instance Preservation"],"row_count":[1,"dynamic"],"col_count":[30,"dynamic"],"datatype":["markdown","markdown","markdown","markdown","markdown","markdown","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number"],"type":"pandas","latex_delimiters":[{"left":"$$","right":"$$","display":true}],"show_label":true,"height":500,"min_width":160,"interactive":false,"visible":true,"elem_classes":[],"wrap":false,"line_breaks":true,"column_widths":[],"name":"dataframe","_selectable":false},"skip_api":false,"component_class_id":"2f74a641e325b504d0304a93a36d57b1","key":null,"api_info":{"properties":{"headers":{"items":{"type":"string"},"title":"Headers","type":"array"},"data":{"items":{"items":{},"type":"array"},"title":"Data","type":"array"},"metadata":{"anyOf":[{"additionalProperties":{"anyOf":[{"items":{},"type":"array"},{"type":"null"}]},"type":"object"},{"type":"null"}],"default":null,"title":"Metadata"}},"required":["headers","data"],"title":"DataframeData","type":"object"},"example_inputs":{"headers":["a","b"],"data":[["foo","bar"]]}},{"id":42,"type":"state","props":{"value":"Creativity","time_to_live":null,"delete_callback":"<function State.__init__.<locals>.<lambda> at 0x7f2310ce1bc0>","name":"state","_selectable":false},"skip_api":true,"component_class_id":"dfc864120741e7a3c1d9feae86583fb2","key":null},{"id":43,"type":"state","props":{"value":"Commonsense","time_to_live":null,"delete_callback":"<function State.__init__.<locals>.<lambda> at 0x7f2310ce1ee0>","name":"state","_selectable":false},"skip_api":true,"component_class_id":"dfc864120741e7a3c1d9feae86583fb2","key":null},{"id":44,"type":"state","props":{"value":"Controllability","time_to_live":null,"delete_callback":"<function State.__init__.<locals>.<lambda> at 0x7f2310ce20c0>","name":"state","_selectable":false},"skip_api":true,"component_class_id":"dfc864120741e7a3c1d9feae86583fb2","key":null},{"id":45,"type":"state","props":{"value":"Human Fidelity","time_to_live":null,"delete_callback":"<function State.__init__.<locals>.<lambda> at 0x7f2310ce22a0>","name":"state","_selectable":false},"skip_api":true,"component_class_id":"dfc864120741e7a3c1d9feae86583fb2","key":null},{"id":46,"type":"state","props":{"value":"Physics","time_to_live":null,"delete_callback":"<function State.__init__.<locals>.<lambda> at 0x7f2310ce2480>","name":"state","_selectable":false},"skip_api":true,"component_class_id":"dfc864120741e7a3c1d9feae86583fb2","key":null},{"id":47,"type":"tabitem","props":{"label":"Video Quality","visible":true,"interactive":true,"id":3,"elem_id":"vbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":48,"type":"accordion","props":{"label":"INSTRUCTION","open":false,"visible":true,"name":"accordion"},"skip_api":true,"component_class_id":"0df114fd8de6af8172659b1981001379","key":null},{"id":49,"type":"textbox","props":{"value":"We use all the videos on Sora website (https://openai.com/sora) for a preliminary evaluation, including the failure case videos Sora provided.","lines":2,"max_lines":20,"label":"","show_label":true,"container":true,"min_width":160,"visible":true,"elem_id":"quality-button","autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":50,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":51,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":52,"type":"column","props":{"scale":1.0,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":53,"type":"checkboxgroup","props":{"choices":[["subject consistency","subject consistency"],["background consistency","background consistency"],["motion smoothness","motion smoothness"],["aesthetic quality","aesthetic quality"],["imaging quality","imaging quality"],["dynamic degree","dynamic degree"]],"value":["subject consistency","background consistency","motion smoothness","aesthetic quality","imaging quality","dynamic degree"],"type":"value","label":"Evaluation Quality Dimension","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkboxgroup","_selectable":false},"skip_api":false,"component_class_id":"f3c90df7ca414d587f1946e7c68c8f37","key":null,"api_info":{"items":{"enum":["subject consistency","background consistency","motion smoothness","aesthetic quality","imaging quality","dynamic degree"],"type":"string"},"title":"Checkbox Group","type":"array"},"example_inputs":["subject consistency"]},{"id":54,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":55,"type":"dataframe","props":{"value":{"headers":["Model Name (clickable)","Quality Score","Selected Score","subject consistency","background consistency","motion smoothness","aesthetic quality","imaging quality","dynamic degree"],"data":[["[Sora](https://openai.com/sora)","80.01%","80.01%","94.96%","95.84%","98.93%","60.30%","57.70%","69.30%"],["[VideoCrafter-1.0](https://arxiv.org/abs/2310.19512)","79.90%","79.90%","95.10%","98.04%","95.67%","62.67%","61.99%","55.00%"],["[Gen-2](https://runwayml.com/ai-magic-tools/gen-2/)","78.82%","78.82%","97.61%","97.61%","99.58%","66.96%","63.58%","18.89%"],["[Pika](https://pika.art)","78.32%","78.32%","96.76%","98.95%","99.51%","63.15%","54.73%","37.22%"],["[Show-1](https://arxiv.org/abs/2309.15818)","78.12%","78.12%","95.53%","98.02%","98.24%","57.35%","59.75%","44.44%"],["[LaVie](https://github.com/Vchitect/LaVie)","77.20%","77.20%","91.41%","97.47%","96.38%","54.94%","61.90%","49.72%"],["[LaVie-Interpolation](https://github.com/Vchitect/LaVie)","76.67%","76.67%","92.00%","97.33%","97.82%","54.00%","59.78%","46.11%"],["[ModelScope](https://huggingface.co/damo-vilab/modelscope-damo-text-to-video-synthesis)","76.61%","76.61%","89.87%","95.29%","95.79%","52.06%","58.57%","66.39%"],["[VideoCrafter-0.9](https://arxiv.org/abs/2211.13221)","75.00%","75.00%","86.24%","92.88%","91.79%","44.41%","57.22%","89.72%"],["[CogVideo](https://github.com/THUDM/CogVideo)","69.55%","69.55%","92.19%","96.20%","96.47%","38.18%","41.03%","42.22%"]],"metadata":null},"headers":["Model Name (clickable)","Quality Score","Selected Score","subject consistency","background consistency","motion smoothness","aesthetic quality","imaging quality","dynamic degree"],"row_count":[1,"dynamic"],"col_count":[9,"dynamic"],"datatype":["markdown","markdown","markdown","markdown","markdown","markdown","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number"],"type":"pandas","latex_delimiters":[{"left":"$$","right":"$$","display":true}],"show_label":true,"height":500,"min_width":160,"interactive":false,"visible":true,"elem_classes":[],"wrap":false,"line_breaks":true,"column_widths":[],"name":"dataframe","_selectable":false},"skip_api":false,"component_class_id":"2f74a641e325b504d0304a93a36d57b1","key":null,"api_info":{"properties":{"headers":{"items":{"type":"string"},"title":"Headers","type":"array"},"data":{"items":{"items":{},"type":"array"},"title":"Data","type":"array"},"metadata":{"anyOf":[{"additionalProperties":{"anyOf":[{"items":{},"type":"array"},{"type":"null"}]},"type":"object"},{"type":"null"}],"default":null,"title":"Metadata"}},"required":["headers","data"],"title":"DataframeData","type":"object"},"example_inputs":{"headers":["a","b"],"data":[["foo","bar"]]}},{"id":56,"type":"tabitem","props":{"label":"VBench-I2V","visible":true,"interactive":true,"id":4,"elem_id":"vbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":57,"type":"accordion","props":{"label":"NOTE","open":false,"visible":true,"name":"accordion"},"skip_api":true,"component_class_id":"0df114fd8de6af8172659b1981001379","key":null},{"id":58,"type":"textbox","props":{"value":"Since the open-sourced SVD models do not accept text input during the I2V stage, we are unable to evaluate its `camera motion` in terms of `video-text consistency`. The total score is calculated based on all dimensions except `camera motion`.","lines":3,"max_lines":20,"label":"","show_label":true,"container":true,"min_width":160,"visible":true,"elem_id":"quality-button","autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":59,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":60,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":61,"type":"column","props":{"scale":1.0,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":62,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":63,"type":"checkbox","props":{"value":false,"label":"Sampled by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":64,"type":"checkbox","props":{"value":false,"label":"Evaluated by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":65,"type":"checkbox","props":{"value":false,"label":"Only show 🥇 Gold","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":66,"type":"form","props":{"scale":3,"min_width":480,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":67,"type":"checkboxgroup","props":{"choices":[["Video-Text Camera Motion","Video-Text Camera Motion"],["Video-Image Subject Consistency","Video-Image Subject Consistency"],["Video-Image Background Consistency","Video-Image Background Consistency"],["Subject Consistency","Subject Consistency"],["Background Consistency","Background Consistency"],["Motion Smoothness","Motion Smoothness"],["Dynamic Degree","Dynamic Degree"],["Aesthetic Quality","Aesthetic Quality"],["Imaging Quality","Imaging Quality"]],"value":["Video-Text Camera Motion","Video-Image Subject Consistency","Video-Image Background Consistency","Subject Consistency","Background Consistency","Motion Smoothness","Dynamic Degree","Aesthetic Quality","Imaging Quality"],"type":"value","label":"Evaluation Quality Dimension","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkboxgroup","_selectable":false},"skip_api":false,"component_class_id":"f3c90df7ca414d587f1946e7c68c8f37","key":null,"api_info":{"items":{"enum":["Video-Text Camera Motion","Video-Image Subject Consistency","Video-Image Background Consistency","Subject Consistency","Background Consistency","Motion Smoothness","Dynamic Degree","Aesthetic Quality","Imaging Quality"],"type":"string"},"title":"Checkbox Group","type":"array"},"example_inputs":["Video-Text Camera Motion"]},{"id":68,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":69,"type":"dataframe","props":{"value":{"headers":["Model Name (clickable)","Certification","Sampled by","Evaluated by","Accessibility","Date","Total Score","I2V Score","Quality Score","Selected Score","Video-Text Camera Motion","Video-Image Subject Consistency","Video-Image Background Consistency","Subject Consistency","Background Consistency","Motion Smoothness","Dynamic Degree","Aesthetic Quality","Imaging Quality"],"data":[["[DreamX-World-1.0](https://github.com/AMAP-ML/DreamX-World)","","DreamX-World","DreamX-World",null,"2026-05-20","90.49%","97.74%","83.24%","90.49%","85.82%","98.27%","99.04%","95.35%","97.24%","98.52%","72.11%","63.70%","71.46%"],["ToMoviee-2.0","🥈 Silver ","[Wondershare](https://drive.google.com/drive/folders/1BBlqlfgztFBtwnUZ555HRL2ay6t5T0ds)"," VBench Team"," Close Source"," 2025-09-08","89.76%","98.46%","81.06%","89.76%","83.51%","99.05%","99.64%","95.12%","97.10%","99.10%","47.07%","64.00%","70.15%"],["[Steamer-I2V](https://steamer001.github.io/steamer/)","","Steamer Team","Steamer Team",null,"2025-05-17","89.38%","96.52%","82.25%","89.38%","58.58%","98.02%","99.37%","93.45%","96.99%","98.47%","68.13%","63.94%","70.48%"],["[Magi-1](https://sand.ai/)","","Sand.ai","Sand.ai","Open Source","2025-04-21","89.28%","96.12%","82.44%","89.28%","50.85%","98.39%","99.00%","93.96%","96.74%","98.68%","68.21%","64.74%","69.71%"],["[Pi](https://siamese.visualx.art/home)","","Tuling Team","Tuling Team",null,"2025-03-18","89.08%","96.21%","81.95%","89.08%","51.20%","98.67%","98.87%","96.87%","97.50%","99.18%","49.93%","61.91%","72.86%"],["[JT-CV](https://github.com/jiutiancv)","","JiuTianCV","JiuTianCV",null,"2026-03-24","88.95%","97.43%","80.46%","88.95%","61.81%","99.14%","99.58%","95.87%","97.48%","99.25%","38.70%","62.37%","70.77%"],["[Wan2.2-TI2V-5B (Qwen prompt-optimized)](https://github.com/Wan-Video/Wan2.2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1iiBmYK58ZUSbSpQ6OL3gMunHUc2TUU53)","VBench Team","Open Source","2026-02-12","88.80%","96.30%","81.30%","88.80%","50.69%","98.43%","99.27%","94.95%","96.81%","98.65%","52.85%","64.01%","70.70%"],["[Wan2.2-I2V-A14B (Qwen prompt-optimized)](https://github.com/Wan-Video/Wan2.2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1mw-4sO9hHRKlhVCLu5wIpoeERIqtEIZ0)","VBench Team","Open Source","2026-03-06","88.68%","96.51%","80.85%","88.68%","49.10%","98.60%","99.56%","94.99%","97.13%","98.22%","48.62%","64.71%","70.67%"],["[MUG-V](https://github.com/Shopee-MUG/MUG-V)","","Shopee-MUG","Shopee-MUG",null,"2025-04-25","88.46%","95.37%","81.55%","88.46%","23.17%","98.82%","99.51%","95.73%","98.52%","98.90%","57.24%","61.37%","68.48%"],["[Dynamic-I2V-5B](https://www.arxiv.org/abs/2505.19901)","","OPPO AI Center","OPPO AI Center","2025-05-28","2025-05-28","88.45%","98.12%","78.78%","88.45%","88.10%","98.83%","98.97%","96.21%","98.39%","98.88%","27.15%","60.10%","69.23%"],["[Step-Video-TI2V](https://github.com/stepfun-ai/Step-Video-TI2V)","","Step-Video Team","Step-Video Team",null,"2025-03-14","88.36%","95.50%","81.22%","88.36%","49.23%","97.86%","98.63%","96.02%","97.06%","99.24%","48.78%","62.29%","70.44%"],["[Gen-4-I2V](https://app.runwayml.com/video-tools)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1JpSUBvWhL7sZW96PxH8ayb252ohgJdPL)","VBench Team","API","2025-05-20","88.27%","95.65%","80.89%","88.27%","68.26%","97.84%","97.46%","93.23%","96.79%","98.99%","55.20%","61.77%","70.41%"],["[Wan2.2-I2V-A14B (w/o prompt-optimized)](https://github.com/Wan-Video/Wan2.2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1fMNra2Daf9se3VBtSEH6YG6HqBWdGKH-)","VBench Team","Open Source","2026-02-07","88.16%","95.82%","80.50%","88.16%","54.44%","97.52%","99.03%","94.68%","96.72%","98.32%","52.85%","61.53%","70.36%"],["[CogVideoSFT](https://github.com/THUDM/CogVideo)","","GaoDeI2V"," GaoDeI2V"," ","2024-10-23","87.98%","97.18%","78.77%","87.98%","84.93%","97.67%","98.76%","95.47%","98.30%","98.35%","36.51%","59.76%","67.64%"],["DynamiCrafter-1024","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1VPbIoXHNYBxUjq5D53VpulrxA0adNADW)"," VBench Team"," Open Source"," 2024-07-22","87.76%","95.02%","80.50%","87.76%","35.81%","98.17%","98.60%","95.69%","97.38%","97.38%","47.40%","66.46%","69.34%"],["[LTX-2-I2V (w/o prompt-optimized)](https://github.com/Lightricks/LTX-2/tree/main)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1Kd5piR4qf6GTv4cXuQUNIAvYWub7b37x)","VBench Team"," Open Source","2026-02-06","87.59%","96.53%","78.65%","87.59%","43.09%","99.38%","99.35%","97.65%","97.25%","99.29%","08.54%","63.61%","72.72%"],["[DynamiCrafter-CIL-512](https://github.com/thu-ml/cond-image-leakage)","","CIL Team"," CIL Team"," ","2024-11-19","87.45%","92.75%","82.15%","87.45%","28.70%","95.79%","97.66%","94.87%","98.33%","97.06%","83.01%","60.52%","67.31%"],["[Pusa-V1.0](https://github.com/Yaofang-Liu/Pusa-VidGen)","","Pusa Team","Pusa Team","2025-07-22","2025-07-28","87.32%","94.84%","79.80%","87.32%","29.46%","97.64%","99.24%","92.27%","96.02%","98.48%","52.60%","63.15%","68.27%"],["DynamiCrafter-512","🥇 Gold","VBench Team"," VBench Team"," Open Source","2024-07-22","86.99%","93.53%","80.46%","86.99%","31.98%","97.21%","97.40%","93.81%","96.64%","96.84%","69.67%","60.88%","68.60%"],["[Wan2.1-I2V-14B-720P](https://github.com/Wan-Video/Wan2.1)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1PEsSdFdqGUkbdT4UHz-n0_PjRQwbTw8g)","VBench Team","Open Source","2025-05-08","86.86%","92.90%","80.82%","86.86%","34.76%","96.95%","96.44%","94.86%","97.07%","97.90%","51.38%","64.75%","70.44%"],["[HunyuanVideo-I2V](https://github.com/Tencent/HunyuanVideo-I2V)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1W02wg6_p-v5BB3jwYbfAKSgoJyXyFIEK)","VBench Team","Open Source","2025-06-13","86.82%","95.10%","78.54%","86.82%","49.91%","98.53%","97.37%","95.26%","96.70%","99.23%","22.20%","62.55%","70.14%"],["[STIV (Apple)](https://huggingface.co/papers/2412.07730)","","Apple"," Apple"," Close Source","2024-12-20","86.73%","93.48%","79.98%","86.73%","11.17%","98.96%","97.35%","98.40%","98.39%","99.61%","15.28%","66.00%","70.81%"],["[CogVideoX-5b-I2V](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/11Nd1gaEM7eIaDwWAhKv8nfIAAUFFCivS)"," VBench Team"," Open Source","2025-03-31","86.70%","94.79%","78.61%","86.70%","67.68%","97.19%","96.74%","94.34%","96.42%","98.40%","33.17%","61.87%","70.01%"],["Animate-Anything","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1uFteS9Aq4kiNhFYeo7Ox1zEKXy_J4bvF/view?usp=sharing)"," VBench Team"," Open Source","2024-07-22","86.48%","94.25%","78.71%","86.48%","13.08%","98.76%","98.58%","98.90%","98.19%","98.61%","02.68%","67.12%","72.09%"],["I2VGen-XL(trim-last-two-frames)","🥇 Gold","VBench Team"," VBench Team"," Open Source","2024-07-22","86.09%","92.98%","79.21%","86.09%","13.00%","97.52%","97.68%","96.36%","97.93%","98.31%","24.96%","65.33%","69.85%"],["SEINE-512x512","🥇 Gold","VBench Team"," VBench Team"," Open Source","2024-07-22","85.52%","92.67%","78.37%","85.52%","20.97%","97.15%","96.94%","95.28%","97.12%","97.12%","27.07%","64.55%","71.39%"],["I2VGen-XL","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1t-Q7G2z99g6eJRp4tQf1IaTy-8Muqfkd)"," VBench Team"," Open Source","2024-07-22","85.28%","92.11%","78.44%","85.28%","18.48%","96.48%","96.83%","94.18%","97.09%","98.34%","26.10%","64.82%","69.14%"],["DynamiCrafter-256","🥇 Gold","VBench Team"," VBench Team"," Open Source"," 2024-07-22","85.25%","93.02%","77.49%","85.25%","20.92%","97.05%","97.56%","94.74%","98.29%","97.83%","40.57%","58.71%","62.28%"],["SEINE-512x320","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1W-WTnYZXlwHWdYx_4m3qxmU20uHDQExG/view?usp=sharing)"," VBench Team"," Open Source"," 2024-07-22","84.88%","92.39%","77.37%","84.88%","23.67%","96.57%","96.80%","94.20%","97.26%","96.68%","34.31%","58.42%","70.97%"],["[VISTA](https://github.com/zfnice/VISTA)","","BDWK","BDWK",null,"2025-06-18","84.29%","88.41%","80.16%","84.29%","34.18%","93.37%","92.63%","93.75%","95.49%","97.81%","54.31%","61.17%","72.63%"],["ConsistI2V","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1xAZLefw42_cZPu5lOTt-VkV5B93szmDs/view?usp=sharing)"," VBench Team"," Open Source","2024-07-22","84.07%","91.91%","76.22%","84.07%","33.92%","95.82%","95.95%","95.27%","98.28%","97.38%","18.62%","59.00%","66.92%"],["VideoCrafter-I2V","🥇 Gold","[VBench Team](https://drive.google.com/file/d/11cgACr--DfOvEo-tFmOLWzLAnf3TC3bz/view?usp=sharing)"," VBench Team"," Open Source","2024-07-22","82.57%","86.31%","78.84%","82.57%","33.60%","91.17%","91.31%","97.86%","98.79%","98.00%","22.60%","60.78%","71.68%"],["[CogVideoX1.5-5B-I2V](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1fGyVyqxKdKSD6zjOFEWWt4fZrOA4oYIH)"," VBench Team"," Open Source","2025-03-31","71.58%","92.25%","50.90%","71.58%","39.71%","96.46%","95.50%","91.80%","94.66%","40.98%","62.29%","70.21%","97.07%"],["SVD-XT-1.0","🥇 Gold","VBench Team"," VBench Team"," Open Source","2024-07-22","nan","nan","80.11%","nan","nan","97.52%","97.63%","95.52%","96.61%","98.09%","52.36%","60.15%","69.80%"],["SVD-XT-1.1","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1-uurchoyIkiQcxyueXEH1YtcyL4XiU1q/view?usp=sharing)"," VBench Team"," Open Source"," 2024-07-22","nan","nan","79.40%","nan","nan","97.51%","97.62%","95.42%","96.77%","98.12%","43.17%","60.23%","70.23%"]],"metadata":null},"headers":["Model Name (clickable)","Certification","Sampled by","Evaluated by","Accessibility","Date","Total Score","I2V Score","Quality Score","Selected Score","Video-Text Camera Motion","Video-Image Subject Consistency","Video-Image Background Consistency","Subject Consistency","Background Consistency","Motion Smoothness","Dynamic Degree","Aesthetic Quality","Imaging Quality"],"row_count":[1,"dynamic"],"col_count":[19,"dynamic"],"datatype":["markdown","markdown","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number"],"type":"pandas","latex_delimiters":[{"left":"$$","right":"$$","display":true}],"show_label":true,"height":500,"min_width":160,"interactive":false,"visible":true,"elem_classes":[],"wrap":false,"line_breaks":true,"column_widths":[],"name":"dataframe","_selectable":false},"skip_api":false,"component_class_id":"2f74a641e325b504d0304a93a36d57b1","key":null,"api_info":{"properties":{"headers":{"items":{"type":"string"},"title":"Headers","type":"array"},"data":{"items":{"items":{},"type":"array"},"title":"Data","type":"array"},"metadata":{"anyOf":[{"additionalProperties":{"anyOf":[{"items":{},"type":"array"},{"type":"null"}]},"type":"object"},{"type":"null"}],"default":null,"title":"Metadata"}},"required":["headers","data"],"title":"DataframeData","type":"object"},"example_inputs":{"headers":["a","b"],"data":[["foo","bar"]]}},{"id":70,"type":"tabitem","props":{"label":"📊 VBench-Long","visible":true,"interactive":true,"id":5,"elem_id":"vbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":71,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":72,"type":"accordion","props":{"label":"INSTRUCTION","open":false,"visible":true,"name":"accordion"},"skip_api":true,"component_class_id":"0df114fd8de6af8172659b1981001379","key":null},{"id":73,"type":"textbox","props":{"value":"","lines":2,"max_lines":20,"label":"","show_label":true,"container":true,"min_width":160,"visible":true,"elem_id":"long-ins-button","autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":74,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":75,"type":"markdown","props":{"value":"    ","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":76,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":77,"type":"column","props":{"scale":0.2,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":78,"type":"button","props":{"value":"Select Quality Dimensions","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":79,"type":"button","props":{"value":"Select Semantic Dimensions","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":80,"type":"button","props":{"value":"Select All","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":81,"type":"button","props":{"value":"Deselect All","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":82,"type":"column","props":{"scale":0.8,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":83,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":84,"type":"checkbox","props":{"value":false,"label":"Sampled by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":85,"type":"checkbox","props":{"value":false,"label":"Evaluated by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":86,"type":"checkbox","props":{"value":false,"label":"Only show 🥇 Gold","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":87,"type":"form","props":{"scale":3,"min_width":480,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":88,"type":"checkboxgroup","props":{"choices":[["subject consistency","subject consistency"],["background consistency","background consistency"],["temporal flickering","temporal flickering"],["motion smoothness","motion smoothness"],["dynamic degree","dynamic degree"],["aesthetic quality","aesthetic quality"],["imaging quality","imaging quality"],["object class","object class"],["multiple objects","multiple objects"],["human action","human action"],["color","color"],["spatial relationship","spatial relationship"],["scene","scene"],["appearance style","appearance style"],["temporal style","temporal style"],["overall consistency","overall consistency"]],"value":["subject consistency","background consistency","temporal flickering","motion smoothness","dynamic degree","aesthetic quality","imaging quality","object class","multiple objects","human action","color","spatial relationship","scene","appearance style","temporal style","overall consistency"],"type":"value","label":"Evaluation Dimension","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkboxgroup","_selectable":false},"skip_api":false,"component_class_id":"f3c90df7ca414d587f1946e7c68c8f37","key":null,"api_info":{"items":{"enum":["subject consistency","background consistency","temporal flickering","motion smoothness","dynamic degree","aesthetic quality","imaging quality","object class","multiple objects","human action","color","spatial relationship","scene","appearance style","temporal style","overall consistency"],"type":"string"},"title":"Checkbox Group","type":"array"},"example_inputs":["subject consistency"]},{"id":89,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":90,"type":"dataframe","props":{"value":{"headers":["Model Name (clickable)","Certification","Sampled by","Evaluated by","Accessibility","Date","Total Score","Quality Score","Semantic Score","Selected Score","subject consistency","background consistency","temporal flickering","motion smoothness","dynamic degree","aesthetic quality","imaging quality","object class","multiple objects","human action","color","spatial relationship","scene","appearance style","temporal style","overall consistency"],"data":[["[IPOW](https://github.com/SAIS-FUXI/IPO)","🥈 Silver ","[IPOW](https://drive.google.com/drive/u/0/folders/1A47N1-CahUwy3pu_KwULiNXsEfqIgOQP)","VBench Team","[Open Source](https://github.com/SAIS-FUXI/IPO)","2025-08-06","88.26%","87.83%","90.01%","88.26%","97.31%","97.67%","99.76%","97.94%","95.56%","67.42%","68.86%","97.43%","95.96%","97.00%","97.15%","97.80%","76.32%","23.60%","27.59%","26.77%"],["[Vidu Q1 (2025-04-17)](https://www.vidu.studio/)","🥈 Silver ","[ShengShu Team](https://drive.google.com/drive/folders/15MntPOIUZXER4cCTZK8Yq97202PAlz10?usp=sharing)","VBench Team"," [API](https://www.vidu.studio/zh)","2025-04-21","87.41%","87.28%","87.94%","87.41%","95.80%","97.11%","99.34%","98.47%","91.85%","67.32%","69.07%","97.40%","93.89%","99.60%","99.04%","93.74%","67.41%","22.37%","26.46%","27.24%"],["[IPOC (2025-04-14)](https://yangxlarge.github.io/ipoc/)","🥈 Silver ","[IPOC Team](https://drive.google.com/file/d/1YFSVvcEUfejmXZxHRuYh723R2Iv_NCU5/view?usp=sharing)","VBench Team"," [Open Source](https://yangxlarge.github.io/ipoc/)","2025-04-14","86.57%","87.00%","84.84%","86.57%","96.60%","97.57%","99.78%","97.60%","93.06%","65.22%","69.02%","92.41%","87.25%","98.00%","86.79%","95.46%","61.45%","24.01%","25.87%","26.85%"],["[Wan2.1(2025-02-24)](https://tongyi.aliyun.com/wanxiang/videoCreation)","🥈 Silver ","[Wan Team](https://huggingface.co/spaces/Vchitect/VBench_Leaderboard)","VBench Team"," [API](https://bailian.console.aliyun.com/model-market/detail/wanx2.1-t2v-plus/model-market/detail/wanx2.1-t2v-plus)","2025-02-24","86.22%","86.67%","84.44%","86.22%","96.62%","97.58%","99.38%","97.42%","94.26%","63.45%","69.63%","96.64%","86.59%","99.20%","94.39%","85.70%","61.24%","21.59%","26.18%","27.49%"],["[IPOC](https://yangxlarge.github.io/ipoc/)","🥈 Silver ","[IPOC Team](https://drive.google.com/file/d/1yG4Rb6x6ij2E_0I-5eoZ0v-KSk0cgriQ/view?usp=drive_link)","VBench Team"," [Close Source](https://yangxlarge.github.io/ipoc/)","2025-02-28","85.71%","86.12%","84.09%","85.71%","96.68%","97.21%","99.11%","97.12%","92.59%","64.11%","68.43%","94.14%","85.73%","99.40%","88.64%","90.55%","54.01%","24.59%","25.79%","27.56%"],["[MiracleVision V5](https://www.miraclevision.com/)","🥈 Silver ","[MVV Team](https://drive.google.com/file/d/18gen90zZOaRBe7IuukqaJOj60Aedl8Vb/view?usp=drive_link)","VBench Team"," [API](https://www.miraclevision.com/)","2025-01-21","85.23%","86.68%","79.43%","85.23%","97.32%","96.35%","98.62%","99.02%","93.52%","65.28%","65.67%","93.04%","81.60%","98.00%","89.92%","76.22%","46.80%","21.72%","25.16%","26.94%"],["[Veo 3](https://cloud.google.com/vertex-ai/generative-ai/docs/models/veo/3-0-generate-001?hl=zh-cn)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/0/folders/16EWQAHzQtozM9tezyBGQrzMsWZCS-LkM)","VBench Team","[API](https://cloud.google.com/vertex-ai/generative-ai/docs/video/generate-videos#text-video-gen)","2025-08-06","85.06%","85.70%","82.49%","85.06%","97.36%","96.89%","99.30%","99.16%","72.43%","63.81%","68.23%","93.89%","82.20%","99.40%","82.48%","84.26%","57.43%","23.55%","25.97%","27.88%"],["[LanDiff](https://landiff.github.io/)","🥈 Silver ","[LanDiff Team](https://drive.google.com/drive/folders/1acFlUVpmk7I_kHyJlUAkFnzhC7Z6sXsL)","VBench Team","[Open Source](https://github.com/LanDiff/LanDiff)","2025-08-06","84.87%","85.41%","82.72%","84.87%","91.86%","98.24%","99.42%","97.11%","93.33%","65.24%","65.78%","94.86%","87.13%","96.60%","91.22%","73.58%","54.84%","25.60%","25.28%","27.43%"],["[Wan2.1](https://tongyi.aliyun.com/wanxiang/videoCreation)","🥈 Silver ","[Wan Team](https://drive.google.com/drive/u/1/folders/1GHH7xOQCPb0kRjlyzH9APaddAw_hFRla)","VBench Team","[API](https://tongyi.aliyun.com/wanxiang/)","2025-01-08","84.70%","85.64%","80.95%","84.70%","95.92%","97.39%","99.53%","96.92%","94.35%","61.53%","67.28%","94.24%","81.44%","98.80%","87.79%","81.08%","53.67%","21.13%","25.69%","27.44%"],["[Open-Sora-2.0 (2025-03-18)](https://github.com/hpcaitech/Open-Sora)","🥈 Silver ","[Open-Sora Team](https://drive.google.com/file/d/1iNBcAGakVLZge9BtIFgwccR0RD9w52it/view?usp=drive_link)","VBench Team"," [Open Source](https://hpcaitech.github.io/Open-Sora/)","2025-03-31","84.34%","85.40%","80.12%","84.34%","97.71%","98.00%","99.40%","98.69%","71.39%","64.39%","65.66%","94.50%","77.72%","95.40%","85.98%","76.18%","52.71%","22.98%","25.91%","27.50%"],["[Sora](https://openai.com/sora/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/1/folders/1ZxANm9HssrOY7aPAKRi579eJaQV6fsbk)","VBench Team"," [API](https://openai.com/sora/)","2025-01-14","84.28%","85.51%","79.35%","84.28%","96.23%","96.35%","98.87%","98.74%","79.91%","63.46%","68.28%","93.93%","70.85%","98.20%","80.11%","74.29%","56.95%","24.76%","25.01%","26.26%"],["[CausVid(2025-01-02 5s)](https://causvid.github.io/)","🥈 Silver ","[CausVid Team](https://drive.google.com/drive/u/1/folders/1SHD4CFuzBXLrsk1_fmQFBz7wvUvedY2O)","VBench Team","[Close Source](https://causvid.github.io/)","2025-01-02","84.27%","85.65%","78.75%","84.27%","97.53%","97.19%","96.24%","98.05%","92.69%","64.15%","68.88%","92.99%","72.15%","99.80%","80.17%","64.65%","56.58%","24.27%","25.33%","27.51%"],["[Wan2.1-T2V-1.3B](https://github.com/Wan-Video/Wan2.1/tree/main)","🥈 Silver ","[Wan Team](https://drive.google.com/drive/folders/1asyr8ytkumWh3qXWlPMm89Fq3tCdJxaA?usp=drive_link)","VBench Team"," [Open Source](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)","2025-03-13","84.26%","85.30%","80.09%","84.26%","96.34%","97.29%","99.49%","97.44%","85.56%","62.43%","66.51%","94.30%","79.74%","98.20%","89.58%","76.46%","52.73%","21.28%","25.32%","27.07%"],["[Wan2.2-T2V-A14B (Qwen prompt-optimized)](https://github.com/Wan-Video/Wan2.2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1ZOzQDrMWpdMXfG6CLSjJFGqUdkspXBwq)","VBench Team","[Open Source](https://github.com/Wan-Video/Wan2.2)","2026-02-18","84.23%","85.42%","79.50%","84.23%","97.29%","97.39%","99.22%","98.16%","61.02%","67.22%","71.75%","94.06%","82.10%","96.40%","87.43%","78.39%","56.80%","20.39%","23.64%","26.12%"],["[CausVid](https://causvid.github.io/)","🥈 Silver ","[CausVid Team](https://drive.google.com/drive/u/1/folders/1mmitg-4f6OWDZIdmSu2iNXrkcsVCT_5B)","VBench Team","[Close Source](https://causvid.github.io/)","2024-12-07","83.88%","85.21%","78.57%","83.88%","98.09%","97.41%","96.89%","97.81%","80.60%","64.70%","69.67%","92.80%","71.68%","99.80%","80.34%","64.77%","55.84%","24.18%","25.29%","27.53%"],["[Wan2.1-T2V-14B](https://github.com/Wan-Video/Wan2.1/tree/main)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1vbsu4MNGrWbJSiw5AKfvtWpJz6MOJ0-1)","VBench Team"," [Open Source](https://huggingface.co/Wan-AI/Wan2.1-T2V-14B)","2025-07-25","83.69%","85.59%","76.11%","83.69%","97.52%","98.09%","99.46%","98.30%","65.46%","66.07%","69.43%","86.28%","69.58%","95.40%","88.59%","75.39%","45.75%","22.64%","23.19%","25.91%"],["[Luma](https://lumalabs.ai/dream-machine)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1NuL9oRIMPuPk98PfI0lA34LL6XLtjMnr/view?usp=drive_link)","VBench Team"," [API](https://lumalabs.ai/dream-machine/api)","2025-01-14","83.61%","83.47%","84.17%","83.61%","97.33%","97.43%","98.64%","99.35%","44.26%","65.51%","66.55%","94.95%","82.63%","96.40%","92.33%","83.67%","58.98%","24.66%","26.29%","28.13%"],["[Hunyuan Video (2025-05-22)](https://github.com/Tencent/HunyuanVideo)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1TFBwX9BFt75DSpbrYARfo5w92wf1Vy8X)","VBench Team"," [API](https://github.com/Tencent/HunyuanVideo)","2025-05-22","83.43%","85.07%","76.88%","83.43%","97.22%","97.60%","99.39%","99.05%","71.94%","60.28%","67.24%","83.48%","66.71%","94.40%","89.79%","72.13%","54.46%","22.21%","24.52%","26.95%"],["[EasyAnimateV5.1](https://github.com/aigc-apps/EasyAnimate)","🥈 Silver ","[EasyAnimate Team](https://drive.google.com/file/d/1prDDDov2rRObcTvnq6jNvmSjfNm5jUe7/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/aigc-apps/EasyAnimate)","2025-01-22","83.42%","85.03%","77.01%","83.42%","98.00%","97.41%","99.19%","98.02%","57.15%","69.48%","68.61%","89.57%","66.85%","95.60%","77.86%","76.11%","54.31%","23.06%","24.61%","26.47%"],["[MiniMax-Video-01](https://platform.minimaxi.com/)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/16U3ANjXcRhFaC78zqF9pVL1B-H-PIV5c/view?usp=drive_link)","VBench Team"," [API](https://www.minimaxi.com/en/news/video-generation-api)","2024-10-01","83.41%","84.85%","77.65%","83.41%","97.51%","97.05%","99.10%","99.22%","64.91%","63.03%","67.17%","87.83%","76.04%","92.40%","90.36%","75.50%","50.68%","20.06%","25.63%","27.10%"],["[Kling 1.6](https://klingai.kuaishou.com/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1DGnYY6yu_0DwtLevxYuNDcP69egQSWva)","VBench Team"," [API](https://klingai.kuaishou.com/)","2025-05-08","83.40%","85.00%","76.99%","83.40%","97.40%","96.84%","98.64%","99.13%","62.22%","64.81%","69.70%","93.34%","63.99%","96.20%","81.26%","79.08%","55.57%","20.75%","24.51%","26.04%"],["[Wan2.1-T2V-1.3B (2025-05-03)](https://github.com/Wan-Video/Wan2.1/tree/main)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1jJmhAzgg_p0mhp5TNPgVT3hUUUaSX1Xo?usp=drive_link)","VBench Team"," [Open Source](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)","2025-05-03","83.31%","85.23%","75.65%","83.31%","97.56%","97.93%","99.55%","98.52%","65.19%","65.46%","67.01%","88.81%","74.83%","94.00%","89.20%","73.04%","41.96%","21.81%","23.13%","25.50%"],["[HunyuanVideo (Open-Source Version)](https://github.com/Tencent/HunyuanVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1gjg9fO6_k5OIRAZtqIIxXd6-k4c1Tjb4/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/Tencent/HunyuanVideo)","2024-12-16","83.24%","85.09%","75.82%","83.24%","97.37%","97.76%","99.44%","98.99%","70.83%","60.36%","67.56%","86.10%","68.55%","94.40%","91.60%","68.68%","53.88%","19.80%","23.89%","26.44%"],["[Wan2.2-T2V-A14B (w/o prompt-optimized)](https://github.com/Wan-Video/Wan2.2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1Zb3YQr2YKXY2WqxcI_s0uSeup7Lw5klL)","VBench Team","[Open Source](https://github.com/Wan-Video/Wan2.2)","2026-02-18","82.61%","85.03%","72.92%","82.61%","97.46%","96.67%","98.92%","97.93%","68.24%","63.52%","71.69%","85.04%","74.61%","83.40%","88.93%","80.22%","34.38%","20.27%","23.13%","24.68%"],["[Gen-3 (2024-07)](https://runwayml.com/ai-tools/gen-3-alpha/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/0/folders/1AFV48EOAXydz2ZB-q2ml7b0ojYrAsl-K)","VBench Team"," [API](https://runwayml.com/research/introducing-gen-3-alpha)","2024-07-25","82.32%","84.11%","75.17%","82.32%","97.10%","96.62%","98.61%","99.23%","60.14%","63.34%","66.82%","87.81%","53.64%","96.40%","80.90%","65.09%","54.57%","24.31%","24.71%","26.69%"],["[Vchitect-2.0 (VEnhancer)](https://github.com/Vchitect/Vchitect-2.0)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1G7M_cz1VoigVQLCuSL9lPSX_Yv6N8Vb_?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/Vchitect/Vchitect-2.0)","2024-09-20","82.24%","83.54%","77.06%","82.24%","96.83%","96.66%","98.57%","98.98%","63.89%","60.41%","65.35%","86.61%","68.84%","97.20%","87.04%","57.55%","56.57%","23.73%","25.01%","27.57%"],["[CogVideoX1.5-5B (5s SAT prompt-optimized)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/13beSJsoQiJpjS5LiIqeZP3X7TXs2CJRe/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/THUDM/CogVideo)","2024-11-15","82.17%","82.78%","79.76%","82.17%","96.87%","97.35%","98.88%","98.31%","50.93%","62.79%","65.02%","87.47%","69.65%","97.20%","87.55%","80.25%","52.91%","24.89%","25.19%","27.30%"],["[CogVideoX1.5-5B](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1v2UBa8XdUlpWwHwSDpNRVWad_pJfAtWR?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2025-04-21","82.01%","82.72%","79.17%","82.01%","96.56%","96.81%","98.53%","98.15%","56.16%","62.07%","65.34%","83.42%","67.28%","97.60%","88.40%","79.43%","53.28%","24.68%","25.42%","27.42%"],["[Jimeng](https://jimeng.jianying.com/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/1lPJp8qspt5h6H6OTX37-BSl73DlLezOL?usp=drive_link)","VBench Team"," [API](https://jimeng.jianying.com/)","2024-11-15","81.97%","83.29%","76.69%","81.97%","97.25%","98.39%","99.03%","98.09%","38.43%","68.80%","67.09%","89.62%","69.08%","90.10%","89.05%","77.45%","44.94%","22.27%","24.70%","27.10%"],["[RepVideo](https://vchitect.github.io/RepVid-Webpage)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1H4eL4SOgidlOZeFPhX_4nzef7OGqpOQM/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/Vchitect/RepVideo)","2025-01-16","81.94%","82.70%","78.91%","81.94%","96.25%","96.56%","99.16%","98.13%","57.78%","62.40%","63.16%","87.83%","71.18%","98.00%","82.51%","74.74%","52.96%","25.12%","25.31%","26.96%"],["[CogVideoX-5B (Diffusers)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1FSAccPXyJR_uw5ldkQJAMzIVphLRuh39/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2025-03-04","81.91%","83.05%","77.33%","81.91%","96.45%","96.71%","98.97%","97.20%","69.51%","61.88%","63.33%","85.07%","63.94%","98.60%","83.03%","68.91%","51.96%","24.98%","25.42%","27.65%"],["[Vidu](https://www.vidu.studio/)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1s_kH08rHeHxTcNH07cyWCiv48_vhDxFc/view?usp=drive_link)","VBench Team"," [API](https://www.vidu.studio/zh)","2024-11-15","81.89%","83.85%","74.04%","81.89%","94.63%","96.55%","99.08%","97.71%","82.64%","60.87%","63.32%","88.43%","61.68%","97.40%","83.24%","66.18%","46.07%","21.54%","23.79%","26.47%"],["[Kling (2024-07 high-performance mode)](https://klingai.kuaishou.com/)","🥇 Gold","[VBench Team](https://drive.google.com/drive/u/1/folders/1g5Y9j2gb9I5FUg4Ql28jSCCPH-Pv-HDg)","VBench Team"," [API](https://klingai.kuaishou.com/)","2024-08-01","81.85%","83.39%","75.68%","81.85%","98.33%","97.60%","99.30%","99.40%","46.94%","61.21%","65.62%","87.24%","68.05%","93.40%","89.90%","73.03%","50.86%","19.62%","24.17%","26.42%"],["[Step-Video-T2V](https://yuewen.cn/videos)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/124XdmyfZOjnrHy9DPMTwvdVANOgVJJBQ/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/stepfun-ai/Step-Video-T2V)","2025-03-13","81.83%","84.46%","71.28%","81.83%","98.05%","97.67%","99.40%","99.08%","53.06%","61.23%","70.63%","80.56%","50.55%","94.00%","88.25%","71.47%","24.38%","23.17%","26.01%","27.12%"],["[Open-Sora-2.0](https://hpcaitech.github.io/Open-Sora/)","🥈 Silver ","[Open-Sora Team](https://drive.google.com/drive/folders/1TnABYBauOJicjpYkxW2ixr_t_klD0S67?usp=drive_link)","VBench Team"," [Open Source](https://hpcaitech.github.io/Open-Sora/)","2025-03-14","81.71%","82.10%","80.14%","81.71%","98.75%","98.00%","99.40%","99.49%","20.74%","64.33%","65.62%","94.50%","77.72%","95.40%","85.98%","76.18%","52.71%","22.98%","25.91%","27.57%"],["[CogVideoX-5B (SAT prompt-optimized)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/11KOdeSHxjRqplpy3sYNsQtJyYm416sTk/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/THUDM/CogVideo)","2024-09-02","81.61%","82.75%","77.04%","81.61%","96.23%","96.52%","98.66%","96.92%","70.97%","61.98%","62.90%","85.23%","62.11%","99.40%","82.81%","66.35%","53.20%","24.91%","25.38%","27.59%"],["[Vchitect-2.0-2B](https://github.com/Vchitect/Vchitect-2.0)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1wy52woeJ3Tf3G54TyrjHtFP94oRVYFdF/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/Vchitect/Vchitect-2.0)","2024-09-16","81.57%","82.51%","77.79%","81.57%","96.42%","96.53%","98.45%","97.76%","58.33%","61.47%","65.60%","87.81%","69.35%","97.00%","86.87%","54.64%","57.51%","24.93%","25.56%","28.01%"],["[CogVideoX-2B (Diffusers)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1qFf0GAYFZ4aF5jAI_n4HsNP5tMN3l1y2/view?usp=drive_link)","VBench Team"," [Open Source](https://github.com/THUDM/CogVideo)","2025-03-03","81.55%","82.48%","77.81%","81.55%","96.52%","96.39%","98.85%","97.51%","64.79%","61.07%","62.37%","86.48%","66.59%","97.80%","83.01%","74.27%","50.04%","24.94%","25.08%","27.33%"],["[CogVideoX-2B (SAT prompt-optimized)](https://github.com/THUDM/CogVideo)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1zuQ47Uvze4157o4YMta0Zqz9G8TdHcXZ/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/THUDM/CogVideo)","2024-08-19","80.91%","82.18%","75.83%","80.91%","96.78%","96.63%","98.89%","97.73%","59.86%","60.82%","61.68%","83.37%","62.63%","98.00%","79.41%","69.90%","51.14%","24.80%","24.36%","26.66%"],["[Mochi-1](https://github.com/genmoai/models)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1H-iSGNs9l9FGIsc-8iFHqAguNol26-bz/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/genmoai/models)","2024-11-07","80.13%","82.64%","70.08%","80.13%","96.99%","97.28%","99.40%","99.02%","61.85%","56.94%","60.64%","86.51%","50.47%","94.60%","79.73%","69.24%","36.99%","20.33%","23.65%","25.15%"],["[LTX-Video (5s 768×512)](https://github.com/Lightricks/LTX-Video)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1eWFEars7HIL3Vkf0dFGolsWADE8tNA2n/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/Lightricks/LTX-Video)","2024-12-02","80.00%","82.30%","70.79%","80.00%","96.56%","97.20%","99.34%","98.96%","54.35%","59.81%","60.28%","83.45%","45.43%","92.80%","81.45%","65.43%","51.07%","21.47%","22.62%","25.19%"],["[OpenSora V1.2 (8s)](https://github.com/hpcaitech/Open-Sora)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1NMIKt3v01xsR6C32hTMt9ZRmRtSHo-uz/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/hpcaitech/Open-Sora)","2024-09-02","79.76%","81.35%","73.39%","79.76%","96.75%","97.61%","99.53%","98.50%","42.39%","56.85%","63.34%","82.22%","51.83%","91.20%","90.08%","68.56%","42.44%","23.95%","24.54%","26.85%"],["[LTX-2 (Diffusers) (w/o prompt-optimized)](https://huggingface.co/docs/diffusers/main/en/api/pipelines/ltx2)","🥇 Gold","[VBench Team](https://drive.google.com/drive/folders/14UgMZ-e9_PYgEeOmlpGvYHFFnY7bFHi1)","VBench Team","[Open Source](https://github.com/Lightricks/LTX-2/tree/main)","2026-02-04","79.35%","84.10%","60.34%","79.35%","97.10%","97.52%","98.42%","98.60%","67.22%","60.55%","67.48%","58.02%","45.04%","76.20%","91.35%","58.80%","15.90%","20.79%","21.36%","22.90%"],["[OpenSoraPlan V1.1](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1zsg-HPiqYZJoryTXw6cG_9deBlIbZN87/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","2024-07-17","78.00%","80.91%","66.38%","78.00%","95.73%","96.73%","99.03%","98.28%","47.72%","56.85%","62.28%","76.30%","40.35%","86.80%","89.19%","53.11%","27.17%","22.90%","23.87%","26.52%"],["[OpenSoraPlan V1.3](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1VHqTvac__eWeX4PBCxoYoaWwx5UGHkuy/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/PKU-YuanGroup/Open-Sora-Plan)","2024-11-07","77.23%","80.14%","65.62%","77.23%","97.79%","97.24%","99.20%","99.05%","30.28%","60.42%","56.21%","85.56%","43.58%","86.80%","79.30%","51.61%","36.73%","20.03%","22.47%","24.47%"],["[OpenSora V1.1](https://github.com/hpcaitech/Open-Sora)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1mGxjDIf7IT_mNibG8Nmg3E1WcXYRVDoo/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/hpcaitech/Open-Sora)","2024-07-17","75.66%","77.74%","67.36%","75.66%","92.35%","97.52%","98.31%","92.78%","82.14%","50.12%","54.90%","86.76%","40.97%","84.20%","74.56%","52.47%","38.63%","23.50%","23.86%","26.37%"],["[Mira](https://github.com/mira-space/Mira)","🥇 Gold","[VBench Team](https://drive.google.com/file/d/1lx0evF0HN0jY3FQ41RhQL9UJbOa-gve6/view?usp=drive_link)","VBench Team"," [OpenSource](https://github.com/mira-space/Mira)","2024-07-17","71.87%","78.78%","44.21%","71.87%","96.23%","96.92%","98.29%","97.54%","60.33%","42.51%","60.16%","52.06%","12.52%","63.80%","42.24%","27.83%","16.34%","21.89%","18.77%","18.72%"]],"metadata":null},"headers":["Model Name (clickable)","Certification","Sampled by","Evaluated by","Accessibility","Date","Total Score","Quality Score","Semantic Score","Selected Score","subject consistency","background consistency","temporal flickering","motion smoothness","dynamic degree","aesthetic quality","imaging quality","object class","multiple objects","human action","color","spatial relationship","scene","appearance style","temporal style","overall consistency"],"row_count":[1,"dynamic"],"col_count":[26,"dynamic"],"datatype":["markdown","markdown","markdown","markdown","markdown","markdown","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number","number"],"type":"pandas","latex_delimiters":[{"left":"$$","right":"$$","display":true}],"show_label":true,"height":500,"min_width":160,"interactive":false,"visible":true,"elem_classes":[],"wrap":false,"line_breaks":true,"column_widths":[],"name":"dataframe","_selectable":false},"skip_api":false,"component_class_id":"2f74a641e325b504d0304a93a36d57b1","key":null,"api_info":{"properties":{"headers":{"items":{"type":"string"},"title":"Headers","type":"array"},"data":{"items":{"items":{},"type":"array"},"title":"Data","type":"array"},"metadata":{"anyOf":[{"additionalProperties":{"anyOf":[{"items":{},"type":"array"},{"type":"null"}]},"type":"object"},{"type":"null"}],"default":null,"title":"Metadata"}},"required":["headers","data"],"title":"DataframeData","type":"object"},"example_inputs":{"headers":["a","b"],"data":[["foo","bar"]]}},{"id":91,"type":"tabitem","props":{"label":"VBench Trust-Worthiness","visible":true,"interactive":true,"id":6,"elem_id":"vbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":92,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":93,"type":"accordion","props":{"label":"Citation","open":false,"visible":true,"name":"accordion"},"skip_api":true,"component_class_id":"0df114fd8de6af8172659b1981001379","key":null},{"id":94,"type":"textbox","props":{"value":"@article{zheng2025vbench2,\n        title={VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness},\n        author={Zheng, Dian and Huang, Ziqi and Liu, Hongbo and Zou, Kai and He, Yinan and Zhang, Fan and Zhang, Yuanhan and He, Jingwen and Zheng, Wei-Shi and Qiao, Yu and Liu, Ziwei},\n        journal={arXiv preprint arXiv:2503.21755},\n        year={2025}\n}","lines":14,"max_lines":20,"label":"Copy the following snippet to cite these results","show_label":true,"container":true,"min_width":160,"visible":true,"elem_id":"citation-button","autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":95,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":96,"type":"markdown","props":{"value":"    ","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":97,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":98,"type":"checkbox","props":{"value":false,"label":"Sampled by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":99,"type":"checkbox","props":{"value":true,"label":"Evaluated by VBench Team (Uncheck to view all submissions)","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":100,"type":"checkbox","props":{"value":false,"label":"Only show 🥇 Gold","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkbox","_selectable":false},"skip_api":false,"component_class_id":"2285567cae33a56f8809dda0d15c250f","key":null,"api_info":{"type":"boolean"},"example_inputs":true},{"id":101,"type":"form","props":{"scale":3,"min_width":480,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":102,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":103,"type":"checkboxgroup","props":{"choices":[["Culture Fairness","Culture Fairness"],["Skin Bias","Skin Bias"],["Gender Bias","Gender Bias"],["Safety","Safety"]],"value":["Culture Fairness","Skin Bias","Gender Bias","Safety"],"type":"value","label":"Evaluation Dimension","show_label":true,"container":true,"min_width":160,"interactive":true,"visible":true,"elem_classes":[],"name":"checkboxgroup","_selectable":false},"skip_api":false,"component_class_id":"f3c90df7ca414d587f1946e7c68c8f37","key":null,"api_info":{"items":{"enum":["Culture Fairness","Skin Bias","Gender Bias","Safety"],"type":"string"},"title":"Checkbox Group","type":"array"},"example_inputs":["Culture Fairness"]},{"id":104,"type":"form","props":{"scale":1,"min_width":160,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":105,"type":"dataframe","props":{"value":{"headers":["Model Name","Certification","Sampled by","Evaluated by","Accessibility","Date","Culture Fairness","Skin Bias","Gender Bias","Safety"],"data":[["VideoCrafter0.9","🥇 Gold","VBench Team","VBench Team","Open Source","7/24/24","74.76%","17.56%","39.57%","42.00%"],["VideoCrafter2.0","🥇 Gold","VBench Team","VBench Team","Open Source","7/24/24","84.92%","30.94%","14.25%","54.33%"],["Lavie512","🥇 Gold","VBench Team","VBench Team","Open Source","7/24/24","81.59%","13.38%","22.91%","50.11%"],["Modelscope","🥇 Gold","VBench Team","VBench Team","Open Source","7/24/24","81.75%","28.44%","36.70%","41.22%"],["Show1","🥇 Gold","VBench Team","VBench Team","Open Source","7/24/24","79.21%","20.61%","16.68%","43.89%"],["CogVideo","🥇 Gold","VBench Team","VBench Team","Open Source","7/24/24","49.29%","15.08%","21.59%","42.11%"]],"metadata":null},"headers":["Model Name","Certification","Sampled by","Evaluated by","Accessibility","Date","Culture Fairness","Skin Bias","Gender Bias","Safety"],"row_count":[1,"dynamic"],"col_count":[10,"dynamic"],"datatype":["markdown","markdown","markdown","markdown","markdown","markdown","number","number","number","number"],"type":"pandas","latex_delimiters":[{"left":"$$","right":"$$","display":true}],"show_label":true,"height":500,"min_width":160,"interactive":false,"visible":true,"elem_classes":[],"wrap":false,"line_breaks":true,"column_widths":[],"name":"dataframe","_selectable":false},"skip_api":false,"component_class_id":"2f74a641e325b504d0304a93a36d57b1","key":null,"api_info":{"properties":{"headers":{"items":{"type":"string"},"title":"Headers","type":"array"},"data":{"items":{"items":{},"type":"array"},"title":"Data","type":"array"},"metadata":{"anyOf":[{"additionalProperties":{"anyOf":[{"items":{},"type":"array"},{"type":"null"}]},"type":"object"},{"type":"null"}],"default":null,"title":"Metadata"}},"required":["headers","data"],"title":"DataframeData","type":"object"},"example_inputs":{"headers":["a","b"],"data":[["foo","bar"]]}},{"id":106,"type":"tabitem","props":{"label":"📝 About","visible":true,"interactive":true,"id":7,"elem_id":"mvbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":107,"type":"markdown","props":{"value":"VBench, a comprehensive benchmark suite for video generative models. We design a comprehensive and hierarchical Evaluation Dimension Suite to decompose \"video generation quality\" into multiple well-defined dimensions to facilitate fine-grained and objective evaluation. For each dimension and each content category, we carefully design a Prompt Suite as test cases, and sample Generated Videos from a set of video generation models. For each evaluation dimension, we specifically design an Evaluation Method Suite, which uses carefully crafted method or designated pipeline for automatic objective evaluation. We also conduct Human Preference Annotation for the generated videos for each dimension, and show that VBench evaluation results are well aligned with human perceptions. VBench can provide valuable insights from multiple perspectives.","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":108,"type":"tabitem","props":{"label":"🚀 [T2V]Submit here! ","visible":true,"interactive":true,"id":8,"elem_id":"mvbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":109,"type":"markdown","props":{"value":"# VBench Leaderboard\n\n*\"Which Video Generation Model is better?\"*  \n🏆 Welcome to the leaderboard of the **VBench**! 🎦 *A Comprehensive Benchmark Suite for Video Generative Models* (**CVPR 2024 Spotlight**)   [![Code](https://img.shields.io/github/stars/Vchitect/VBench.svg?style=social&label=Official)](https://github.com/Vchitect/VBench) \n<div style=\"display: flex; flex-wrap: wrap; align-items: center; gap: 10px;\">\n<a href='https://arxiv.org/abs/2311.17982'><img src='https://img.shields.io/badge/cs.CV-Paper-b31b1b?logo=arxiv&logoColor=red'></a>\n<a href='https://vchitect.github.io/VBench-project/'><img src='https://img.shields.io/badge/VBench-Website-green?logo=googlechrome&logoColor=green'></a>\n<a href='https://pypi.org/project/vbench/'><img src='https://img.shields.io/pypi/v/vbench'></a>\n<a href='https://www.youtube.com/watch?v=7IhCC8Qqn8Y'><img src='https://img.shields.io/badge/YouTube-Video-c4302b?logo=youtube&logoColor=red'></a>\n<a href='https://hits.seeyoufarm.com'><img src='https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2FVchitect%2FVBench&count_bg=%23FFA500&title_bg=%23555555&icon=&icon_color=%23E7E7E7&title=visitors&edge_flat=false'></a>\n</div>\n\n- **Comprehensive Dimensions:** We carefully decompose video generation quality into 16 comprehensive dimensions to reveal individual model's strengths and weaknesses.\n- **Human Alignment:** We conducted extensive experiments and human annotations to validate robustness of VBench.\n- **Valuable Insights:** VBench provides multi-perspective insights useful for the community.  \n\n**Join Leaderboard**: Please see the [instructions](https://github.com/Vchitect/VBench/tree/master?tab=readme-ov-file#trophy-leaderboard) for 3 options to participate. One option is to follow [VBench Usage info](https://github.com/Vchitect/VBench?tab=readme-ov-file#usage), and upload the generated `result.json` file here. After clicking the `Submit here!` button, click the `Refresh` button.\n**Get VBench Certified: Gold & Silver & Bronze Tiers**： \nWe encourage developers of closed-source models to provide API access to us for evaluation via VBench.\nModels are certified under VBench based on the transparency and rigor of the evaluation process:\n🥇 Gold – Sampled and evaluated by the VBench team\n🥈 Silver – Sampled by a partner team, evaluated by the VBench team\n🥉 Bronze – Sampled by the model’s own team, evaluated by the VBench team\nThis certification helps ensure fair, consistent, and reproducible comparisons across models — making it easier for the community to track progress and identify strengths and weaknesses.\n\n**Ready to participate?**: Contact the VBench Team at ZIQI002@e.ntu.edu.sg to submit your work and earn your certification.\n\n**Model Information**: What are the details of these Video Generation Models? See [HERE](https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)\n\n**Credits**: This leaderboard is updated and maintained by the team of [VBench Contributors](https://github.com/Vchitect/VBench?tab=readme-ov-file#muscle-vbench-contributors).","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":110,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":111,"type":"markdown","props":{"value":"# Submit on VBench Benchmark Introduction\n## 🎈\n1. Please note that you need to obtain the file `evaluation_results/*.json` by running VBench in Github. You may conduct an [Offline Check](https://github.com/Vchitect/VBench?tab=readme-ov-file#get-final-score-and-submit-to-leaderboard) before uploading.\n2. Then, pack these JSON files into a `ZIP` archive, ensuring that the top-level directory of the ZIP contains the individual JSON files. \n3. Finally, upload the ZIP archive below.\n⚠️ Uploading generated videos or images of the model is invalid!\n⚠️ Submissions that do not correctly fill in the model name and model link may be deleted by the VBench team. The contact information you filled in will not be made public. ","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":112,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":113,"type":"markdown","props":{"value":"# ✉️✨ Submit your model evaluation json file here!","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":114,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":115,"type":"markdown","props":{"value":"Here is a required field","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":116,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":117,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":118,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field","label":"Model name","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":119,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"If you need to update the previous results, please fill in this line","label":"Revision Model Name(Optional)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":120,"type":"dropdown","props":{"choices":[["Open Source","Open Source"],["Ready to Open Source","Ready to Open Source"],["API","API"],["Close","Close"]],"type":"value","allow_custom_value":false,"filterable":true,"label":"Please select the way user can access your model. You can update the content by revision_name, or contact the VBench Team.","show_label":true,"container":true,"min_width":160,"visible":true,"elem_classes":[],"name":"dropdown","_selectable":false},"skip_api":false,"component_class_id":"902cba3780940d593554601d79c5417e","key":null,"api_info":{"type":"string","enum":["Open Source","Ready to Open Source","API","Close"]},"example_inputs":"Open Source"},{"id":121,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":122,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":123,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field. If filling in the wrong information, your results may be removed.","label":"Project Page/Paper Link/Github/HuggingFace Repo","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":124,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"User Upload","label":"Your Team Name(If left blank, it will be user upload)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":125,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field","label":"E-Mail(Will not be displayed)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":126,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":127,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":128,"type":"markdown","props":{"value":"The following is optional and will be synced to [GitHub] (https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":129,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":130,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"1970-01-01","label":"Time of Publish","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":131,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Width x Height","label":"resolution","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":132,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"FPS(int)","label":"model fps","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":133,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"INT","label":"model frame count","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":134,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"float(2.0)","label":"model video length","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":135,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"optional","label":"model checkpoint","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":136,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"main","label":"github commit id","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":137,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"mp4","label":"pipeline format","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":138,"type":"form","props":{"scale":8,"min_width":1280,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":139,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":140,"type":"file","props":{"file_count":"single","type":"binary","label":"Click to Upload a ZIP File","show_label":true,"container":true,"min_width":160,"visible":true,"elem_classes":[],"name":"file","_selectable":false},"skip_api":false,"component_class_id":"0edb4c50d0e29a0d77e4cfbbb9713a1b","key":null,"api_info":{"properties":{"path":{"title":"Path","type":"string"},"url":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Url"},"size":{"anyOf":[{"type":"integer"},{"type":"null"}],"default":null,"title":"Size"},"orig_name":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Orig Name"},"mime_type":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Mime Type"},"is_stream":{"default":false,"title":"Is Stream","type":"boolean"},"meta":{"default":{"_type":"gradio.FileData"},"title":"Meta","type":"object"}},"required":["path"],"title":"FileData","type":"object"},"example_inputs":{"path":"https://github.com/gradio-app/gradio/raw/main/test/test_files/sample_file.pdf","meta":{"_type":"gradio.FileData"},"orig_name":"sample_file.pdf","url":"https://github.com/gradio-app/gradio/raw/main/test/test_files/sample_file.pdf"}},{"id":141,"type":"button","props":{"value":"Submit Eval","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":142,"type":"markdown","props":{"value":"Submit Success! Please press refresh and return to LeaderBoard!","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":false,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":143,"type":"markdown","props":{"value":"<span style=\"color:red;\">Please ensure that the `Model Name`, `Project Page`, and `Email` are filled in correctly.</span>","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":false,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":144,"type":"markdown","props":{"show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":145,"type":"tabitem","props":{"label":"🚀 [I2V]Submit here! ","visible":true,"interactive":true,"id":9,"elem_id":"mvbench-i2v-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":146,"type":"markdown","props":{"value":"# VBench Leaderboard\n\n*\"Which Video Generation Model is better?\"*  \n🏆 Welcome to the leaderboard of the **VBench**! 🎦 *A Comprehensive Benchmark Suite for Video Generative Models* (**CVPR 2024 Spotlight**)   [![Code](https://img.shields.io/github/stars/Vchitect/VBench.svg?style=social&label=Official)](https://github.com/Vchitect/VBench) \n<div style=\"display: flex; flex-wrap: wrap; align-items: center; gap: 10px;\">\n<a href='https://arxiv.org/abs/2311.17982'><img src='https://img.shields.io/badge/cs.CV-Paper-b31b1b?logo=arxiv&logoColor=red'></a>\n<a href='https://vchitect.github.io/VBench-project/'><img src='https://img.shields.io/badge/VBench-Website-green?logo=googlechrome&logoColor=green'></a>\n<a href='https://pypi.org/project/vbench/'><img src='https://img.shields.io/pypi/v/vbench'></a>\n<a href='https://www.youtube.com/watch?v=7IhCC8Qqn8Y'><img src='https://img.shields.io/badge/YouTube-Video-c4302b?logo=youtube&logoColor=red'></a>\n<a href='https://hits.seeyoufarm.com'><img src='https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2FVchitect%2FVBench&count_bg=%23FFA500&title_bg=%23555555&icon=&icon_color=%23E7E7E7&title=visitors&edge_flat=false'></a>\n</div>\n\n- **Comprehensive Dimensions:** We carefully decompose video generation quality into 16 comprehensive dimensions to reveal individual model's strengths and weaknesses.\n- **Human Alignment:** We conducted extensive experiments and human annotations to validate robustness of VBench.\n- **Valuable Insights:** VBench provides multi-perspective insights useful for the community.  \n\n**Join Leaderboard**: Please see the [instructions](https://github.com/Vchitect/VBench/tree/master?tab=readme-ov-file#trophy-leaderboard) for 3 options to participate. One option is to follow [VBench Usage info](https://github.com/Vchitect/VBench?tab=readme-ov-file#usage), and upload the generated `result.json` file here. After clicking the `Submit here!` button, click the `Refresh` button.\n**Get VBench Certified: Gold & Silver & Bronze Tiers**： \nWe encourage developers of closed-source models to provide API access to us for evaluation via VBench.\nModels are certified under VBench based on the transparency and rigor of the evaluation process:\n🥇 Gold – Sampled and evaluated by the VBench team\n🥈 Silver – Sampled by a partner team, evaluated by the VBench team\n🥉 Bronze – Sampled by the model’s own team, evaluated by the VBench team\nThis certification helps ensure fair, consistent, and reproducible comparisons across models — making it easier for the community to track progress and identify strengths and weaknesses.\n\n**Ready to participate?**: Contact the VBench Team at ZIQI002@e.ntu.edu.sg to submit your work and earn your certification.\n\n**Model Information**: What are the details of these Video Generation Models? See [HERE](https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)\n\n**Credits**: This leaderboard is updated and maintained by the team of [VBench Contributors](https://github.com/Vchitect/VBench?tab=readme-ov-file#muscle-vbench-contributors).","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":147,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":148,"type":"markdown","props":{"value":"# Submit on VBench Benchmark Introduction\n## 🎈\n1. Please note that you need to obtain the file `evaluation_results/*.json` by running VBench in Github. You may conduct an [Offline Check](https://github.com/Vchitect/VBench?tab=readme-ov-file#get-final-score-and-submit-to-leaderboard) before uploading.\n2. Then, pack these JSON files into a `ZIP` archive, ensuring that the top-level directory of the ZIP contains the individual JSON files. \n3. Finally, upload the ZIP archive below.\n⚠️ Uploading generated videos or images of the model is invalid!\n⚠️ Submissions that do not correctly fill in the model name and model link may be deleted by the VBench team. The contact information you filled in will not be made public. ","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":149,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":150,"type":"markdown","props":{"value":"# ✉️✨ Submit your i2v model evaluation json file here!","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":151,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":152,"type":"markdown","props":{"value":"Here is a required field","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":153,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":154,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":155,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field","label":"Model name","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":156,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"If you need to update the previous results, please fill in this line","label":"Revision Model Name(Optional)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":157,"type":"dropdown","props":{"choices":[["Open Source","Open Source"],["Ready to Open Source","Ready to Open Source"],["API","API"],["Close","Close"]],"type":"value","allow_custom_value":false,"filterable":true,"label":"Please select the way user can access your model. You can update the content by revision_name, or contact the VBench Team.","show_label":true,"container":true,"min_width":160,"visible":true,"elem_classes":[],"name":"dropdown","_selectable":false},"skip_api":false,"component_class_id":"902cba3780940d593554601d79c5417e","key":null,"api_info":{"type":"string","enum":["Open Source","Ready to Open Source","API","Close"]},"example_inputs":"Open Source"},{"id":158,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":159,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":160,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field. If filling in the wrong information, your results may be removed.","label":"Project Page/Paper Link/Github/HuggingFace Repo","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":161,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"User Upload","label":"Your Team Name(If left blank, it will be user upload)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":162,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field","label":"E-Mail(Will not be displayed)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":163,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":164,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":165,"type":"markdown","props":{"value":"The following is optional and will be synced to [GitHub] (https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":166,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":167,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"1970-01-01","label":"Time of Publish","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":168,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Width x Height","label":"resolution","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":169,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"FPS(int)","label":"model fps","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":170,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"INT","label":"model frame count","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":171,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"float(2.0)","label":"model video length","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":172,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"optional","label":"model checkpoint","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":173,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"main","label":"github commit id","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":174,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"mp4","label":"pipeline format","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":175,"type":"form","props":{"scale":8,"min_width":1280,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":176,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":177,"type":"file","props":{"file_count":"single","type":"binary","label":"Click to Upload a ZIP File","show_label":true,"container":true,"min_width":160,"visible":true,"elem_classes":[],"name":"file","_selectable":false},"skip_api":false,"component_class_id":"0edb4c50d0e29a0d77e4cfbbb9713a1b","key":null,"api_info":{"properties":{"path":{"title":"Path","type":"string"},"url":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Url"},"size":{"anyOf":[{"type":"integer"},{"type":"null"}],"default":null,"title":"Size"},"orig_name":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Orig Name"},"mime_type":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Mime Type"},"is_stream":{"default":false,"title":"Is Stream","type":"boolean"},"meta":{"default":{"_type":"gradio.FileData"},"title":"Meta","type":"object"}},"required":["path"],"title":"FileData","type":"object"},"example_inputs":{"path":"https://github.com/gradio-app/gradio/raw/main/test/test_files/sample_file.pdf","meta":{"_type":"gradio.FileData"},"orig_name":"sample_file.pdf","url":"https://github.com/gradio-app/gradio/raw/main/test/test_files/sample_file.pdf"}},{"id":178,"type":"button","props":{"value":"Submit Eval","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":179,"type":"markdown","props":{"value":"Submit Success! Please press refresh and retfurn to LeaderBoard!","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":false,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":180,"type":"markdown","props":{"value":"<span style=\"color:red;\">Please ensure that the `Model Name`, `Project Page`, and `Email` are filled in correctly.</span>","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":false,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":181,"type":"markdown","props":{"show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":182,"type":"tabitem","props":{"label":"⭐ [VBench2]Submit here! ","visible":true,"interactive":true,"id":10,"elem_id":"mvbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":183,"type":"markdown","props":{"value":"# VBench Leaderboard\n\n*\"Which Video Generation Model is better?\"*  \n🏆 Welcome to the leaderboard of the **VBench**! 🎦 *A Comprehensive Benchmark Suite for Video Generative Models* (**CVPR 2024 Spotlight**)   [![Code](https://img.shields.io/github/stars/Vchitect/VBench.svg?style=social&label=Official)](https://github.com/Vchitect/VBench) \n<div style=\"display: flex; flex-wrap: wrap; align-items: center; gap: 10px;\">\n<a href='https://arxiv.org/abs/2311.17982'><img src='https://img.shields.io/badge/cs.CV-Paper-b31b1b?logo=arxiv&logoColor=red'></a>\n<a href='https://vchitect.github.io/VBench-project/'><img src='https://img.shields.io/badge/VBench-Website-green?logo=googlechrome&logoColor=green'></a>\n<a href='https://pypi.org/project/vbench/'><img src='https://img.shields.io/pypi/v/vbench'></a>\n<a href='https://www.youtube.com/watch?v=7IhCC8Qqn8Y'><img src='https://img.shields.io/badge/YouTube-Video-c4302b?logo=youtube&logoColor=red'></a>\n<a href='https://hits.seeyoufarm.com'><img src='https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2FVchitect%2FVBench&count_bg=%23FFA500&title_bg=%23555555&icon=&icon_color=%23E7E7E7&title=visitors&edge_flat=false'></a>\n</div>\n\n- **Comprehensive Dimensions:** We carefully decompose video generation quality into 16 comprehensive dimensions to reveal individual model's strengths and weaknesses.\n- **Human Alignment:** We conducted extensive experiments and human annotations to validate robustness of VBench.\n- **Valuable Insights:** VBench provides multi-perspective insights useful for the community.  \n\n**Join Leaderboard**: Please see the [instructions](https://github.com/Vchitect/VBench/tree/master?tab=readme-ov-file#trophy-leaderboard) for 3 options to participate. One option is to follow [VBench Usage info](https://github.com/Vchitect/VBench?tab=readme-ov-file#usage), and upload the generated `result.json` file here. After clicking the `Submit here!` button, click the `Refresh` button.\n**Get VBench Certified: Gold & Silver & Bronze Tiers**： \nWe encourage developers of closed-source models to provide API access to us for evaluation via VBench.\nModels are certified under VBench based on the transparency and rigor of the evaluation process:\n🥇 Gold – Sampled and evaluated by the VBench team\n🥈 Silver – Sampled by a partner team, evaluated by the VBench team\n🥉 Bronze – Sampled by the model’s own team, evaluated by the VBench team\nThis certification helps ensure fair, consistent, and reproducible comparisons across models — making it easier for the community to track progress and identify strengths and weaknesses.\n\n**Ready to participate?**: Contact the VBench Team at ZIQI002@e.ntu.edu.sg to submit your work and earn your certification.\n\n**Model Information**: What are the details of these Video Generation Models? See [HERE](https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)\n\n**Credits**: This leaderboard is updated and maintained by the team of [VBench Contributors](https://github.com/Vchitect/VBench?tab=readme-ov-file#muscle-vbench-contributors).","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":184,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":185,"type":"markdown","props":{"value":"# Submit on VBench Benchmark Introduction\n## 🎈\n1. Please note that you need to obtain the file `evaluation_results/*.json` by running VBench in Github. You may conduct an [Offline Check](https://github.com/Vchitect/VBench?tab=readme-ov-file#get-final-score-and-submit-to-leaderboard) before uploading.\n2. Then, pack these JSON files into a `ZIP` archive, ensuring that the top-level directory of the ZIP contains the individual JSON files. \n3. Finally, upload the ZIP archive below.\n⚠️ Uploading generated videos or images of the model is invalid!\n⚠️ Submissions that do not correctly fill in the model name and model link may be deleted by the VBench team. The contact information you filled in will not be made public. ","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":186,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":187,"type":"markdown","props":{"value":"# ✉️✨ Submit your model evaluation json file here!","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":188,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":189,"type":"markdown","props":{"value":"Here is a required field","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":190,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":191,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":192,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field","label":"Model name","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":193,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"If you need to update the previous results, please fill in this line","label":"Revision Model Name(Optional)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":194,"type":"dropdown","props":{"choices":[["Open Source","Open Source"],["Ready to Open Source","Ready to Open Source"],["API","API"],["Close","Close"]],"type":"value","allow_custom_value":false,"filterable":true,"label":"Please select the way user can access your model. You can update the content by revision_name, or contact the VBench Team.","show_label":true,"container":true,"min_width":160,"visible":true,"elem_classes":[],"name":"dropdown","_selectable":false},"skip_api":false,"component_class_id":"902cba3780940d593554601d79c5417e","key":null,"api_info":{"type":"string","enum":["Open Source","Ready to Open Source","API","Close"]},"example_inputs":"Open Source"},{"id":195,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":196,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":197,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field. If filling in the wrong information, your results may be removed.","label":"Project Page/Paper Link/Github/HuggingFace Repo","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":198,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"User Upload","label":"Your Team Name(If left blank, it will be user upload)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":199,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field","label":"E-Mail(Will not be displayed)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":200,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":201,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":202,"type":"markdown","props":{"value":"The following is optional and will be synced to [GitHub] (https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":203,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":204,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"1970-01-01","label":"Time of Publish","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":205,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Width x Height","label":"resolution","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":206,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"FPS(int)","label":"model fps","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":207,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"INT","label":"model frame count","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":208,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"float(2.0)","label":"model video length","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":209,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"optional","label":"model checkpoint","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":210,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"main","label":"github commit id","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":211,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"mp4","label":"pipeline format","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":212,"type":"form","props":{"scale":8,"min_width":1280,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":213,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":214,"type":"file","props":{"file_count":"single","type":"binary","label":"Click to Upload a ZIP File","show_label":true,"container":true,"min_width":160,"visible":true,"elem_classes":[],"name":"file","_selectable":false},"skip_api":false,"component_class_id":"0edb4c50d0e29a0d77e4cfbbb9713a1b","key":null,"api_info":{"properties":{"path":{"title":"Path","type":"string"},"url":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Url"},"size":{"anyOf":[{"type":"integer"},{"type":"null"}],"default":null,"title":"Size"},"orig_name":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Orig Name"},"mime_type":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Mime Type"},"is_stream":{"default":false,"title":"Is Stream","type":"boolean"},"meta":{"default":{"_type":"gradio.FileData"},"title":"Meta","type":"object"}},"required":["path"],"title":"FileData","type":"object"},"example_inputs":{"path":"https://github.com/gradio-app/gradio/raw/main/test/test_files/sample_file.pdf","meta":{"_type":"gradio.FileData"},"orig_name":"sample_file.pdf","url":"https://github.com/gradio-app/gradio/raw/main/test/test_files/sample_file.pdf"}},{"id":215,"type":"button","props":{"value":"Submit Eval","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":216,"type":"markdown","props":{"value":"Submit Success! Please press refresh and return to LeaderBoard!","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":false,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":217,"type":"markdown","props":{"value":"<span style=\"color:red;\">Please ensure that the `Model Name`, `Project Page`, and `Email` are filled in correctly.</span>","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":false,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":218,"type":"markdown","props":{"show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":219,"type":"tabitem","props":{"label":"[VBench Trust_Worthiness]Submit here! ","visible":true,"interactive":true,"id":12,"elem_id":"mvbench-tab-table","name":"tab"},"skip_api":true,"component_class_id":"41bb04e5b5a12cfb323ac07af755e348","key":null},{"id":220,"type":"markdown","props":{"value":"# VBench Leaderboard\n\n*\"Which Video Generation Model is better?\"*  \n🏆 Welcome to the leaderboard of the **VBench**! 🎦 *A Comprehensive Benchmark Suite for Video Generative Models* (**CVPR 2024 Spotlight**)   [![Code](https://img.shields.io/github/stars/Vchitect/VBench.svg?style=social&label=Official)](https://github.com/Vchitect/VBench) \n<div style=\"display: flex; flex-wrap: wrap; align-items: center; gap: 10px;\">\n<a href='https://arxiv.org/abs/2311.17982'><img src='https://img.shields.io/badge/cs.CV-Paper-b31b1b?logo=arxiv&logoColor=red'></a>\n<a href='https://vchitect.github.io/VBench-project/'><img src='https://img.shields.io/badge/VBench-Website-green?logo=googlechrome&logoColor=green'></a>\n<a href='https://pypi.org/project/vbench/'><img src='https://img.shields.io/pypi/v/vbench'></a>\n<a href='https://www.youtube.com/watch?v=7IhCC8Qqn8Y'><img src='https://img.shields.io/badge/YouTube-Video-c4302b?logo=youtube&logoColor=red'></a>\n<a href='https://hits.seeyoufarm.com'><img src='https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2FVchitect%2FVBench&count_bg=%23FFA500&title_bg=%23555555&icon=&icon_color=%23E7E7E7&title=visitors&edge_flat=false'></a>\n</div>\n\n- **Comprehensive Dimensions:** We carefully decompose video generation quality into 16 comprehensive dimensions to reveal individual model's strengths and weaknesses.\n- **Human Alignment:** We conducted extensive experiments and human annotations to validate robustness of VBench.\n- **Valuable Insights:** VBench provides multi-perspective insights useful for the community.  \n\n**Join Leaderboard**: Please see the [instructions](https://github.com/Vchitect/VBench/tree/master?tab=readme-ov-file#trophy-leaderboard) for 3 options to participate. One option is to follow [VBench Usage info](https://github.com/Vchitect/VBench?tab=readme-ov-file#usage), and upload the generated `result.json` file here. After clicking the `Submit here!` button, click the `Refresh` button.\n**Get VBench Certified: Gold & Silver & Bronze Tiers**： \nWe encourage developers of closed-source models to provide API access to us for evaluation via VBench.\nModels are certified under VBench based on the transparency and rigor of the evaluation process:\n🥇 Gold – Sampled and evaluated by the VBench team\n🥈 Silver – Sampled by a partner team, evaluated by the VBench team\n🥉 Bronze – Sampled by the model’s own team, evaluated by the VBench team\nThis certification helps ensure fair, consistent, and reproducible comparisons across models — making it easier for the community to track progress and identify strengths and weaknesses.\n\n**Ready to participate?**: Contact the VBench Team at ZIQI002@e.ntu.edu.sg to submit your work and earn your certification.\n\n**Model Information**: What are the details of these Video Generation Models? See [HERE](https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)\n\n**Credits**: This leaderboard is updated and maintained by the team of [VBench Contributors](https://github.com/Vchitect/VBench?tab=readme-ov-file#muscle-vbench-contributors).","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":221,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":222,"type":"markdown","props":{"value":"# Submit on VBench Benchmark Introduction\n## 🎈\n1. Please note that you need to obtain the file `evaluation_results/*.json` by running VBench in Github. You may conduct an [Offline Check](https://github.com/Vchitect/VBench?tab=readme-ov-file#get-final-score-and-submit-to-leaderboard) before uploading.\n2. Then, pack these JSON files into a `ZIP` archive, ensuring that the top-level directory of the ZIP contains the individual JSON files. \n3. Finally, upload the ZIP archive below.\n⚠️ Uploading generated videos or images of the model is invalid!\n⚠️ Submissions that do not correctly fill in the model name and model link may be deleted by the VBench team. The contact information you filled in will not be made public. ","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":223,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":224,"type":"markdown","props":{"value":"# ✉️✨ Submit your model evaluation json file here!","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":225,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":226,"type":"markdown","props":{"value":"Here is a required field","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":227,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":228,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":229,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field","label":"Model Name","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":230,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"If you need to update the previous results, please fill in this line","label":"Revision Model Name(Optional)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":231,"type":"dropdown","props":{"choices":[["Open Source","Open Source"],["Ready to Open Source","Ready to Open Source"],["API","API"],["Close","Close"]],"type":"value","allow_custom_value":false,"filterable":true,"label":"Please select the way user can access your model. You can update the content by revision_name, or contact the VBench Team.","show_label":true,"container":true,"min_width":160,"visible":true,"elem_classes":[],"name":"dropdown","_selectable":false},"skip_api":false,"component_class_id":"902cba3780940d593554601d79c5417e","key":null,"api_info":{"type":"string","enum":["Open Source","Ready to Open Source","API","Close"]},"example_inputs":"Open Source"},{"id":232,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":233,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":234,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field. If filling in the wrong information, your results may be removed.","label":"Project Page/Paper Link/Github/HuggingFace Repo","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":235,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"User Upload","label":"Your Team Name(If left blank, it will be user upload)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":236,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Required field","label":"E-Mail(Will not be displayed)","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":237,"type":"form","props":{"scale":0,"min_width":0,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":238,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":239,"type":"markdown","props":{"value":"The following is optional and will be synced to [GitHub] (https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models)","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":240,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":241,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"1970-01-01","label":"Time of Publish","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":242,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"Width x Height","label":"resolution","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":243,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"FPS(int)","label":"model fps","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":244,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"INT","label":"model frame count","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":245,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"float(2.0)","label":"model video length","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":246,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"optional","label":"model checkpoint","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":247,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"main","label":"github commit id","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":248,"type":"textbox","props":{"lines":1,"max_lines":20,"placeholder":"mp4","label":"pipeline format","show_label":true,"container":true,"min_width":160,"visible":true,"autofocus":false,"autoscroll":true,"elem_classes":[],"type":"text","rtl":false,"show_copy_button":false,"name":"textbox","_selectable":false},"skip_api":false,"component_class_id":"eacc6f7a8769a0bf4abe77bcd0b4ee73","key":null,"api_info":{"type":"string"},"example_inputs":"Hello!!"},{"id":249,"type":"form","props":{"scale":8,"min_width":1280,"name":"form"},"skip_api":true,"component_class_id":"4591fc49a1d8a2aeddcb8e8a41555f33","key":null},{"id":250,"type":"column","props":{"scale":1,"min_width":320,"variant":"default","visible":true,"show_progress":false,"name":"column"},"skip_api":true,"component_class_id":"c964ea867df9c8a88841258146474d35","key":null},{"id":251,"type":"file","props":{"file_count":"single","type":"binary","label":"Click to Upload a ZIP File","show_label":true,"container":true,"min_width":160,"visible":true,"elem_classes":[],"name":"file","_selectable":false},"skip_api":false,"component_class_id":"0edb4c50d0e29a0d77e4cfbbb9713a1b","key":null,"api_info":{"properties":{"path":{"title":"Path","type":"string"},"url":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Url"},"size":{"anyOf":[{"type":"integer"},{"type":"null"}],"default":null,"title":"Size"},"orig_name":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Orig Name"},"mime_type":{"anyOf":[{"type":"string"},{"type":"null"}],"default":null,"title":"Mime Type"},"is_stream":{"default":false,"title":"Is Stream","type":"boolean"},"meta":{"default":{"_type":"gradio.FileData"},"title":"Meta","type":"object"}},"required":["path"],"title":"FileData","type":"object"},"example_inputs":{"path":"https://github.com/gradio-app/gradio/raw/main/test/test_files/sample_file.pdf","meta":{"_type":"gradio.FileData"},"orig_name":"sample_file.pdf","url":"https://github.com/gradio-app/gradio/raw/main/test/test_files/sample_file.pdf"}},{"id":252,"type":"button","props":{"value":"Submit Eval","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null},{"id":253,"type":"markdown","props":{"value":"Submit Success! Please press refresh and return to LeaderBoard!","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":false,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":254,"type":"markdown","props":{"value":"<span style=\"color:red;\">Please ensure that the `Model Name`, `Project Page`, and `Email` are filled in correctly.</span>","show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":false,"elem_classes":["markdown-text"],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":255,"type":"markdown","props":{"show_label":true,"rtl":false,"latex_delimiters":[{"left":"$$","right":"$$","display":true}],"visible":true,"elem_classes":[],"sanitize_html":true,"line_breaks":false,"header_links":false,"name":"markdown","_selectable":false},"skip_api":false,"component_class_id":"2f8e7f1b22b4753d076370b7e0c1a8b2","key":null,"api_info":{"type":"string"},"example_inputs":"# Hello!"},{"id":256,"type":"row","props":{"variant":"default","visible":true,"equal_height":true,"show_progress":false,"name":"row"},"skip_api":true,"component_class_id":"4d8167e07370ad8901f04005ae5f2331","key":null},{"id":257,"type":"button","props":{"value":"Refresh","variant":"secondary","visible":true,"interactive":true,"elem_classes":[],"name":"button","_selectable":false},"skip_api":true,"component_class_id":"79a4594d8e4223caf87a17cbd75b3d32","key":null}],"css":null,"connect_heartbeat":true,"js":null,"head":null,"title":"Gradio","space_id":"Vchitect/VBench_Leaderboard","enable_queue":true,"show_error":false,"show_api":true,"is_colab":false,"max_file_size":null,"stylesheets":["https://fonts.googleapis.com/css2?family=Source+Sans+Pro:wght@400;600&display=swap","https://fonts.googleapis.com/css2?family=IBM+Plex+Mono:wght@400;600&display=swap"],"theme":"default","protocol":"sse_v3","body_css":{"body_background_fill":"white","body_text_color":"#1f2937","body_background_fill_dark":"#0b0f19","body_text_color_dark":"#f3f4f6"},"fill_height":false,"theme_hash":"aa3cf5a76ff4ff3d05b407358c4a85aa7a55a3f5751b53d49cba0b8d49a6c148","layout":{"id":0,"children":[{"id":1},{"id":2,"children":[{"id":3,"children":[{"id":4,"children":[{"id":5,"children":[{"id":7,"children":[{"id":6}]}]}]},{"id":8},{"id":9,"children":[{"id":10,"children":[{"id":11},{"id":12},{"id":13}]},{"id":14,"children":[{"id":19,"children":[{"id":15},{"id":16},{"id":17},{"id":18}]}]}]},{"id":20}]},{"id":21,"children":[{"id":22,"children":[{"id":23,"children":[{"id":25,"children":[{"id":24}]}]}]},{"id":26},{"id":27,"children":[{"id":31,"children":[{"id":28},{"id":29},{"id":30}]}]},{"id":32,"children":[{"id":33},{"id":34},{"id":35},{"id":36},{"id":37}]},{"id":38,"children":[{"id":40,"children":[{"id":39}]}]},{"id":41},{"id":42},{"id":43},{"id":44},{"id":45},{"id":46}]},{"id":47,"children":[{"id":48,"children":[{"id":50,"children":[{"id":49}]}]},{"id":51,"children":[{"id":52,"children":[{"id":54,"children":[{"id":53}]}]}]},{"id":55}]},{"id":56,"children":[{"id":57,"children":[{"id":59,"children":[{"id":58}]}]},{"id":60,"children":[{"id":61,"children":[{"id":62,"children":[{"id":66,"children":[{"id":63},{"id":64},{"id":65}]}]},{"id":68,"children":[{"id":67}]}]}]},{"id":69}]},{"id":70,"children":[{"id":71,"children":[{"id":72,"children":[{"id":74,"children":[{"id":73}]}]}]},{"id":75},{"id":76,"children":[{"id":77,"children":[{"id":78},{"id":79},{"id":80},{"id":81}]},{"id":82,"children":[{"id":83,"children":[{"id":87,"children":[{"id":84},{"id":85},{"id":86}]}]},{"id":89,"children":[{"id":88}]}]}]},{"id":90}]},{"id":91,"children":[{"id":92,"children":[{"id":93,"children":[{"id":95,"children":[{"id":94}]}]}]},{"id":96},{"id":97,"children":[{"id":101,"children":[{"id":98},{"id":99},{"id":100}]}]},{"id":102,"children":[{"id":104,"children":[{"id":103}]}]},{"id":105}]},{"id":106,"children":[{"id":107}]},{"id":108,"children":[{"id":109},{"id":110,"children":[{"id":111}]},{"id":112,"children":[{"id":113}]},{"id":114,"children":[{"id":115}]},{"id":116,"children":[{"id":117,"children":[{"id":121,"children":[{"id":118},{"id":119},{"id":120}]}]},{"id":122,"children":[{"id":126,"children":[{"id":123},{"id":124},{"id":125}]}]}]},{"id":127,"children":[{"id":128}]},{"id":129,"children":[{"id":138,"children":[{"id":130},{"id":131},{"id":132},{"id":133},{"id":134},{"id":135},{"id":136},{"id":137}]}]},{"id":139,"children":[{"id":140},{"id":141},{"id":142},{"id":143},{"id":144}]}]},{"id":145,"children":[{"id":146},{"id":147,"children":[{"id":148}]},{"id":149,"children":[{"id":150}]},{"id":151,"children":[{"id":152}]},{"id":153,"children":[{"id":154,"children":[{"id":158,"children":[{"id":155},{"id":156},{"id":157}]}]},{"id":159,"children":[{"id":163,"children":[{"id":160},{"id":161},{"id":162}]}]}]},{"id":164,"children":[{"id":165}]},{"id":166,"children":[{"id":175,"children":[{"id":167},{"id":168},{"id":169},{"id":170},{"id":171},{"id":172},{"id":173},{"id":174}]}]},{"id":176,"children":[{"id":177},{"id":178},{"id":179},{"id":180},{"id":181}]}]},{"id":182,"children":[{"id":183},{"id":184,"children":[{"id":185}]},{"id":186,"children":[{"id":187}]},{"id":188,"children":[{"id":189}]},{"id":190,"children":[{"id":191,"children":[{"id":195,"children":[{"id":192},{"id":193},{"id":194}]}]},{"id":196,"children":[{"id":200,"children":[{"id":197},{"id":198},{"id":199}]}]}]},{"id":201,"children":[{"id":202}]},{"id":203,"children":[{"id":212,"children":[{"id":204},{"id":205},{"id":206},{"id":207},{"id":208},{"id":209},{"id":210},{"id":211}]}]},{"id":213,"children":[{"id":214},{"id":215},{"id":216},{"id":217},{"id":218}]}]},{"id":219,"children":[{"id":220},{"id":221,"children":[{"id":222}]},{"id":223,"children":[{"id":224}]},{"id":225,"children":[{"id":226}]},{"id":227,"children":[{"id":228,"children":[{"id":232,"children":[{"id":229},{"id":230},{"id":231}]}]},{"id":233,"children":[{"id":237,"children":[{"id":234},{"id":235},{"id":236}]}]}]},{"id":238,"children":[{"id":239}]},{"id":240,"children":[{"id":249,"children":[{"id":241},{"id":242},{"id":243},{"id":244},{"id":245},{"id":246},{"id":247},{"id":248}]}]},{"id":250,"children":[{"id":251},{"id":252},{"id":253},{"id":254},{"id":255}]}]}]},{"id":256,"children":[{"id":257}]}]},"dependencies":[{"id":0,"targets":[[11,"click"]],"inputs":[],"outputs":[18],"backend_fn":true,"js":null,"queue":true,"api_name":"choose_all_quailty","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":1,"targets":[[null,"then"]],"inputs":[18,15,16],"outputs":[20],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":0,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":2,"targets":[[12,"click"]],"inputs":[],"outputs":[18],"backend_fn":true,"js":null,"queue":true,"api_name":"choose_all_semantic","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":3,"targets":[[null,"then"]],"inputs":[18,15,16],"outputs":[20],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":2,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":4,"targets":[[13,"click"]],"inputs":[],"outputs":[18],"backend_fn":true,"js":null,"queue":true,"api_name":"disable_all","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":5,"targets":[[null,"then"]],"inputs":[18,15,16],"outputs":[20],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":4,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":6,"targets":[[18,"change"]],"inputs":[18,15,16,17],"outputs":[20],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_3","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":7,"targets":[[15,"change"]],"inputs":[18,15,16,17],"outputs":[20],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_4","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":8,"targets":[[16,"change"]],"inputs":[18,15,16,17],"outputs":[20],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_5","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":9,"targets":[[17,"change"]],"inputs":[18,15,16,17],"outputs":[20],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_6","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":10,"targets":[[28,"change"]],"inputs":[39,28,29,30],"outputs":[41],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_2_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":11,"targets":[[29,"change"]],"inputs":[39,28,29,30],"outputs":[41],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_2_2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":12,"targets":[[30,"change"]],"inputs":[39,28,29,30],"outputs":[41],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_2_3","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":13,"targets":[[33,"click"]],"inputs":[42,28,29,30],"outputs":[41,39],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_score_change_2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":14,"targets":[[34,"click"]],"inputs":[43,28,29,30],"outputs":[41,39],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_score_change_2_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":15,"targets":[[35,"click"]],"inputs":[44,28,29,30],"outputs":[41,39],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_score_change_2_2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":16,"targets":[[36,"click"]],"inputs":[45,28,29,30],"outputs":[41,39],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_score_change_2_3","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":17,"targets":[[37,"click"]],"inputs":[46,28,29,30],"outputs":[41,39],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_score_change_2_4","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":18,"targets":[[53,"change"]],"inputs":[53],"outputs":[55],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_quality","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":19,"targets":[[67,"change"]],"inputs":[67,63,64,65],"outputs":[69],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_i2v","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":20,"targets":[[63,"change"]],"inputs":[67,63,64,65],"outputs":[69],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_i2v_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":21,"targets":[[64,"change"]],"inputs":[67,63,64,65],"outputs":[69],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_i2v_2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":22,"targets":[[65,"change"]],"inputs":[67,63,64,65],"outputs":[69],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_i2v_3","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":23,"targets":[[78,"click"]],"inputs":[],"outputs":[88],"backend_fn":true,"js":null,"queue":true,"api_name":"choose_all_quailty_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":24,"targets":[[null,"then"]],"inputs":[88,84,85],"outputs":[90],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_long","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":23,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":25,"targets":[[79,"click"]],"inputs":[],"outputs":[88],"backend_fn":true,"js":null,"queue":true,"api_name":"choose_all_semantic_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":26,"targets":[[null,"then"]],"inputs":[88,84,85],"outputs":[90],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_long_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":25,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":27,"targets":[[80,"click"]],"inputs":[],"outputs":[88],"backend_fn":true,"js":null,"queue":true,"api_name":"enable_all","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":28,"targets":[[null,"then"]],"inputs":[88,84,85],"outputs":[90],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_long_2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":27,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":29,"targets":[[81,"click"]],"inputs":[],"outputs":[88],"backend_fn":true,"js":null,"queue":true,"api_name":"disable_all_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":30,"targets":[[null,"then"]],"inputs":[88,84,85],"outputs":[90],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_long_3","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":29,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":31,"targets":[[88,"change"]],"inputs":[88,84,85,86],"outputs":[90],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_long_4","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":32,"targets":[[84,"change"]],"inputs":[88,84,85,86],"outputs":[90],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_long_5","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":33,"targets":[[85,"change"]],"inputs":[88,84,85,86],"outputs":[90],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_long_6","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":34,"targets":[[86,"change"]],"inputs":[88,84,85,86],"outputs":[90],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_long_7","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":35,"targets":[[98,"change"]],"inputs":[103,98,99,100],"outputs":[105],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_trust","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":36,"targets":[[99,"change"]],"inputs":[103,98,99,100],"outputs":[105],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_trust_1","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":37,"targets":[[100,"change"]],"inputs":[103,98,99,100],"outputs":[105],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_trust_2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"always_last","show_api":true,"zerogpu":false,"rendered_in":null},{"id":38,"targets":[[141,"click"]],"inputs":[140,118,119,123,124,125,130,120,131,132,133,134,135,136,137],"outputs":[141,142,143],"backend_fn":true,"js":null,"queue":true,"api_name":"add_new_eval","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":39,"targets":[[178,"click"]],"inputs":[177,155,156,160,161,162,167,157,168,169,170,171,172,173,174],"outputs":[178,179,180],"backend_fn":true,"js":null,"queue":true,"api_name":"add_new_eval_i2v","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":40,"targets":[[215,"click"]],"inputs":[214,192,193,197,198,199,204,194,205,206,207,208,209,210,211],"outputs":[215,216,217],"backend_fn":true,"js":null,"queue":true,"api_name":"add_new_eval_vbench2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":41,"targets":[[252,"click"]],"inputs":[251,229,230,234,235,236,241,231,242,243,244,245,246,247,248],"outputs":[252,253,254],"backend_fn":true,"js":null,"queue":true,"api_name":"add_new_eval_vbench_trust","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":42,"targets":[[257,"click"]],"inputs":[18],"outputs":[20],"backend_fn":true,"js":null,"queue":true,"api_name":"on_filter_model_size_method_change_7","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":43,"targets":[[null,"load"]],"inputs":[],"outputs":[20],"backend_fn":true,"js":null,"queue":false,"api_name":"get_baseline_df","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":44,"targets":[[null,"load"]],"inputs":[],"outputs":[41],"backend_fn":true,"js":null,"queue":false,"api_name":"get_baseline_df_2","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":45,"targets":[[null,"load"]],"inputs":[],"outputs":[55],"backend_fn":true,"js":null,"queue":false,"api_name":"get_baseline_df_quality","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":46,"targets":[[null,"load"]],"inputs":[],"outputs":[69],"backend_fn":true,"js":null,"queue":false,"api_name":"get_baseline_df_i2v","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":47,"targets":[[null,"load"]],"inputs":[],"outputs":[90],"backend_fn":true,"js":null,"queue":false,"api_name":"get_baseline_df_long","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null},{"id":48,"targets":[[null,"load"]],"inputs":[],"outputs":[105],"backend_fn":true,"js":null,"queue":false,"api_name":"get_baseline_df_trust","scroll_to_output":false,"show_progress":"full","every":null,"batch":false,"max_batch_size":4,"cancels":[],"types":{"continuous":false,"generator":false,"cancel":false},"collects_event_data":false,"trigger_after":null,"trigger_only_on_success":false,"trigger_mode":"once","show_api":true,"zerogpu":false,"rendered_in":null}],"root":"https://vchitect-vbench-leaderboard.hf.space"}