DATASET

Open Source Community

TIFA, AIGCIQA2023, ECCV_Caption, D3PO

This repository contains multiple datasets, including TIFA, AIGCIQA2023, ECCV_Caption, and D3PO, for human feedback research on reward models. Each dataset comes with detailed download and setup instructions.

Updated 2/5/2024

github

Description

Dataset Overview

Dataset Download and Setup

Image Download

TIFA and AIGCIQA2023 dataset images: Can be downloaded from this link. After downloading, extract to obtain the annotated_images and allimg folders.

TIFA Dataset

Preference ranking data: located at csvs/tifa.csv.
Image setup: Ensure the annotated_images folder is in the same directory as tifa.csv.

AIGCIQA2023 Dataset

Preference ranking data: located at csvs/aigciqa2023.csv.
Image setup: Ensure the allimg folder is in the same directory as aigciqa2023.csv.

ECCV_Caption Dataset

Preference ranking data: located at eccv_caption.csv.
Image setup: Download the COCO2014 val split, extract, and place the val2014 folder in the same directory as eccv_caption.csv.

D3PO Dataset

Image download: Can be downloaded from this link.
Image setup: After extracting, place the text2image_evaluation/img folder in the same directory as the CSV files of the D3PO dataset.

AI studio

Generate PPTs instantly with Nano Banana Pro.

Generate PPT Now

Access Dataset

Login to Access

Please login to view download links and access full dataset details.

Topics

Machine Learning

Human Feedback

Source

Organization: github

Created: 1/5/2024

Power Your Data Analysis with Premium AI Models

Supporting GPT-5, Claude-4, DeepSeek v3, Gemini and more.

Enjoy a free trial and save 20%+ compared to official pricing.

Check Prices →