

DIG In
Overview :
DIG-In is a library for evaluating the quality, diversity, and consistency differences of text-to-image generation models across geographical regions. It utilizes GeoDE and DollarStreet as reference datasets and computes metrics such as accuracy, coverage, and diversity of generated images. It also employs the CLIPScore metric to measure model consistency. This library empowers researchers and developers to conduct geographical diversity audits of their image generation models, ensuring fairness and inclusivity on a global scale.
Target Users :
DIG-In is designed for researchers and developers who need to evaluate and ensure the consistent performance of their image generation models globally. It is particularly suitable for applications that focus on the fairness and inclusivity of models across different cultures and geographical backgrounds.
Use Cases
Researchers use DIG-In to assess the output quality of different image generation models in Africa.
Developers leverage DIG-In to ensure their applications provide a consistent user experience globally.
Educational institutions utilize DIG-In as a teaching tool to educate students on evaluating and improving the fairness of AI models.
Features
Evaluate the quality difference of generated images using GeoDE and DollarStreet datasets.
Calculate accuracy, recall, coverage, and density metrics for generated images.
Evaluate image consistency using the CLIPScore metric.
Provide scripts to extract features from generated images.
Support custom image or feature path pointers.
Provide scripts for calculating metrics including balanced reference datasets.
How to Use
1. Generate images corresponding to the prompts in the csv file.
2. Provide pointers to the prompt csv and generated image folder to extract image features.
3. Calculate metrics including accuracy, recall, coverage, and density using the extracted features.
4. Update the feature file path if needed.
5. Run the script for calculating metrics including balanced reference datasets.
6. Analyze the metric results in the generated csv file to evaluate model performance.
Featured AI Tools
Chinese Picks

Capcut Dreamina
CapCut Dreamina is an AIGC tool under Douyin. Users can generate creative images based on text content, supporting image resizing, aspect ratio adjustment, and template type selection. It will be used for content creation in Douyin's text or short videos in the future to enrich Douyin's AI creation content library.
AI image generation
9.0M

Outfit Anyone
Outfit Anyone is an ultra-high quality virtual try-on product that allows users to try different fashion styles without physically trying on clothes. Using a two-stream conditional diffusion model, Outfit Anyone can flexibly handle clothing deformation, generating more realistic results. It boasts extensibility, allowing adjustments for poses and body shapes, making it suitable for images ranging from anime characters to real people. Outfit Anyone's performance across various scenarios highlights its practicality and readiness for real-world applications.
AI image generation
5.3M