How to clean 8217 pictures from the similar one

[John6666]

I know how to automatically tag images in detail to a certain extent, but I don’t know how to process large image data sets concisely, so I searched around for a solution.
It seems there are several specialized tools.

How to clean/audit your image data?

For the folks working on real-world CV projects or generative AI, I think you will find this open-sourced Python library useful that detects common issues (in famous datasets too) such as images which are: blurry, under/over-exposed, low information, oddly sized, or (near) duplicates of others. CleanVision is a new package you can use to quickly audit any image dataset (including HuggingFace Datasets) for a broad range of common issues lurking in real-world data. Instead of relying on manual in…

Cleaning Image Classification Datasets With fastdup and Renumics Spotlight

GitHub - cleanlab/cleanvision: Automatically find issues in image datasets and...