Demystifying CLIP Data

The paper introduces MetaCLIP, a data curation approach that outperforms CLIP's data on standard benchmarks. MetaCLIP achieves higher accuracy in zero-shot ImageNet classification and scales well with larger datasets.