A neural network based on multimodal (image, text) contrastive training. It can predict the most relevant text snippets using natural language given an image, without the need for optimization for specific tasks. CLIP is designed similarly to GPT-2 and GPT-3, boasting excellent zero-shot capabilities and can be applied to a variety of multimodal tasks.