Noise-Contrastive Estimation - CLEARLY EXPLAINED!

Noise-Contrastive Estimation is a loss function that enables learning representations by comparing positive and negative sample pairs. It came into the limelight as a workaround to approximate softmax in NLP but is now being used in a lot of experiments in Self-supervised representation learning. #selfsupervised #representationlearning #noisecontrastiveestimation