Skip to content

Tung M Phung's Blog

  • Home
  • About me

Tag: cross entropy loss

Machine Learning - Data Mining, MiscellaneousLeave a comment

Information Theory concepts: Entropy, Mutual Information, KL-Divergence, and more

May 20, 2021June 25, 2021 Tung.M.Phung

An intuitive introduction to Information Content, Encoding, Entropy, Joint Entropy, Cross Entropy, KL Divergence, Conditional Entropy, and Mutual Information… Continue reading Information Theory concepts: Entropy, Mutual Information, KL-Divergence, and more

Classification Models, Machine Learning - Data MiningLeave a comment

Binary Classification Evaluation Summary

January 15, 2020July 31, 2020 Tung.M.Phung

This article attempts to summarize the popular evaluation metrics for binary classification problems. Continue reading Binary Classification Evaluation Summary