Cost function & back propagation & gradient

Ref: https://mlfromscratch.com/neural-networks-explained/#/

Loss (cost) Function :

• categorical cross-entropy loss function quantifies the difference between two probability distributions
  • good at multi-class classification
• Binary cross-entropy is the typical loss function for the binary classification

Comments