Intuitively Understanding the Cross Entropy Loss 

KL = Cross Entropy - Entropy.

Real world data bro, from annotated samples.

Human is the criteria for everything，so called AI

In the classification task, the true distribution has the value of 1 for the correct class and value of 0 for the other classes. So that's it, that's the true distribution. And we know it, if the data is labelled correctly. The distribution in classification task is called probability mass function btw

Intuitively, information is lost whenever discretizing a continuous variable. Said another way, the difference between a class probability of 0.51 and 0.99 is very different. Downstream, soft targets allow for more precise gradient updates.

As explained in the video the KL divergence is a measure of "distance", so it has to be >0. There other prerequisites for a function to be a measure of distance like symmetry, and couple other things i forget about.

the frequency of occurrence of a particular class depends on the characteristics of the objects

4:24. do you know how golden the statement is

Your name is commonsense and you still don't use your common sense lol In every RU-vid application, there is the option to slow a video down to 75%, 50% or even 25% speed. If you have trouble with understanding his language, you should just select the 0.75 speed option.

@@Oliver-2103 Visually Impaired people have problems seeing some of the adjustments one can make on a phone even when they know that they exist.