I guess @ 33:05, Lmin = H(X) iff each pi is integer power of 2 is invalid statement. Lmin = H(X) iff each pi = 1/length symbol space. For bainary symbol space, it is 1/2.
rama chandra I am afraid you didn't get it right. Try to understand Lmin meaning. It is achievable average L such that all l's are integers. If X has 3 possible symbols in alphabet, as per your suggestion the h(x) is log(3) while lmin(achievable) is between log3 and log3+1. To be specific it is 2. lets say {a b c} are letters in alphabet and their probabilities are{1/2 1/4 1/4} h(x) is 1.5 while lmin(achievable) can be 1.5 because we can choose lengths{1 2 2}
atchut ram thanks for pointing it out. It should actually be H(x) = Lmin iff the sameple space is a power of 2 and each pi is 1/sample space. In that Prof probably meant to say integers are exclusively negative numbers. All hail the Prof
