Recent questions tagged entropy

A binary random variable $X$ takes the value $+2$ or $-2$. The probability $P(X=+2)=\alpha $. The value of $\alpha$ (rounded off to one decimal place), for which the entr...

A fair coin is tossed repeatedly until a ‘Head’ appears for the first time. Let $L$ be the number of tosses to get this first ‘Head’. The entropy $H(L)$ in bits is _____.

Let $U$ and $V$ be two independent and identically distributed random variables such that $P(U=+1)=P(U=-1) = \dfrac{1}{2}.$ The entropy $H(U + V)$ in bits is$\frac{3}{4} ...