Why do power stations throw away heat?

I was asked online recently: why do (thermal) power stations throw away so much heat?
You've probably seen pictures of large coal- or gas-fired power stations with big plumes of water vapour coming out of their cooling towers. Why do we throw all that heat away? Isn't that a waste?
Here I briefly step through the reason we can't convert all the heat from a fuel into work (electricity).