This is a really important question, and one which climatologists work on in many aspects of their jobs.
Curious Kids: Why does cold air go down and hot air go up?
Jennifer Fitchett, Associate Professor of Physical Geography, University of the Witwatersrand