How do they know what the temperature was 10,000 years ago when the thermometer wasn't even invented?

I've seen temperature charts that purport to prove/disprove global warming. How are the charts constructed?