If it does then you probably had a chimney fire like this person did!
Chimney fires are worst case scenario, but other damage such as water damage can cause just as much destruction to your house. Even something as small as a hole in the side of the box causes moisture and heat to get to where its not supposed to be!