Passenger side Door speaker distorted sometimes

Passenger side Door speaker distorted sometimes The Sony speaker on my 2012 Ford Escape front passenger side door sounds distorted, but only sometimes. It usually happens first thing in the morning and then sometimes sounds fine later on in the day. Any suggestions besides replacing the speaker with a new one?