The headphone doesn't charge so can't use Bluetooth anymore

The headphone doesn't charge so can't use Bluetooth anymore

When I plug my headphone, the light turns on, then turn off some seconds or minutes after. I can't turn on the Bluetooth anymore but the headphone still works when use with the jack wire. How can I change the battery?