Would something like this work just to plug the modem in?
Amazon Basics Standby UPS 400VA 255W Surge Protector Battery Power Backup, 6 Outlets - Black
It should be with 255w ... If you look on your modem it should have a Power Rating -- probably less than 100w -- so you might be able to add a Cellphone charger