Should boost timers only go down during the actual fight?

BabyGroot

Me personally I'd love this. If I throw on some boost and then have to step away from the game or watch a video on how to do the fight I loose them. It's not a huge deal but it would be nice if they were just there when I got back.