I do ribeyes over a hot bed of coals in a Weber with the lid on. If there is a flare up, I just shut the top vent for a few seconds to choke the flames. Open the top vent and rock on. The flare up rarely comes back.
Babysitting isn't a term I'd use since they're not on there very long.
