Not knowing quite how many bees you have, I would say that if the queen is laying, and there's enough bees to cover some brood, then leave them be. As sealed brood will generate some heat by itself the laying area should gradually increase. I would put an excluder across the entrance - as has been suggested - to keep her in. I find queens and the girls abscond when it's a hot day.