Will honey bee swarms in my yard move into a hole in the wall of my house?

Maybe, especially if bees have occupied the wall before. Bees are attracted by the odor of the other bees. You can prevent their entry by sealing outside openings 3/8th of an inch or larger with caulking or window screen. If the bees enter your wall, they are difficult to remove.