Whats the best way to keep bees away?

WE have a gazebo and every year we get quite a few bees nests up in the itty bitty crevices near the top of the gazebo. Is there something we can hang up there to deter them or do we have to spray?