My back yard has so many yellow jackets I can't be out there. Besides killing them is there anything I can do?

I'm normally not afraid of bee's, but these won't leave me alone, they are everywhere. They are on the gr, the trees, the fence, the dirt, my lawn furnature. I thought flowers was what attracted them. Anyone have any idea's? I live in the valley in Calif. if that makes a difference. Thank You.