If you have a large number of wasps gathering around a small entry point in a building then you may have a wasp nest.