Depends on if a queen survives the winter and repopulates the nest:

Yellowjackets are social hunters living in colonies containing workers, queens, and males (drones). Colonies are annual with only inseminated queens overwintering. Fertilized queens are found in protected places such as in hollow logs, in stumps, under bark, in leaf litter, in soil cavities, and in man-made structures. Queens emerge during the warm days of late spring or early summer, select a nest site, and build a small paper nest in which they lay eggs. After eggs hatch from the 30 to 50 brood cells, the queen feeds the young larvae for about 18 to 20 days. Larvae pupate, then emerge later as small, infertile females called workers. Workers in the colony take over caring for the larvae, feeding them with chewed up meat or fruit. By midsummer, the first adult workers emerge and assume the tasks of nest expansion, foraging for food, care of the queen and larvae, and colony defense.
From this time until her death in the autumn, the queen remains inside the nest, laying eggs. The colony then expands rapidly, reaching a maximum size of 4000 to 5000[2] workers and a nest of 10,000 to 15,000 cells in late summer. (This is true of most species in most areas; however, Vespula squamata, in the southern part of its range, may build much larger perennial colonies populated by scores of queens, tens of thousands of workers, and hundreds of thousands of cells.)

I would just remember the nest location and spay it with wasp/hornet killer on a cool evening if there are signs of activity.