We will leave the gardens as is for one year, then the next we'll be removing a significant number of the beds to make it a more family friendly space....and a space I can manage with just a little help. Right now I'm just cheering on the deer who eat half of the plants...they're helping me prune down the garden
If you must remove some of the plants don't trash them. You could hold a "yard" sale - literally! My wife would not be able to drive past a house that was selling their landscaping without stopping and buying something. Check out local nurseries for prices an sell yours at a fair price.