go to seed 

To decline or fall apart; to become worn and shabby.

This phrase comes from gardening. After a plant has flowered, it falls apart, sending its seeds into the soil. As the plant dies, it 'goes to seed'.

Hicksville has gone to seed since the last time I was there.

go to seed by VAKI5 May 14, 2005