I don't think you should say anything. Either delete or just leave it inactive -- at some point, there may be something you DO want to say or follow.
If you announce you're leaving, people might think there was some kind inciting incident, or maybe take it personally, like you don't want to associate with them. You never know!