WordPress can allow your user to register by themself, but has no function to delete their own account.
You can also create Resign Page which displays message to your customer.
Are you sure to delete your account? We miss you.
Deze plugin kan worden gedownload, zodat je hem op je zelf-gehoste WordPress-installatie kan gebruiken.