WordPress can allow your user to register by themself, but has no function to delete their own account.
You can also create Resign Page which displays message to your customer.
Are you sure to delete your account? We miss you.
Dieses Plugin steht zum Download zur Verfügung, um in deiner selbst gehosteten WordPress-Installation verwendet zu werden.