No. You cannot delete admin users, but you can deactivate them and they will no longer have access to the system.
You can deactivate their account though. Go into their profile and where it says "active" click on it so it no longer shows green and then hit submit at the bottom of the page.
