You may run into this:
"The item that you are trying to delete is the current welcome page and cannot be deleted."
Problem: Startup page does not exist (languages removed?)
Solution: Site Actions -> Site Settings -> Modify All Settings -> "Welcome page" under "Look and Feel"
Set it back to default.aspx
Also check the hidden list: /Relationships List/AllItems.aspx