Adam, it will cover in the hole with bits of rock and sand. Mine doesn't like his front door open. He drilled right thru the rock and made a back door and comes and goes from there. If I turn the rock around, he fills in the backdoor and uses the old front door again! Tou'll probably find that he opens it in the morning again. Give him a bit of prawn or something with some tweezers. He'll love ya for it!
It is most likely a Gonodactylus species.
Go here for more info..
http://www.blueboard.com/mantis/