The right sign for "erase" is going to depend on your context.
Erase as in: Erase a blackboard:
If you mean "erase" as in "use a pencil to erase your mistake," then mime the action using a modified "X" hand to represent the eraser side of a pencil.
Notes: