I killed a mouse and I feel aweful is this normal?

Yes you should feel horrible. Next time use the glue traps then remove the mouse with cooking oil and release them elsewhere!