The below video demonstrates a perfectly serviceable gun camera made using nothing but a sub-$10 video camera (available for around $10 or less on ebay), a rail mount and some velcro tape.
The result is a very cool video. I think I am going to have to make one of these.
[ Many thanks to jdun1911 for the link. ]