I'm trying to make a drunken POV view down the barrel of a crossbow:

Now I have all the trees, background, etc. on different Z points to give a wide range of parallax, but I'd like to fix the crossbow to the camera, so it is stationary from the stand point of the viewer.
Any ideas how to do this without having to move it in synch with the camera... which just seems to be a huge pain in the buttocks.