It is annoying indeed. Unlike DVDs, with divx files you can go frame by frame in both directions, it is easier.
What I did is to assign Ctrl+Left/Right for framestep backward/forward, and just Left/Right for "Jump medium". So when I press the left key it moves of 3-4 seconds back. There is also a "Jump small" which may be better for what you want.