I had the same problem and solved it.

The problem was, the Virtuemart category was not translated.
So you have to translate the Virtuemart category for a SEF URL in another language.

If the VM category is not translated, the SEF for the category page and all products in that category will not work.