Ok if I was being silly....you do know there is a lock and you need a key right?
Seriously though I have no trouble with mine and I do not recall ever seeing a similar complaint so it may be just your bike. Is there any signs of damage or rust? Perhaps the rubber seal is swollen and is too tight? Completely the wrong cap?
Good luck getting this sorted out!