Well it doesn't realyy irritate me that much , but i havent noticed it doing this when i was on a lower firmware , and i don't know if its my psp being a prick or something amatter with it.

Well when i push it in for longer it seems to work better , thanks for all of your help :D