Late, but when you were getting good speeds, it's probably a good idea to check who's actually uploading at that speed for you.  If it's like one or two crazy fast uploaders, there's the possibility that they leave and you get stuck with a slow speed.  But otherwise, there probably isn't terribly much you can do (assuming this isn't a firewall/router/NAT issue).