I understand what you mean about drifting away from things you use to do...
I feel this especially since I have just graduated highschool.

My mom use to force me into bed at 10 P.M. the time from 10PM to 3AM was always anime time... I would download it convert it and sneak my psp into my bed and watch it there.
Now I'm 18 and a highschool graduate... I have no bed time...

At school wee use to have A day B day schedule... I only needed 4 classes to graduate so I took the 4 classes I needed on A day
and I would always have art class on B day... (nothing but art class lol like 4 art classes) even if B day was all art day I would still draw during class all the time on A day..
I have no more school... there is no set time for drawing

Usually when I came home from school I would play video games use the internet do whatever I had too... it was always computer time...

well now I find that without school to structure my life around it basically is being overrun by the computer. I don't know if I necessarily think it is a bad thing, but I do think I understand how you feel... I watch anime when I'm too tired to play video games usually this lasts like an hour or 2 before I pass out from exhaustion. And I draw very little here and there between games or when I'm just too bored of it to bother caring....
Also I'm going to have to get a job soon because I'm going to college, and I'm really going to have to give up a lot of "gaming" time...

I normally don't worry about what I do with my time because I figure I'm here, might as well do something right? And what does it matter what I do, as long as I enjoy my life. But there are certainly times I sit down and wonder what the fudge I'm doing with my life.
How long am I going to watch anime like a little kid? How am I going to fit in with society with my strange ideas and the way I think. Will I ever make it into anything in the world?
I honestly think I'm going to become a NEET and or a Hikikomori at this rate...
or end up in an asylum for just being fudgeing crazy...

Honestly I see one way that I can make it in the world... I need to find a way to be damn rich and so I can do what I want whenever I want... but even then I wonder if that's just a pipe dream...
Oh well... don't really know where I'm going with this. Just thought I'd say as far as not fitting in I kind of understand how you feel...

I can't say much for caring what people think, because generally I don't or simply pretend to be too cool to care...
I wouldn't let the fact that some guy insulted my drawings keep me out of highschool
And I already graduated... so all I can tell you there is good luck :3 and don't let people get to you