Minecraft Performance

I have 3 GB allocated to my minecraft.
As soon as I start up minecraft it just instantly uses all of it in the task manager, I think this is causing lag because I'm having quite a bit of it. Any help?