New computer goes low frames for gaming! Why?

Okay so. I have bought this new desktop for gaming(Minecraft) and it sucks. I drop to as low as 1-10 frames(FPS)! I just bought this today and I don't know what the deal is!
Processor: AMD E1-2500 APU with Radeon(TM) HD Graphics
4gb of ram
64 bit windows 8 os
It's and HP desktop too!
Please leave suggestions, I need help!

Well no wonder. You bought an HP. They suck. You could've just made a computer or tell someone to make one for you and it would be cheaper and a better computer. My cousin made one for about $600 and it can run every thing on max graphics and it doesn't lag at all