What GPU's are good for my desktop?

I have a HP desktop that I just recently bought yesterday. I only bought it basically for minecraft and it's bad. The Frame rate(FPS) is terrible… I go like 1-10 FPS which is basically not playable! I think it might be the graphics card or computer model… Which
Computer specs:
Processor: AMD E1-2500 APU with Radeon(TM) HD Graphics
4gb of ram
64 bit windows 8 os
It's and HP desktop too
Graphics card is AMD Radeon HD 8240… I read that it's a bad card for minecraft… But I'll let you guys decide.

If the graphics card is the problem. I'm think on buying the AMD Radeon 6450 2gb ddr3 GPU! I hear it's real great for minecraft, but will it work with my computer? Will it also work with minecraft real well( at least 40-60fps)
Thank you for answering as it is kindly appreciated!

First of all. Your CPU is really horrible. It only uses 15 watts. It will bottleneck almost any dedicated GPU for gaming standard. It has 2 cores running at 1.4 Ghz… Yeah 1.4 Ghz.

I doubt it could run with a HD 6450. Also minecraft uses Java. Which is CPU intensive so if it can't run Java then I know that it can hold a low end GPU at the same time.

Future tip buy build your own PC. Or worst case scenario buy a gaming PC for $500-600 and upgrade the GPU.

The rest of your pc alone is really bad, it will be hard to get a good gpu because it will bottleneck