It won't let me delete stuff

I tried to get onto my Minecraft server, but it gave me ID mismatches.
So I deleted the mod I think was responsible, but it said I could not delete it because it was open in another program. I logged off, and then logged back on, but I still couldn't delete it!