How to get rid of my port from my minecraft server?

I made a minecraft server and i put my port in it. When i played it i didn't do the right one so i did more research and it says i need a bukkit server. So i went and got a bukkit server and it was making it and then it says it can't bind the port maybe it is running on another server. So i did a stupid thing and i thought once i got rid of all the files on my first server it would work so i deleted them and went into the recycling bin and deleted it. So i went back and tryed it and i guess its still running…

1. Can i recover those files and if so how?

2. Can i shut it down withut those files?

So stick in a Firewalll and shut down the port.

You need to port forward your router. To do this Google.