Will my minecraft Bukkit server slow down my internet connection?

I host a Bukkit Minecraft server on 3GB Ram min and 6GB Max and 250KB/S download speed the maximum number people who will be online at the same time is 4 and they all live in the same city as me. Will this server slow down my internet and if it does at what speed will the internet be?

I had a bukkit server before. My computer had a max of 2GB of RAM, and I have 6 devices on my home internet at one time. My computer was able to support a max of 20 people around the country when I allocated 1 GB of RAM to the game. However I was cautious of my internet. This depends on how many mods you plan to use, how many chunks have loaded, how many mods you let players use (Helps to set up permissions). How much RAM you allocated, and your upload speed (Download speed will be for their individual computers). When I was cautious about my internet, I had one to two tabs open. It would slow when I would watch youtube with it, but I ended up keeping the server to run on its own, with shutdowns, etc. And not watch alot of videos or stream, at the same time. If I needed the internet, I used a separate machine for it, but if you allocate 3GB for your server, you should be fine. Especially with only four players. If there's any lag, it will more than likely be on their own end. Not yours.