One last thing, if all else fails you can also check your drivers. If you recently reinstalled you operating system (Window XP) you may need to check your drivers. Go to – > Start – > Control Panel – > Performance and Maintenance – > System – > Hardware – > Device Manager. Once the device manager pops up what should flag your attention is if you see any yellow questions marks. If you do they usually are labeled such as network device (nic/Ethernet), video device (video card), and etc. This means that the device is missing the proper drivers (software) to function. You can generally find the drivers from who ever made your PC such as dell.com, hp.com, or whomever you got your PC from or the manufacturer. They usually will have a section for software and downloads just put in your model info and download the drivers you need.
However, I would definitely check supersonicdave suggestions first. The drivers would be if all else fails it wouldn't hurt to check.
Ethernet is generally a simple plug and play, so if it doesn't work it's either the cable, the network card in the computer, the software in the computer, or the port on the router. Since the router has 4 port's it would be highly unlikely that they are all not functioning.