PCs have several different slots types that can be used for video cards & other add-on cards. The 3 that can be used for video cards are PCI, AGP, or PCI-Express.
PCI = Peripheral Component Interconnect. It is the oldest slot type currently in use. It can be used for sound cards, modems, network cards, video cards, etc. PCI cards runs at 33MHz.
AGP = Accelerated Grahics Port. This slot is used for video cards only. Until recently, this was the standard slot for high performance graphics. AGP cards run at 66MHz.
PCI-Express = is the new slot type that was recently introduced & is becoming common on new systems. There are different PCI-E slots...the one exclusively for video cards is called PCI-E x16. PCI-E cards run at 100MHz.
Most low end systems use motherboards with onboard graphics & have PCI slots only. There are still PCI video cards available, but manufacturers have all but abandoned this format in favor of AGP & PCI-E. When shopping for a system, avoid "PCI only" setups. Check the specs & make sure to get a system with either an AGP or PCI-E x16 slot...that way you can add a gaming video card or upgrade the existing video card when needed.
You should be able to find a retail system in your price range with either an AGP or PCI-E slot, but the board will probably use onboard video & slot will be empty...either that, or the included video card will be low end & not good for gaming. But as long as you have that slot available, you can install a gaming video card when you have the money.