With a 64 bit CPU you are in touch with the future, in other words the software coming soon (Windows Vista and most Linux systems) will require this architecture as the starting point. 32 bit will last long time, but those processors are part of the past.
The advantageous of 64 bit processors can process data in 64bit chuncks per clock cylce, in other words they will be much faster. 64 bit processors will also allow the systems to utilize much larger amounts of RAM. However, in order to do this it requires a 64bit OS with 64bit drivers and 64bit capable applications.
The 64bit WindowsXP is curently available and driver support has gotten much better, but there are still a lot of drivers that have not been ported to 64bit. Additionally there are very few aplpications that have been written to take advantage of 64bit.
You can run a 64bit OS with 32bit aplpications, but you can't use 32bit drivers. There are other problems with going to 64bit OS at this time as well. For instance Windows XP 64bit comes with 2 versions of IE (32bit and 64bit). This is because some sites that require ActiveX components will not work in the 64bit version if the ActiveX component has not been written to work in 64bit mode.