USB IS backward compatible.
I agree with the above comments concerning printing from Win95. Even if you could find a printer to work the cost for that solution is more than the alternatives.
I don't know where you live so perhaps geography is an issue but I am in the US and around here folks are discarding much newer computers. I just had someone give me a Dell 8100 running Winwp.
If you have a newer computer with a printer as was mentioned there are many ways to get files off your Win95 hard drive.