I agree but I'm going to have to spend at least $500 in order to get a decent budget PC. I was looking at maybe just buying a used one for like $100-$200. My wife won't get on my case as much that way and then I could just gradually upgrade over time.
I would like to find a friend that has one they are willing to just give me to play with.
Just remember, you get what you pay for. If it's in the $100-$200 range it will be significantly cheaper than something like an HP desktop that wasn't built for gaming. Most gaming PCs are going to run $500+ even on the low end. Most people aren't going to put $500-$700 into building a gaming PC and then turn around and sell it for $100 while it's still a relevant machine.
Unfortunately you can't get much cheaper than the APU setup I posted yesterday and still play modern games. You might be able to build something relatively weak with intel integrated graphics on an i3 CPU and run SteamOS on it instead of paying for Windows for about $300. You will be limited to indie games that have Linux support and you won't be playing DayZ though.