Well, are you concerned about spending more than $1k on a computer in general, or is it more of an issue regarding the time it would take you to save up for a higher cost build? If it's the latter, you could do what BizarreJuju did and defer buying the video card, relying on the CPU's GPU in the meanwhile. It's good enough to run Vindictus, according to Juju. If you're interested in this idea, you can ask him for specifics about what he can and cannot run with that limited graphics power.
And I disagree with the Cat's build in several points:
* That video card is overclocked. Video cards, especially NVIDIA's, can die out fairly quickly. Overclocking them makes this process even quicker. The GTX570 is also a lot more video card than you need, with a price to match. <_< IMO you'll have to settle for a lower price point, unless you plan to defer it like mentioned earlier.
Something like a Radeon HD 6870 would probably be a better idea. If you want an NV card, get the 560 Ti (not 560).
* Single stick of 4GB RAM. :| No.
Get this instead:
G.SKILL Value Series 8GB (2 x 4GB) - $50
* HDD: Avoid 2TB! Unless you want to risk higher failure rates. Just get some 1TB or 500GB drive. I like the Western Digital Black Caviar line, personally. Seagate is also decent. Dunno about Samsung.
* Case: I agree with the above. Antec 300 is decent for a budget system. Keep in mind that the max gfx card length it can fit is 11". Check the dimensions of the gfx card you intend to buy.