In article <[email protected]>, Dennis Lee Bieber <[email protected]> wrote:
> Memory is cheap -- I/O is slow. <G> Just how massive are these CSV > files? Actually, these days, the economics of hardware are more like, "CPU is cheap, memory is expensive". I suppose it all depends on what kinds of problems you're solving, but my experience is I'm much more likely to run out of memory on big problems than I am to peg the CPU. Also, pegging the CPU leads to well-behaved performance degradation. Running out of memory leads to falling off a performance cliff as you start to page. And, with the advent of large-scale SSD (you can get 1.6 TB SSD in 2.5 inch form-factor!), I/O is as fast as you're willing to pay for :-) -- https://mail.python.org/mailman/listinfo/python-list
