Either you pay to idle 1 GB of ram on some giant server somewhere, or you put it on really fast SSD and pay the time to load it all into ram.

Now a little Python or C routine that uses 8 MB of ram... becomes a much easier thing to do.