On Wednesday, August 15, 2012 2:03:38 PM UTC-7, Taras Glek wrote: > Hi, > > According to metrics we have about 1TB of telemetry data in hadoop. This > is almost a year worth of telemetry data. Our telemetry ping packets > keep growing as we add more probes. As the hadoop database gets bigger, > query times get worse, etc. We need to decide on what data we can throw > away and when.
Most of this sounds fine to me, except I wanna ask: how much does it cost to store 1TB of data? Next to nothing, right? I'd say move it out of the primary database to an archive area if you need to for performance, but why not keep all the archives? Dave _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
