On September 15, 2011 9:44 AM, Brandon Phelps wrote: > > Hello! [...] > My problem here is that the logs are coming in extremely fast and > while the script does work, it progressively gets further and > further behind. It's currently Sep 15, 10AM yet the script is still > dealing with lines from Sep 14 at 8am. This is obviously due to the > fact that the Tail module, and more likely the DBI module simply > can't INSERT/UPDATE the database as fast as the logs are coming in.
Have you benchmarked/profiled your program yet? You can't tell what parts are slow, and what would benefit from a rework, without that. -- Eric
