Do logstash/graylog2 do log processing/searching in real time? Or can scale
for real time need?
I guess harshadmehta is looking for real-time indexing/search.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/need-basic-information-tp4004588p4004996.html
Sent
Agreed. There are a lot of products that do this already. Writing it from
scratch in Solr seems like a huge waste of time. You should also check out
Graylog2: http://graylog2.org/
wunder
On Aug 31, 2012, at 7:05 AM, Alexandre Rafalovitch wrote:
> Have you tried looking at http://logstash.net/
Think of the log file as a flat database, each line/entry a "row". So, each
log line/entry would need to be added to Solr as a separate document.
Maybe you could do this using DIH and a LineEntityProcessor and
RegexTransformer, DateFormatTransformer, etc.
-- Jack Krupansky
-Original Mess
I have looked at splunk and logstash but want to explore solr to do the job.
Thanks
--
View this message in context:
http://lucene.472066.n3.nabble.com/need-basic-information-tp4004588p4004763.html
Sent from the Solr - User mailing list archive at Nabble.com.
Have you tried looking at http://logstash.net/ first? Or Splunk
(http://www.splunk.com/) if you have money These might be a better
starting point than bare SOLR.
Regards,
Alex
Personal blog: http://blog.outerthoughts.com/
LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch
- Time is t
You got what i am looking for but indexing part is where i am not sure how
it needs to be done.
So to send these log files for indexing in CSV format, is it just a
configuration change to pull these 3 fields from each line in text files or
i need to write code for that.
I simplified the lines in
One basic and trivial solution could be to have schema like;
Date (of type date/string) --> this would store the '-mm-dd' format date
Tag (of type string) --> the text/tag 'Account' goes into this
account-id (of type sint/int) --> account id like '123' goes into this
action (of type sting) -->
