At the moment I have no plans to stream the data. Note the raw data is saved in a Linux host, I need to do index on those raw data and provide search capabilities on the data.
The data is in FIX, I believe I would need to parse the data and create index on the parsed data, I have never worked on FIXdata nor Solr, any ideas are greatly appreciated. Thanks lots in advance. Again, if you want to see the data a sample is in the original question. ~~~sent from my cell phone, sorry if there is any typo Raymond Xie <xie3208...@gmail.com> 于 2018年4月1日周日 下午12:12写道： > Thanks to all. > > FIX is a format standard of financial data. It contains lots of tags in > number with value for the tag, like 8=asdf, where 8 is the tag and asdf is > the tag's value. Each tag has its definition. > > The sample msg in FIX format was in the original question. > > All I need to do is to know how to paste the msg and get all tag's value. > > I found so far a parser is what I need to start with., But I am more > concerning about how to create index in Solr on the extracted tag's value, > that is the first step, the next would be to customize the dashboard for > users to search with a value to find out which msg contains that value in > which tag and present users the whole msg as proof. > > ~~~sent from my cell phone, sorry if there is any typo > > Rick Leir <rl...@leirtech.com> 于 2018年3月31日周六 下午6:00写道： > >> Raymond >> Will you be streaming the FIX data, perhaps with aggregation? Just a >> thought, I have no experience with FIX. Streaming opens up lots of >> questions. >> Cheers -- Rick >> >> On March 31, 2018 2:33:25 PM EDT, Walter Underwood <wun...@wunderwood.org> >> wrote: >> >Looks like Financial Information Exchange data, but, as Shawn says, the >> >real problem is what you want to do with it. >> > >> >* What fields will be searched? Those are indexed. >> >* What fields will be returned in the result? Those are stored. >> >* What is the data type for each field? >> > >> >I often store the data for most of the fields because it makes >> >debugging search problems so much easier. >> > >> >wunder >> >Walter Underwood >> >wun...@wunderwood.org >> >http://observer.wunderwood.org/ (my blog) >> > >> >> On Mar 31, 2018, at 11:29 AM, Shawn Heisey <apa...@elyograg.org> >> >wrote: >> >> >> >> On 3/31/2018 12:21 PM, Raymond Xie wrote: >> >>> I just started using Solr to create a Searching function on our >> >existing >> >>> data. >> >>> >> >>> The existing data is in FIX format sample as below: >> >> <snip> >> >>> all the red tags (I didn't mark all of them) are fields with >> >definition >> >>> from FIX standard, I need to create index on all the tags, how do I >> >start? >> >> >> >> I do not know what FIX means, and there are no colors in your email. >> >> >> >> Can you elaborate? >> >> >> >> Fine-tuning the schema can be one of the most time-consuming parts of >> >setting up a Solr installation, and there are usually no easy quick >> >answers. Exactly what to do will depend not only on the data that >> >you're indexing, but also what you want to do with it. >> >> >> >> Thanks, >> >> Shawn >> >> >> >> -- >> Sorry for being brief. Alternate email is rickleir at yahoo dot com > >
