Don't know why the mail list took away the highlighted color on the tags, anyway, I have explained the data structure so hopefully you get the idea.
Thanks. ~~~sent from my cell phone, sorry if there is any typo Raymond Xie <xie3208...@gmail.com> 于 2018年4月1日周日 下午12:24写道： > At the moment I have no plans to stream the data. > > Note the raw data is saved in a Linux host, I need to do index on those > raw data and provide search capabilities on the data. > > The data is in FIX, I believe I would need to parse the data and create > index on the parsed data, I have never worked on FIXdata nor Solr, any > ideas are greatly appreciated. Thanks lots in advance. > > Again, if you want to see the data a sample is in the original question. > > ~~~sent from my cell phone, sorry if there is any typo > > Raymond Xie <xie3208...@gmail.com> 于 2018年4月1日周日 下午12:12写道： > >> Thanks to all. >> >> FIX is a format standard of financial data. It contains lots of tags in >> number with value for the tag, like 8=asdf, where 8 is the tag and asdf is >> the tag's value. Each tag has its definition. >> >> The sample msg in FIX format was in the original question. >> >> All I need to do is to know how to paste the msg and get all tag's value. >> >> I found so far a parser is what I need to start with., But I am more >> concerning about how to create index in Solr on the extracted tag's value, >> that is the first step, the next would be to customize the dashboard for >> users to search with a value to find out which msg contains that value in >> which tag and present users the whole msg as proof. >> >> ~~~sent from my cell phone, sorry if there is any typo >> >> Rick Leir <rl...@leirtech.com> 于 2018年3月31日周六 下午6:00写道： >> >>> Raymond >>> Will you be streaming the FIX data, perhaps with aggregation? Just a >>> thought, I have no experience with FIX. Streaming opens up lots of >>> questions. >>> Cheers -- Rick >>> >>> On March 31, 2018 2:33:25 PM EDT, Walter Underwood < >>> wun...@wunderwood.org> wrote: >>> >Looks like Financial Information Exchange data, but, as Shawn says, the >>> >real problem is what you want to do with it. >>> > >>> >* What fields will be searched? Those are indexed. >>> >* What fields will be returned in the result? Those are stored. >>> >* What is the data type for each field? >>> > >>> >I often store the data for most of the fields because it makes >>> >debugging search problems so much easier. >>> > >>> >wunder >>> >Walter Underwood >>> >wun...@wunderwood.org >>> >http://observer.wunderwood.org/ (my blog) >>> > >>> >> On Mar 31, 2018, at 11:29 AM, Shawn Heisey <apa...@elyograg.org> >>> >wrote: >>> >> >>> >> On 3/31/2018 12:21 PM, Raymond Xie wrote: >>> >>> I just started using Solr to create a Searching function on our >>> >existing >>> >>> data. >>> >>> >>> >>> The existing data is in FIX format sample as below: >>> >> <snip> >>> >>> all the red tags (I didn't mark all of them) are fields with >>> >definition >>> >>> from FIX standard, I need to create index on all the tags, how do I >>> >start? >>> >> >>> >> I do not know what FIX means, and there are no colors in your email. >>> >> >>> >> Can you elaborate? >>> >> >>> >> Fine-tuning the schema can be one of the most time-consuming parts of >>> >setting up a Solr installation, and there are usually no easy quick >>> >answers. Exactly what to do will depend not only on the data that >>> >you're indexing, but also what you want to do with it. >>> >> >>> >> Thanks, >>> >> Shawn >>> >> >>> >>> -- >>> Sorry for being brief. Alternate email is rickleir at yahoo dot com >> >>
