Hi Michael, I know you are asking about Solr, but in case you haven't seen it, Ian Soboroff has a nice little demo for Lucene:
https://github.com/isoboroff/trec-demo. There is also the lucene benchmark code: http://lucene.apache.org/core/4_5_1/benchmark/org/apache/lucene/benchmark/quality/package-summary.html Otherwise, all I can think of is writing an app layer that keeps track of the id, sends the query to Solr, parses the search results and spits out results in the trec format. I'd love to find some open-source code that does what you ask. I did a quick and dirty version of something like that for the INEX book track. I'll see if I can find the code and if it is in any shape to share. Tom Tom Burton-West Information Retrieval Programmer Digital Library Production Sevice University of Michigan Library tburt...@umich.edu http://www.hathitrust.org/blogs/large-scale-search On Wed, Oct 30, 2013 at 10:52 AM, Michael Preminger < michael.premin...@hioa.no> wrote: > Hello! > > Is there a simple way to evaluate a SOLR index with TREC_EVAL? > I mean: > * preparing a query file in some format Solr will understand, but where > each query has an ID > * getting results out in trec format, with these query IDs attached > > Thanks > > Michael >