On Saturday, December 7, 2013 at 14:06, Jim - FooBar(); wrote: > Hi all, > > Technically speaking this is not a question specific to Clojure. I 'd > like to see how people are generally accessing some big resource (e.g a > massive .csv file). My use case is this: > > I've got code that fetches the weather conditions from Yahoo, given a > WOE_ID code. The problem is that I'd like to be able to search by city > name rather than WOE_ID. After hours of searching I managed to find a > downloadable .tsv file from yahoo which includes the mapping from > WOE_IDs to cities. However it is a 253MB file! Including it in my > /jar/uberjar is out of the question of course...I had , what appeared to > be a good idea, to put the file in my public dropbox folder and access > the url from my code. This works but is terribly slow because I'm > opening and reading the file through the network (it takes roughly 25 > sec to look up 'Manchester').
Is there a reason you can’t parse the file into a database and then just set up the world’s simplest web service? i.e. curl http://my-woe-id-lookup-service.com/city?name=Manchester - Josh -- -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to [email protected] Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/groups/opt_out.
