Re: [Tutor] Filesystem vs Database vs Lucene

2007-03-28 Thread John Fouhy
On 29/03/07, Shitiz Bansal <[EMAIL PROTECTED]> wrote: > Shelves seem nice but I would like to be sure on how it is implemented. > Would it > seek to a particular point in file and load just the desired data in memory > or does it unpickle everything and create a fullblown dictionary in > memory?...

Re: [Tutor] Filesystem vs Database vs Lucene OOPS

2007-03-28 Thread Luke Paireepinart
Bob Gailer wrote: > Bob Gailer wrote: >> Shitiz Bansal wrote: >> I need to implement a system which stores Strings(average length 50> >>> chars). >>> >> [snip] >> > I may have read 50> as >50. Please confirm that average length IS 50? > I need to implement a system whi

Re: [Tutor] Filesystem vs Database vs Lucene OOPS

2007-03-28 Thread Bob Gailer
Bob Gailer wrote: Shitiz Bansal wrote: I need to implement a system which stores Strings(average length 50> chars). [snip] I may have read 50> as >50. Please confirm that average length IS 50? Are these arbitrary text, or do the words come f

Re: [Tutor] Filesystem vs Database vs Lucene

2007-03-28 Thread Bob Gailer
Shitiz Bansal wrote: > > I need to implement a system which stores Strings(average length 50> > chars). [snip] How much greater than 50? 500, 5000, 50,000, ...? Are these arbitrary text, or do the words come from some predetermined domain? Would you provide some examples? -- Bob Gailer 510-97

Re: [Tutor] Filesystem vs Database vs Lucene

2007-03-28 Thread Shitiz Bansal
Thanks Alan for your reply. I however have a few more concerns. Memory is not an option not just because of capacity but also because I desire persistence. Also I feel that 500 MB of data in a dictionary would typically cross 1 Gigin total used memory.That of course will depend on the Hashing al

Re: [Tutor] Filesystem vs Database vs Lucene

2007-03-26 Thread Alan Gauld
"Shitiz Bansal" <[EMAIL PROTECTED]> wrote > I need to implement a system which stores Strings(average length 50 > chars). > For every input String it would need to tell the user wether that > string > already exists in the system. It would also need to add that input > String to the system if it

Re: [Tutor] Filesystem vs Database vs Lucene

2007-03-26 Thread Christopher Arndt
Shitiz Bansal schrieb: > I need to implement a system which stores Strings(average length 50 chars). > I was wondering what would be the most efficient(timewise) solution for > this riddle. I'd use pysqlite, a SQL database in a file. > For every input String it would need to tell the user wether

[Tutor] Filesystem vs Database vs Lucene

2007-03-26 Thread Shitiz Bansal
Hi, I need to implement a system which stores Strings(average length 50 chars). For every input String it would need to tell the user wether that string already exists in the system. It would also need to add that input String to the system if it did not exist. It will also be useful to know the