Re: [Virtuoso-users] Loading uniprot

2011-09-14 Thread Pierre-Yves Chibon
On Sat, 2011-09-10 at 19:18 +0100, Hugh Williams wrote: > Let me know if this works for you ... I changed the setting as you indicated me and then I loaded the dataset in single thread (couldn't make the mutli-thread working as I wanted). It took 4 days, but the 178G of the uniprot.rdf are in vir

Re: [Virtuoso-users] Loading uniprot

2011-09-10 Thread Hugh Williams
Hi Pierre, The script assumes ld_dir() has already been run to setup the datasets to load then you fire the multiple client to load the data specified in the load_list table populated by the ld_dir() function. You can add it at the point you suggest but as it only has to be run once for a give

Re: [Virtuoso-users] Loading uniprot

2011-09-10 Thread Pierre-Yves Chibon
Hi Hugh, Thanks a lot for your help! Just a small precision for your script, doesn't the rdf_loader_run() need the ld_dir() before ? So I am thinking something like: > isql-vt dba dba exec="checkpoint_interval(-1);" & > isql-vt dba dba exec="ld_dir ('/data/virtuoso/','uniprot.rdf.gz','ht

Re: [Virtuoso-users] Loading uniprot

2011-09-10 Thread Hugh Williams
Hi Pierre, The NumberOfBuffers parameter in the virtuoso.ini file is too low for a machine with 16GB memory and loading large datasets like uniprot, please refer to the following performance tuning guide document for recommended settings for best performance with various typical memory sizes:

[Virtuoso-users] Loading uniprot

2011-09-10 Thread Pierre-Yves Chibon
Dear all, I am trying to load uniprot on a quadcore machine with 16Gb of ram and 2 hard-drives in raid 1. I installed virtuoso opensource from the Fedora repository, I therefore have the version virtuoso-opensource-6.1.3-1.fc14.x86_64. I generated the ~/.odbc.ini file, then I load uniprot by: > $