Re: [Virtuoso-users] deadlocks in bulk loading using rdf_loader_run function

2015-12-21 Thread Gang Fu
Is it possible to load files into staging tables first, then merge them into RDF_QUAD? Best, Gang On Fri, Dec 18, 2015 at 2:34 PM, Gang Fu wrote: > Hi, > > I have deadlock problem with function 'rdf_loader_run' running in > parallel, and I have tried many ways to avoi

[Virtuoso-users] deadlocks in bulk loading using rdf_loader_run function

2015-12-18 Thread Gang Fu
Hi, I have deadlock problem with function 'rdf_loader_run' running in parallel, and I have tried many ways to avoid deadlocks, including 1) Preprocess files using sort and uniq 2) Loading without indexes 3) Split big files into very small chunks But deadlocks problem is still

[Virtuoso-users] virtuoso.db file can not start the server

2015-11-03 Thread Gang Fu
Hi, We have copied the virtuoso.db file from one server to another one, and start the server using just the db file, but we got the following error message in virtuoso.log file, can anyone help? Thank you very much! Best, Gang - 16:00:50 OpenLink Virtuoso Universal Ser

[Virtuoso-users] cannot start server after delete

2015-05-07 Thread Gang Fu
Hi, I was running sparql delete and stopped the job. Then when I tried to start the server I got the error message: Starting virtuoso: The VDBMS server process terminated prematurely after checkpointing. The server cannot be started anymore. I checked the log file, I found this message:

[Virtuoso-users] exact string match

2015-05-07 Thread Gang Fu
Hi, I want to do fast exact string match for hundreds of millions of text strings. sparql filter regex is apparently too slow. I found bif:contains is very fast, and in virtuoso 7 we do not need to do anything after installation, bif:contains works well. However, bif:contains only does substring m

[Virtuoso-users] describe query from all graphs

2015-05-04 Thread Gang Fu
Hi, I want to use 'describe' query to retrieve triples from all of named graphs. I tried to put the following define sql:describe-mode "CBD" before the describe query in the sparql endpoint, it did not give me what I want. I also tried to edit the DB.DBA.SYS_SPARQL_HOST table, by insert a recor

Re: [Virtuoso-users] check if a stored procedure exists

2015-04-22 Thread Gang Fu
(res_vec_out) > 0) { exec (sprintf ('drop procedure %s', pname), sql_state, err_msg, vector(), 1, mdta_out, res_vec_out); if (sql_state <> '0') signal (sql_state, err_msg); } } On Tue, Apr 21, 2015 at 5:44 PM, Gang Fu wrote: > The rationale is t

Re: [Virtuoso-users] check if a stored procedure exists

2015-04-21 Thread Gang Fu
The rationale is the remove a stored procedure if it exists already. Anyone knows how to do it? Thank you very much in advance! On Sat, Apr 18, 2015 at 1:36 PM, Gang Fu wrote: > Thanks a lot, Marc! > > I want to create a procedure to drop a given procedure name if it exists: &

Re: [Virtuoso-users] best way to update large RDF stores with triples of a large document

2015-04-21 Thread Gang Fu
oogle.com/100570109519069333827/ > Facebook -- http://www.facebook.com/OpenLinkSoftware > Universal Data Access, Integration, and Management Technology Providers > > On 17 Apr 2015, at 13:29, Gang Fu wrote: > > Thank you very much, Hugh! You are right, we are going to update the large > d

Re: [Virtuoso-users] virtuoso striping

2015-04-21 Thread Gang Fu
plus.google.com/100570109519069333827/ > Facebook -- http://www.facebook.com/OpenLinkSoftware > Universal Data Access, Integration, and Management Technology Providers > > On 17 Apr 2015, at 15:05, Gang Fu wrote: > > By the way, I have tried to compress the big db file using gzip, and

Re: [Virtuoso-users] check if a stored procedure exists

2015-04-18 Thread Gang Fu
OM sys_procedures WHERE p_name LIKE pname; IF (pcount>0) DROP PROCEDURE pname; } Any idea why? Best, Gang On Fri, Apr 17, 2015 at 8:34 AM, Marc-Antoine Parent wrote: > I have used this: > > SELECT COUNT(*) FROM SYS_PROCEDURES WHERE P_NAME = :name > > > Le 2015-04-11 à 08:45, G

Re: [Virtuoso-users] virtuoso striping

2015-04-17 Thread Gang Fu
may in turn boost the performance as well? Best, Gang On Fri, Apr 17, 2015 at 8:32 AM, Gang Fu wrote: > Thank you very much, Morty! You are right, 'split' plus 'cat' is a better > option, since the server can start immediately with the rebuild db file. > > Is ther

Re: [Virtuoso-users] virtuoso striping

2015-04-17 Thread Gang Fu
checksum > stuff. So if a file transfer gets interrupted, it picks off right > where it left off. You can then do file verification outside the > scope of rsync, e.g. by doing sha1sum on both sides and comparing the > results. > > Contact your local sysadmins for assistance

Re: [Virtuoso-users] check if a stored procedure exists

2015-04-17 Thread Gang Fu
Hi, I just want to ping this question, in case it was missed Best, Gang On Sat, Apr 11, 2015 at 8:45 AM, Gang Fu wrote: > Hi, > > I want to ask how can we check the existence of a stored procedure before > we drop it? > We need to drop the stored procedure before we creat

Re: [Virtuoso-users] best way to update large RDF stores with triples of a large document

2015-04-17 Thread Gang Fu
twitter.com/OpenLink > Google+ -- http://plus.google.com/100570109519069333827/ > Facebook -- http://www.facebook.com/OpenLinkSoftware > Universal Data Access, Integration, and Management Technology Providers > > On 8 Apr 2015, at 12:27, Gang Fu wrote: > > using isql or jdbc or http will m

Re: [Virtuoso-users] virtuoso striping

2015-04-15 Thread Gang Fu
gt; On Tue, Apr 14, 2015 at 12:24:22PM -0400, Gang Fu wrote: > > > We want to copy a large virtuoso db from one server to another in > > different location. We cannot copy single 500 GB db file, which is > > slow and unstable. So we want to break the db files in different > >

Re: [Virtuoso-users] virtuoso striping

2015-04-15 Thread Gang Fu
nLink > Google+ -- http://plus.google.com/100570109519069333827/ > Facebook -- http://www.facebook.com/OpenLinkSoftware > Universal Data Access, Integration, and Management Technology Providers > > On 14 Apr 2015, at 17:24, Gang Fu wrote: > > Hi, > > We want to copy a large virt

[Virtuoso-users] virtuoso striping

2015-04-14 Thread Gang Fu
Hi, We want to copy a large virtuoso db from one server to another in different location. We cannot copy single 500 GB db file, which is slow and unstable. So we want to break the db files in different segments. I have tried with virtuoso striping: each segment has 20 GB, and in total we have over

[Virtuoso-users] check if a stored procedure exists

2015-04-11 Thread Gang Fu
Hi, I want to ask how can we check the existence of a stored procedure before we drop it? We need to drop the stored procedure before we create it, otherwise, there will be some issue, but if we drop a stored procedure that does not exist, we will get an error. So we need to check existence before

Re: [Virtuoso-users] best way to update large RDF stores with triples of a large document

2015-04-08 Thread Gang Fu
using isql or jdbc or http will make any difference? On Wed, Apr 8, 2015 at 7:25 AM, Gang Fu wrote: > There are millions of triples to be updated on weekly basis. > > On Wed, Apr 8, 2015 at 7:24 AM, Gang Fu wrote: > >> Hi, >> >> I want to update a large RDF store

Re: [Virtuoso-users] best way to update large RDF stores with triples of a large document

2015-04-08 Thread Gang Fu
There are millions of triples to be updated on weekly basis. On Wed, Apr 8, 2015 at 7:24 AM, Gang Fu wrote: > Hi, > > I want to update a large RDF store with 10 billions triples once a week. > The triples to be inserted or deleted are save in documents. > There is no variable b

[Virtuoso-users] best way to update large RDF stores with triples of a large document

2015-04-08 Thread Gang Fu
Hi, I want to update a large RDF store with 10 billions triples once a week. The triples to be inserted or deleted are save in documents. There is no variable binding or blank nodes in the documents. So I guess the best fit sparql update functions are insert data/delete data What is the best way

Re: [Virtuoso-users] create procedure in bash shell

2015-04-07 Thread Gang Fu
file_name); > } > } > > > Done. -- 13 msec. > > -- Line 72: > $ > > Best Regards > Hugh Williams > Professional Services > OpenLink Software, Inc. // http://www.openlinksw.com/ > Weblog -- http://www.openlinksw.com/blogs/ > LinkedI

Re: [Virtuoso-users] create procedure in bash shell

2015-04-07 Thread Gang Fu
I double-checked the error message and found the plus sign '+' is missing in the error message: file_len := file_len ses_len; Do we need to escape plus sign in shell script? Any comment? On Tue, Apr 7, 2015 at 4:36 PM, Gang Fu wrote: > Hi, > > In our application, we

[Virtuoso-users] create procedure in bash shell

2015-04-07 Thread Gang Fu
Hi, In our application, we want to create many different dump functions to dump different subset of triple collections from database. According to the wiki page: http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtRDFDatasetDump we can define dump one graph function in isql command li

Re: [Virtuoso-users] vhost_define vsp_user and real user

2015-02-06 Thread Gang Fu
guration is changed, they want to know whether the endpoint is still read-only... I found the system table 'http_path' tells you the 'vsp_host' for 'lpath', but not the user and user role... Best, Gang On Thu, Feb 5, 2015 at 10:17 AM, Rumi wrote: > Hi Gang

Re: [Virtuoso-users] vhost_define vsp_user and real user

2015-02-05 Thread Gang Fu
auth_fn=>'DB.DBA.HP_AUTH_SPARQL_USER', realm=>'SPARQL', opts=>vector('noinherit', 1, 'exec_as_get', 1), is_default_host=>0 ); It is password protected, but it is read+write ,even though I have: 'exec_as_get', 1 Best, Gang On Wed, Fe

Re: [Virtuoso-users] vhost_define vsp_user and real user

2015-02-03 Thread Gang Fu
, Feb 3, 2015 at 12:35 PM, Rumi wrote: > Hi Gang Fu, > > On 03-Feb-15 3:47 PM, Gang Fu wrote: > > Hi Rumi, > > I looked at the source code of libsrc/Wi/sparql_io.sql for procedure > WS.WS."/!sparql/": > create procedure WS.WS."/!sparql/" (inout path

Re: [Virtuoso-users] vhost_define vsp_user and real user

2015-02-03 Thread Gang Fu
b 3, 2015 at 8:10 AM, Rumi wrote: > Hi Gang Fu, > > On 03-Feb-15 1:15 PM, Gang Fu wrote: > > Hi, > > I am using function vhost_define() to expose read-only sparql endpoint > through another port (different from 8890) for security concern. > > I have two questio

Re: [Virtuoso-users] vhost_define vsp_user and real user

2015-02-03 Thread Gang Fu
SERVICE_DATA" does not exist. But it does not allow me to expose /sparql endpoint using vsp_user "SPARQL". What I am really interested in is how to expose sparql endpoint using vsp users other than dba. Best, Gang On Tue, Feb 3, 2015 at 8:10 AM, Rumi wrote: > Hi G

[Virtuoso-users] vhost_define vsp_user and real user

2015-02-03 Thread Gang Fu
Hi, I am using function vhost_define() to expose read-only sparql endpoint through another port (different from 8890) for security concern. I have two questions: 1) how can I expose a sparql endpoint using account other than 'dba'. I have tried to using vsp_user=>'SPARQL', but I got '404 cannot a