Re: [Virtuoso-users] read only db?

2017-09-21 Thread Jörn Hees
> On 21 Sep 2017, at 19:23, Hugh Williams wrote: > > read-only in what sense, as if you query the Virtuoso default /sparql > endpoint it is in read only mode, thus if that is all that is exposed it > cannot be modified ? No, even stricter... read only down to filesystem level as in "no bit ch

[Virtuoso-users] read only db?

2017-09-20 Thread Jörn Hees
Hey, is there a way to run virtuoso in read-only mode, i.e., so the virtuoso.db file doesn't get modified but i can SPARQL against it? I'm asking cause this would incredibly ease scientific use cases with docker etc. and allow us to package whole ready-to-run containers e.g. for various DBpedi

Re: [Virtuoso-users] obtaining a copy/dump of an online SPARQL endpoint in a nice manner

2016-04-06 Thread Jörn Hees
On 31 Mar 2016, at 22:10, Kingsley Idehen wrote: > > How are you arriving at data devoid or metadata about its origins? Link rot... Endpoint is still working, dumps aren't... > You would be better served, ultimately, instantiating a dedicated > Virtuoso instance in the cloud for your specific

[Virtuoso-users] obtaining a copy/dump of an online SPARQL endpoint in a nice manner

2016-03-31 Thread Jörn Hees
Hi, i developed some machine learning algorithms that i'd like to run against various datasets. Many of them provide Virtuoso powered SPARQL endpoints online, but running my algorithms against them would for sure not be considered "fair use". Some datasets provide dumps, so i'm able to play nic

Re: [Virtuoso-users] full-text indexing after mass import (was: rdf_loader_run logs "missed delete of name id cache" messages)

2015-11-30 Thread Jörn Hees
Hi, any ideas on this? > On 23 Nov 2015, at 04:01, Jörn Hees wrote: > >>> >>> Reading the doc page, i have two remaining questions: >>> >>> After a normal `rdf_loader_run()`, would a >>> `DB.DBA.VT_INC_INDEX_DB_DBA_RDF_OBJ();` be suffici

[Virtuoso-users] traps: virtuoso-t[54165] general protection ip:931aa7 sp:7f9b34d2eda0 error:0 in virtuoso-t[400000+c00000]

2015-11-30 Thread Jörn Hees
Hi, i'm running a machine learning algorithm against a local Virtuoso 7.2.1 SPARQL endpoint containing ~ 6 G triples... After several weeks of using it (including reboots etc.) tonight it crashed after > 6h of heavy load with no further information in any of the logs than this in dmesg: > tra

Re: [Virtuoso-users] full-text indexing after mass import (was: rdf_loader_run logs "missed delete of name id cache" messages)

2015-11-22 Thread Jörn Hees
Hi, > On 23 Nov 2015, at 03:36, Hugh Williams wrote: > >>> >>> http://docs.openlinksw.com/virtuoso/sparqlextensions.html#rdfsparqlrulefulltext >> >> I really think that this could be it, as by default there seems to be an >> "all" index. > > [Hugh] If you installed the Virtuoso Faceted B

[Virtuoso-users] full-text indexing after mass import (was: rdf_loader_run logs "missed delete of name id cache" messages)

2015-11-22 Thread Jörn Hees
Hi Hugh, thanks again for your replies... > On 22 Nov 2015, at 01:46, Hugh Williams wrote: > >> What puzzles me is that after import and several checkpoints and restarts, >> just leaving the DB idle without any queries (see below) it seems to become >> busy. >> I guess it does some kind of "r

Re: [Virtuoso-users] rdf_loader_run logs "missed delete of name id cache" messages

2015-11-14 Thread Jörn Hees
Hi Hugh, > If all datasets are indicate to have loaded with ll_state = 2 and not errors > reported in ll_error then the datasets have been loaded successfully. ok, cool :) > Did you run the checkpoint command when the bulk load completed as that > should always be done ? Also after restart i

Re: [Virtuoso-users] rdf_loader_run logs "missed delete of name id cache" messages

2015-11-13 Thread Jörn Hees
Hi Hugh, > On 13 Nov 2015, at 04:11, Hugh Williams wrote: > > If you check the load_list table does it log in the ll_error column which > dataset is causing the error and you can check the file to see it is valid ? thanks for the answer... the following returns 0 rows SELECT * FROM DB.DBA.LOA

[Virtuoso-users] rdf_loader_run logs "missed delete of name id cache" messages

2015-11-12 Thread Jörn Hees
Hi, i'm trying to import the latest DBpedia dumps with 3 rdf_loader_runs on Virtuoso-Opensource 7.2.1. In the virtuoso.log file i find messages like this: 15:47:39 Server online at (pid 60790) 15:48:30 PL LOG: Loader started 15:48:57 PL LOG: Loader started 15:49:21 PL LOG: Loader started 1

[Virtuoso-users] how to build additional DAV files (e.g. dbpedia)?

2015-11-10 Thread Jörn Hees
Hi, what's the proper way to build and install the dbpedia VAD files? Is it this? > ./configure --with-layout=debian --enable-dbpedia-vad > cd binsrc > make That will generate dbpedia_dav.vad and dbpedia_filesystem.vad... am i right to assume that one is for installing via DAV upload and the ot

Re: [Virtuoso-users] quick exact label search through all languages

2015-10-08 Thread Jörn Hees
Hi Patrick, > On 8 Oct 2015, at 13:33, Patrick van Kleef wrote: > >> I know i can do something like the following, but it's terribly slow >> (timeout, no result): >> >> select * where { >> ?s rdfs:label ?l . >> FILTER(str(?l) = "贝拉克·奥巴马"). >> } >> >> [...] > > This of course would result in

[Virtuoso-users] quick exact label search through all languages

2015-10-08 Thread Jörn Hees
Hi, i'm trying to do simple entity lookup by label (exact match), but i don't know the language of the label. I know i can do something like the following, but it's terribly slow (timeout, no result): select * where { ?s rdfs:label ?l . FILTER(str(?l) = "贝拉克·奥巴马"). } e.g. http://dbpedia.o

[Virtuoso-users] how to compile further vad packages after compiling .deb packages and installing them from source?

2015-05-05 Thread Jörn Hees
Hi, i'm trying to upgrade this guide on how to set up a local linked data mirror: https://joernhees.de/blog/2014/11/10/setting-up-a-local-dbpedia-2014-mirror-with-virtuoso-7-1-0/ As 7.2.0 seems to have heavily updated the debian package, i'd now like to properly use it instead of my old guerrill

Re: [Virtuoso-users] SPARQL query size limits (GET, POST, POST DIRECT)

2015-04-07 Thread Jörn Hees
POST and POST DIRECT? Cheers, Jörn >> On 4 Apr 2015, at 18:45, Jörn Hees wrote: >> >> Hi, >> >> for my PhD (learning graph patterns for human associations) i'm currently >> experimenting with some sub-graphs that i need to match via SPARQL against a >

[Virtuoso-users] SPARQL query size limits (GET, POST, POST DIRECT)

2015-04-04 Thread Jörn Hees
Hi, for my PhD (learning graph patterns for human associations) i'm currently experimenting with some sub-graphs that i need to match via SPARQL against a Virtuoso endpoint. The sub-graph sizes range from 30 to 400K triples and are automatically transformed into SPARQL queries (basically via N3

[Virtuoso-users] http://linkeddata.uriburner.com/sparql broken?

2015-04-03 Thread Jörn Hees
Hi, if i run the default query on http://linkeddata.uriburner.com/sparql it tells me: > Virtuoso 37000 Error SQ074: Line 4: at 'in' before '(' > > SPARQL query: > define sql:big-data-const 0 > #output-format:text/html > select distinct * where {[] a ?EntityType} limit 50 Maybe someone could h

[Virtuoso-users] public sparql endpoint with dbpedia pagelinks?

2015-03-13 Thread Jörn Hees
Hi, does anyone know if there is a public endpoint that also has the dbepdia pagelinks () e.g. from http://data.dws.informatik.uni-mannheim.de/dbpedia/2014/en/page_links_en.nt.bz2 loaded? I think http://lod.openlinksw.com/sparql once had them, but

Re: [Virtuoso-users] Virtuoso query length - http 400 exception

2015-01-09 Thread Jörn Hees
Hi, On 9 Jan 2015, at 14:10, Boris Villazon-Terrazas wrote: > I'm performing a query against Virtuoso 07.10.3208 , via Jena-ARQ 2.11.2 > The query is a bit long, it has 16kb and I'm getting an http 400 > exception > > is there a way to deal with big SPARQL queries in Virtuoso (in this >

[Virtuoso-users] SPARQL: getting precise counts from a local endpoint

2015-01-05 Thread Jörn Hees
Hi, TLDR: i'm trying to get node degree counts and neighbourhood subgraphs for a lot of nodes from a local virtuoso-opensource endpoint. My problem is that i seem to get partial / wrong results (similar to https://github.com/openlink/virtuoso-opensource/issues/112 ). Now as this is a local endp

[Virtuoso-users] SPARQL specific BNode knowing its nodeID?

2015-01-05 Thread Jörn Hees
Hi, is there a way to get persistent BNode IDs in SPARQL result sets across multiple SPARQL queries in Virtuoso? Or put another way: Can virtuoso "transform" all BNodes into persistent generated URIs for me? It seems as if Virtuoso already does something like that... for example my result set c

Re: [Virtuoso-users] DBpedia & other vad files

2014-11-10 Thread Jörn Hees
On 10 Nov 2014, at 09:58, Dimitris Kontokostas wrote: > It is an option in the configure script > > Running ./configure --help you can see what extra vad's you can enable > --enable-dbpedia-vad --enable-rdfmappers-vad thanks, missed that :( Cheers, Jörn ---

[Virtuoso-users] DBpedia & other vad files

2014-11-09 Thread Jörn Hees
Hi, i'm currently trying to update my "Setting up a local DBpedia 3.9 endpoint with Virtuoso 7" guide [1]. It seems all works quite well and similar with DBpedia 2014 but for whatever reason i'm missing the DBpedia VAD package in the final step. If i check the /usr/share/virtuoso/vad/ i can onl

[Virtuoso-users] get all URIs in a owl:sameAs equivalence class

2014-09-11 Thread Jörn Hees
Hi, i have a large list of URIs. For each i would like to get all URIs being in one owl:sameAs equivalence class with it. I want to restrict this to the data which is already on the endpoint, so no sponging / federated queries. What i tried: Try: ``` select distinct * where { ?i (owl:sameAs|

Re: [Virtuoso-users] importing Freebase RDF dump: slows down, memleak?

2014-09-08 Thread Jörn Hees
On 2 Sep 2014, at 00:01, Hugh Williams wrote: >>> Development indicate your suggestion is not without merit but >>> implementation is not as simple as it may seems as the indexes are not all >>> sequential, but something like that could possibly be implemented. It is >>> suggested you could t

Re: [Virtuoso-users] importing Freebase RDF dump: slows down, memleak?

2014-09-01 Thread Jörn Hees
On 1 Sep 2014, at 17:15, Hugh Williams wrote: > [Hugh] Did you let the load continue or was it stopped ? yupp, i let it continue but it was killed for out of memory 2.5 days after my last mail... :-/ > Development indicate your suggestion is not without merit but implementation > is not as

Re: [Virtuoso-users] importing Freebase RDF dump: slows down, memleak?

2014-08-25 Thread Jörn Hees
Hi again, On 22 Aug 2014, at 17:44, Jörn Hees wrote: > On 22 Aug 2014, at 17:51, Hugh Williams wrote: > >> What I would not expect though is for the memory consumption to continue to >> increase until the server is killed due to oom error which would imply a >> pos

Re: [Virtuoso-users] importing Freebase RDF dump: slows down, memleak?

2014-08-22 Thread Jörn Hees
Hi Hugh, thanks for the reply. I know 32 GB is probably not much considering the size of the dumps, but it's the size limit of our VMs :( So i'd be willing to live with a bit slower import and response times if i can still leave it on a VM. On 22 Aug 2014, at 17:51, Hugh Williams wrote: > Wh

[Virtuoso-users] importing Freebase RDF dump: slows down, memleak?

2014-08-22 Thread Jörn Hees
Hi, TLDR: When importing the Freebase RDF dump Virtuoso seems to consume way more RAM than configured. i'm trying to load the Freebase RDF dump ( https://developers.google.com/freebase/data ) into a clean Virtuoso OpenSource 7.1.0 instance running on a VM with 4 cores and 32 GB of RAM, 300+ GB

Re: [Virtuoso-users] Conductor -> RDF -> Graphs tab doesn't show all graphs

2010-08-19 Thread Jörn Hees
OK, I did further investigations: I had a backup of the virtuoso db at the point just after loading the DBpedia dumps (en & de) and installing the DBpedia and rdf_mappers packages. I replayed this backup and executed all 3 queries: On Thursday 19 August 2010, Jörn Hees wrote: > On Thur

Re: [Virtuoso-users] Conductor -> RDF -> Graphs tab doesn't show all graphs

2010-08-19 Thread Jörn Hees
On Thursday 19 August 2010, Hugh Williams wrote: > Testing against my latest Virtuoso version 06.01.3127 build 18th August > 2010 all of the following queries and the graphs list in the Conductor > give me the same value for number of graphs in my store: > > SPARQL SELECT ?g count(*) WHERE { GRAPH

[Virtuoso-users] Conductor -> RDF -> Graphs tab doesn't show all graphs

2010-08-19 Thread Jörn Hees
Hi, I noticed is that in the virtuoso conductor under RDF/Graphs a few graphs are listed, but that this list is different from what I get with this SPARQL-query: SELECT ?g count(*) WHERE { GRAPH ?g {?s ?p ?o.} } GROUP BY ?g ORDER BY DESC 2 (As a side-note: this SPARQL-query might take a long ti

Re: [Virtuoso-users] Problems loading the DBpedia dump (very long URIs)

2010-08-08 Thread Jörn Hees
Hi Patrick, thanks for your answers, helped me a lot. On Saturday 07 August 2010, Patrick van Kleef wrote: > > 1. Is there a possibility to for example get the line number where > > the error occurred? > > The loader process creates a table called load_list which records > which datasets where no

[Virtuoso-users] Problems loading the DBpedia dump (very long URIs)

2010-08-07 Thread Jörn Hees
Hi all, after having a lot trouble with our group internal DBpedia mirror, I decided to do a fresh install. I downloaded all the files (we only need a subset of the dbpedia: {en,de}) and followed this guide yesterday: http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtBulkRDFLoaderExamp

Re: [Virtuoso-users] SPARQL Linked Data: howto configure sponger behind IRI deref for variables

2010-08-04 Thread Jörn Hees
On Tuesday 03 August 2010, Kingsley Idehen wrote: > What are your Virtuoso INI settings? The behavior you describe basically > implies that cache handling is disabled. > > The [SPARQL] section of the INI is what's relevant. The section looks like this: [SPARQL] ;ExternalQuerySource=

Re: [Virtuoso-users] SPARQL Linked Data: howto configure sponger behind IRI deref for variables

2010-08-03 Thread Jörn Hees
On Tuesday 03 August 2010, Kingsley Idehen wrote: > [...] > Jörn Hees wrote: > > If I use: > > DEFINE get:proxy "localhost:8890" > > > > with this query: > > DEFINE input:grab-all "yes" > > DEFINE input:grab-depth 1 > >

Re: [Virtuoso-users] SPARQL Linked Data: howto configure sponger behind IRI deref for variables

2010-08-03 Thread Jörn Hees
On Tuesday 03 August 2010, Ivan Mikhailov wrote: > What should be added to existing extension API configurable via > "define input:grab-resolver ..." > and "define input:grab-loader ..." > as they're described in > http://docs.openlinksw.com/virtuoso/rdfiridereferencing.html#rdfinputgrab Sorry, sa

Re: [Virtuoso-users] SPARQL Linked Data: howto configure sponger behind IRI deref for variables

2010-08-03 Thread Jörn Hees
On Tuesday 03 August 2010, Nathan wrote: > Aldo Bucchi wrote: > > Hi Ivan, Jorn, > > > > I've run into similar requirements. A catch-all solution to this could > > be to surface the ability to specify a custom deref procedure > > > > define input:iri_deref "DB.DBA.MY_CUSTOM_IRI_DEREF" > > > > Th

[Virtuoso-users] SPARQL Linked Data: howto configure sponger behind IRI deref for variables

2010-07-29 Thread Jörn Hees
Hey all, I'm currently working on a project where I want to ask a lot "cross-border" SPARQL-Queries like the following one: SELECT DISTINCT ?p ?lp ?o ?lo WHERE { ?p ?o. OPTIONAL { ?p rdfs:label ?lp. } OPTIONAL { ?o rdfs:label ?lo. } } (So I'd prefer