Re: [Virtuoso-users] 5.0.9: built from source: var/lib/virtuoso/demo missing
Ceriel Jacobs wrote: When building Virtuoso 5.0.9 from source using instructions in the readme file, everything goes quite well, untill the point reading "Starting the Demo Database": $ cd var/lib/virtuoso/demo -bash: cd: var/lib/virtuoso/demo: No such file or directory Any idea what I could have done wrong, in that there is no var/lib/ virtuoso/demo being created? [] Interesting. I'll have a look at the README and see what's up there. Meanwhile, http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VOSMake#Installation is probably what you want. var/lib/virtuoso/db/ - there is no demo/ and hasn't been for a little while. Cheers, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Server Startup Command Line Options: minus options (-fcnCbDARwMKrBd) where explained?
Ceriel Jacobs wrote: In search for information how to launch virtuoso-t as a daemon in mac os x, I was looking for information what all different virtuoso-t command line startop options (-fcnCbDARwMKrBd) mean. My tries: 1. $ ./virtuoso-t -? Didn't give me a clue, as it lists only the plus (+) prefixed command line options. 2. Manual section 6.1.10.1 It only says that -d = +debug and -f = +foreground. Where can I find documentation what the other minus (-) prefixed virtuoso-t command line startup options mean? Any suggestions which command line arguments to use when running virtuoso-t in daemon mode (on mac os x) are also welcome... No options required at all! Or you'll find +wait useful, perhaps - detaches itself once it's fully started up and online. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] The default graph when not set
Kjetil Kjernsmo wrote: All, I've been reading http://docs.openlinksw.com/virtuoso/rdfapiandsql.html#rdfdefaultgraph but I'm still confused what the default graph is when none of these things are set. That is, I'm not sending a HTTP parameter, I have no FROM clauses, no define and nothing in DB.DBA.SYS_SPARQL_HOST. It appears not to return the query the whole merged graph, but I don't understand which subset it returns. It appears to return data from a few graphs. Perhaps I'm just blind, but I hope someone will help me see :-) Does the ini-file, [SPARQL] ;ExternalQuerySource= 1 ;ExternalXsltSource = 1 ResultSetMaxRows= 10 ;DefaultGraph = http://localhost:8890/dataspace come into play at all? Cheers, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] I cant edit the user profile,..
Cristian Vasquez wrote: Hello, We have two accounts on our ODS server[1]: cristian.vasquez and leonardo.soto. Both were created following the sign up process. Now, for some unknown reason, cristian.vasquez can't edit his profile. When clicking the "edit" link, an error page appears, saying: 14:12:12 PL LOG: ODS [100] Not found exception But leonardo.soto doesn't have any problems. Is there an easy way to compare both users? That way we could find what is triggering the bug (assuming it is a bug). Hi, You could have a look in /conductor, in the sysadmin / users tab. Open them up in two tabs side by side and see what parameters (username, is a DAV user, has a home-dir?) they have in common. You could also have a poke in the db..sys_users table, but that's less visually pleasant. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] i cant upload pictures to the WebDav
Cristian Vasquez wrote: Hello all! We are making use of the app's, the problem comes when we try to upload a picture to the WebDav the server freezes up. And we dont get logging output. We are running virtuoso en a EC2, Hi, Let's gather a bit more debugging information: a) in the ini-file, set PLDebug=1 b) restart the server using virtuoso-iodbc-t -df so it runs in foreground mode c) using isql, execute trace_on('errors'); d) make the problem happen e) while it's "hung", check for server debug output and in isql, run status(); to see what it's doing f) do you have the rdf_mappers VAD package installed? Cheers, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] i cant upload pictures to the WebDav
Cristian Vasquez wrote: Thank you in advance for your response, I did the following procedure to gather more information: with PLDebug=1 i connected to webdav using a linux client, then i copied a .png file, and the Connection terminated unexpectedly. On the isql console: SQL> status(); *** Error 08S01: [Virtuoso Driver]CL065: Lost connection to server at line 2 of Top-Level: I had the rdf_mapper installed, so i proceeded to uninstall it for testing, then i did the same procedure, and it did hung (i didn't lost the connection) and it said: [] Hi, It sounds a little weird. I'm advised that the EC2 build is out of date, so could you run a quick `yum update' and try it again please? Thanks, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] /conductor not found ?
Marc-Alexandre Nolin wrote: Hello, I've problem accessing /conductor since I've upgraded from 5.0.5 to 5.0.9 When I do http://localhost:/sparql it work for everyone of my 31 servers running on this computer. When I do http://localhost:/conductor everyone of them is now answering me - Error HTTP/1.1 404 File not found The requested URL was not foundURI = '/conductor' - When I start a Virtuoso instance, I receive this PL LOG: Can't get list of vad packages in /opt/virtuoso/share/virtuoso/vad/ --> this folder really contain vad files I'm running this on a Linux Fedora 8. Virtuoso is installed in /opt in folder virtuoso-5.0.9 My older virtuoso is installed in /opt also in folder virtuoso-5.0.5 I've created a symbolic link to virtuoso in the /opt folder like this lrwxrwxrwx 1 rootroot 15 2009-02-06 15:52 virtuoso -> virtuoso-5.0.9/ drwxr-xr-x 6 rootroot4096 2008-03-18 17:03 virtuoso-5.0.5 drwxr-xr-x 6 rootroot4096 2009-02-06 15:52 virtuoso-5.0.9 What Am I doing wrong? I need conductor to change Sparql users properties to add update to it. You might want to check the virtuoso.ini file for the paths it contains in both the DirsAllowed and VADInstallDir as well. I expect you've done a `make install prefix=/opt/virtuoso-5.0.9' or similar at some stage so the paths might be broken. As Kingsley suggests, it's best to just make install on top of old versions and copy backups whenever you feel like it. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] /conductor not found ?
Tim Haynes wrote: Marc-Alexandre Nolin wrote: [...] Error HTTP/1.1 404 File not found The requested URL was not foundURI = '/conductor' - When I start a Virtuoso instance, I receive this PL LOG: Can't get list of vad packages in /opt/virtuoso/share/virtuoso/vad/ --> this folder really contain vad files [] You might want to check the virtuoso.ini file for the paths it contains in both the DirsAllowed and VADInstallDir as well. I expect you've done a `make install prefix=/opt/virtuoso-5.0.9' or similar at some stage so the paths might be broken. As Kingsley suggests, it's best to just make install on top of old versions and copy backups whenever you feel like it. Also a thought: if the conductor really isn't installed, you can install a VAD using isql: isql> vad_install('vad/conductor_dav.vad', 0); Adjust the source path and DirsAllowed parameter in the ini-file to taste. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
[Virtuoso-users] Announcing OpenLink Virtuoso, Open-Source Edition, v5.0.10
Hi, OpenLink Software is pleased to announce a new release of Virtuoso, Open-Source Edition, version 5.0.10. This version includes: Database: * Initial support for JDBC 4.x in the JDBC Driver * Self-signed certificates and optional client-verification in HTTPS * HTTP ACLs for rate-limiting * A new `TOP(N, -1)' function for skipping N rows prior to resultset construction * New INI-file options LiteMode and DisableTcpSocket for thinner embeddable RDF or SQL RDBMS operation, RdfFreeTextRulesSize and IndexTreeMaps for better memory control * Fixes for a deadlock handler bug and various 64-bit issues and compiler warnings * Performance optimizations in the core database engine RDF Data Management & Data Access: * New Meta Cartridges for UMBEL, Calais, Zemanta, Hoovers and the New York Times * New Sponger cartridges for AB Meta, Last.FM, Twitter, Meetup.com, LibraryThing, SalesForce.com, RadioPop, Rhapsody * Added support for FOAF+SSL * New (X)HTML browser page for RDF Linked Data * SPASQL ExtendedString and RdfBox types in .NET * new CURIE-generation functions * Amazon S3 DET and WebDAV mounting * improved Turtle output presentation * Various SPARQL and SPARUL updates and extensions and fixes * Automated generating OWL from DB schema * Fixed memory leaks OpenLink Data Spaces Application-suite: * New OAuth support * Support for foaf+ssl self-signed certificates written to in FOAF-based member profiles * Support for Amazon S3 folders in ODS-Briefcase * New contact fields in ODS-AddressBook * Ubiquity commands for interacting with all Data Spaces programmatically For more details, see the release notes: https://sourceforge.net/project/shownotes.php?group_id=161622&release_id=660861 Other links: Virtuoso Open Source Edition: * Home Page: http://virtuoso.openlinksw.com/wiki/main/ * Download Page: http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload OpenLink Data Spaces: * Home Page: http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef OpenLink AJAX Toolkit (OAT): * Project Page: http://sourceforge.net/projects/oat * Live Demonstration: http://demo.openlinksw.com/oatdemo * Interactive SPARQL Demo: http://demo.openlinksw.com/isparql/ OpenLink Data Explorer (Firefox extension for RDF browsing): * Home Page: http://ode.openlinksw.com/ Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] XPATH/XSLT on sponged RDFa
Kingsley Idehen wrote: Jem Rayfield wrote: Hi Kingsley, I want to push content into Virtuoso via HTTP rather than a crawl mechanism. I don't think the content crawler is what I am after. Yes. When you PUT data into Virtuoso, sponging can occur, it depends on where you PUT the data :-) Our content gets created and pushed onto publish/rendering queues. I need to aysnch the triple extraction as and when content is published rather than waiting for a publishing mechanism, exposure onto public facing web servers and a subsequent crawl. Ideally I would like the extraction process to work on new content documents (rdf) and augment the rdf to an existing graph. (Will a HTTP post approach always create a new graph? Maybe I have configured something incorrectly?) New graph if you create resources in the RDF_Sink folder. Otherwise not. Of course you can tailor all of this to your specific needs e.g. put the triples in one graph. (The crawl mechanism certainly looks like a very interesting feature but I don't think it fits this use case. Although I could have missed something?) After pushing the XHTML2/RDFa content into Virtuoso via HTTP I am able to use SPARQL on the quad store. The origin document is also available via the DAV interface. Yes. However I am assuming that your DAV store is built using database tables and thus the sponging process also consumes the XHTML into a Table (XMLType (text index)). This Table/XMLType could then be queried using SQL/SPARQL?. I could then maybe even be expose these a stored proc using virtuoso web service->PL? Yes, but you should use WebDAV as if first via functions. Also note we do have a separate WebDAV Cartridge that simply makes an RDF graph of DAV resources. This particular cartridge is about the DAV information resources. Thus, you have SPARQL access to these, you just use the http:///webdav Graph IRI. Even better, if you install ODS-Briefcase, all you DAV resources are exposed via a more granular graph using the SIOC Ontology. Only if the ODS-Briefcase or basic WebDAV graphs don't meet your needs should you consider writing Virtuoso PL against the WebDAV tables. Something to bear in mind: DAV_PROP_SET ('/DAV/home/me/rdf_sink/', 'virt:rdf_graph', someIRI, 'me', 'mypassword'); Subsequent uploads into rdf_sink will use the someIRI specified in the virt:rdf_graph DAV Property as their graph. I'm sure this can be set using the WebDAV Browser via Conductor and probably the ODS-Briefcase UI if required. ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] User Authentication via LDAP server failed
Matthias Löbe wrote: Hello, we installed Virtuoso version 05.09.3035 on Debian and want to use OpenLDAP as an authentication service. We succesfully connected to the LDAP server in Virtuoso Conductor >> System Admin >> User Accounts >> LDAP Servers, and could possibly import user data manually. However, wenn we try to user LDAP login and password to connect to Virtuoso Conductor "at runtime", user authentification failed due to "Invalid credentials" (LDAP error code 49?). If we specify LDAP settings in Virtuoso Account Management, I can see the succesful LDAP bind at network level using wireshark. On the other hand, when logging into Virtuoso Conductor, there is no bind attempt made by Virtuoso to LDAP. Is this functionality for one-time importing user data only? Hi, It does work for dynamic lookups, with three provisos: a) Virtuoso has to make the connection to ldap as the admin/root user in ldap; b) you correctly assign the field to be used as a password; c) the ldap password will be treated as plaintext by Virtuoso. Hence, if you've used e.g. SHA1-hashing on your LDAP store, prepare to type some very long strings into ODS login password boxes. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] User Authentication via LDAP server failed
Matthias Löbe wrote: Hello Tim, thank you for your answer. In case you ever want to improve LDAP support, I would have some addditional wishes: a) the uid field should be used for a subtree filter query rather then for composing the RDN in form "uid=$1,..." since some directory services (as ours) won't use DN's starting with "uid=" b) allow empty base DN, because possibly you have users in distinct parts of the DIT, i.e. starting with c=de, c=us, c=fr ... c) support groups. I might wish not to give all user the right to access but limiting it to a certain group which member DN's will have access d) use displayName rather than cn for the user's name Thanks; I've noted your suggested enhancements internally :) Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] using the vad wiki package
Hugh Williams wrote: Kurt, On 16 Mar 2009, at 18:27, Kurt J wrote: hmmm when i get to step 4 i get a proxy error. this seems to goto http://localhost:8890/wiki/ which firefox doesn't seem to like ("Proxy server refused connection"). as i'm proxying thru my localhost ssh tunnel to access the virtuoso instance which is only facing inside uni. [Hugh] In your virtuoso.ini configuration file what is the value of the "DefaultHost" param in the "[URIQA]" section as I do believe the localhost:8890 is being picked up from this setting and you can change this to the value of the external host name being used. Although still that should not account for the error you are experiencing having made the same setting on my server and still being able to access the Wiki instance maybe somehow it works at uni - i won't know until next week when i return. i've tried changing conductor->Sys Admin-> Packages -> Framework -> configure to use cognac.qmul.ac.uk instead of localhost but the wiki links still seem to point to localhost [Hugh] So you configured a new HTTP listener endpoint to try and setup the external hostname on ? As an aside, check your networking setup by doing a double-lookup on hostname: dig +short `hostname` dig +short -x $(dig +short `hostname`) Or just check /etc/hosts, make sure the machine's hostname has a line to itself. ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Permission to execute a "SPARUL_CLEAR"?
Bob DuCharme wrote: I tried to execute a "clear graph" command as shown at the end of 15.4.3 at http://docs.openlinksw.com/virtuoso/rdfsparul.html and got this: 42000 Error SR186: No permission to execute procedure DB.DBA.SPARUL_CLEAR. When I go to the Edit Grants of [username] screen in the Conductor and pick Show All, it looks like there are dozens and dozens of named permissions to grant, many with very cryptic names. What do I need to grant an account to enable it to clear graphs with a SPARUL query? Hi, Have you given them SPARQL_UPDATE? ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Debian packages again
Stéphane Laurière wrote: All, Now that Debian has been released, I'm wondering what the status of the official Debian packaging of Virtuoso? I have my own packages, but I only package for one architecture (and both i385 and amd64 is common), and the package structure isn't quite good (e.g. virtuoso.ini should be in /etc/ and virtuoso.log should be in /var/log). Also, I've learnt that the NEPOMUK project has a stripped-down version of Virtuoso. Thus, it would be nice to have different packages, virtuoso-core, virtuoso-server, virtuoso-conductor, etc., built from the source. Is this in the making? Hi Kjetil, hi everyone, I'm currently packaging Virtuoso for Mandriva, in the frame of Nepomuk indeed (http://nepomuk.kde.org). I copied the current SPEC file there (the subpackages need to be redefined though, taking into account your suggestion, see my remarks below): http://mandriva.pastebin.com/m68576155 Once done, I'll see with some Debian savvy friends whether they can create the .deb as well. You should know that we already have contacts with Debian over this; I'll chase them up and see what's happening. Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Programming Virtuoso. Recommended Environment
Aldo Bucchi wrote: Hi, Just wondering. Do you have any recommended environment for Virtuoso PL programming? Grammars of any kind? I am finding it a bit error-prone to code by hand. PL/SQL color hinting helps though. Personally I use emacs (Aquamacs on the mac) with its default SQL mode. Presumably other editors have similar SQL/PL highlighting etc. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] FYI: VOS 5.0.10 - breaks make -j2 (Mac OS X 10.5.6 64-bit )
Ceriel Jacobs wrote: For your information. Building VOS 5.0.9 with 'make -j2' succeeded in december 2008. Now trying with VOS 5.0.10. After some failed VOS 5.0.10 build experiments, executed were: $ make clean $ CFLAGS="-O -m64 -mmacosx-version-min=10.5" $ export CFLAGS $ ./configure && make -j2 && sudo make install && make check 'make' without '-j2' finishes the VOS 5.0.10 build process. Hi, Thanks for that - I gather it's already a known issue that should hopefully be fixed soon. Cheers, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Local DBPedia restore
Steve Judkins wrote: Running this locally downloads the data fine, but fails during the reassemble phase with: ERROR SR406: Running of file '/bin/sh' is not allowed in run_executable(). (42000). Hi, You might want to investigate AllowOSCalls in virtuoso.ini. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
[Virtuoso-users] Announcing OpenLink Virtuoso, Open-Source Edition, v5.0.11
Hi, OpenLink Software is pleased to announce a new release of Virtuoso, Open-Source Edition, version 5.0.11. This version includes: * Database engine - Added x.509 Certificate Generation & Management functions - Improvements to session-handling (strses) to avoid temp-files and improve threading support - Added initial support for gzipped stream session - Added support for HTTP, socks4 and socks5 proxying with authentication options - Added support for URIQA methods in http_client() - Added support for gunzip in http_client - Various fixes for FT optimization, fractions in datetime, checkpoint-rollback and the compile/build process. * SPARQL and RDF - Added compiler extensions for SPARQL graph-level security - Added initial implementation of RDF graph-level security metadata functions - Added initial infrastructure for new SPARQL result serialization - Added support for SSG_VALMODE_SHORT_OR_LONG - Added support for define sparql-get:proxy for RDF mappers - Enhanced N3 syntax support - Added support for XML literals in RDF/XML, SPARQL XML resultset and JSON outputs - Enhanced speed of TTL output - Fixed SPARQL/SPARUL security - VoiD graph generation for describing Quad Store * Sponger Cartridges Related - Added U.S. Congress Web service - Added Del.icio.us Tag Lookup Meta Cartridge - Added GoodRelations and Barters for eCommerce Services - Added NYT Articles Lookup Meta Cartridge - Added OpenStreetMap Cartridge - Added O'Reilly Books Catalog Lookup Meta Cartridge - Added PowerPoint (PPTX) Cartridge - Added SCOT based Tag Cloud - Added Technocrati Lookup Meta Cartridge - Misc. fixes - Fixed GPF in rare case when using NOT FROM / NOT FROM NAMED - Fixed handling of class instance array - Fixed i18N issues with freetext search in RDF - Fixed i18N serialization of RDF/XML box - Fixed incorrect result when Accept is set to "text/rdf-n3" - Fixed passing retvals of variables from OPTION(), like ?SCORE ?x, from deeply nested subselects * ODS Applications - Added FOAF+SSL and FOAF+SSL+OpenID - Added Bibliographical ontology usage in ODS Graph - Added Calendar API and upstream commands - Added "One-Click" X.509 Certificate, Private Key generation plus Browser import, and write to FOAF profile - Added Messaging Services - Added Relationships Ontology terms to ODS-AddressBook for qualifying relationships in Social Network - Added Biographical Ontology terms added to Profile Page UI - Added Support for MS Live Contacts API - Additional Ubiquity commands for relationship qualification in Social Network data spaces - Added Support for Portable contacts api - Fixed OpenID registration/auth in FOAF+SSL+OpenID implementation For more details, see the release notes: https://sourceforge.net/project/shownotes.php?group_id=161622&release_id=677418 Other links: Virtuoso Open Source Edition: * Home Page: http://virtuoso.openlinksw.com/wiki/main/ * Download Page: http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload OpenLink Data Spaces: * Home Page: http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef OpenLink AJAX Toolkit (OAT): * Project Page: http://sourceforge.net/projects/oat * Live Demonstration: http://demo.openlinksw.com/oatdemo * Interactive SPARQL Demo: http://demo.openlinksw.com/isparql/ OpenLink Data Explorer (Firefox extension for RDF browsing): * Home Page: http://ode.openlinksw.com/ Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] openlink data explorer
rick wrote: I've been successfully working with Virtuoso for a while now and I had a few questions about results I'm seeing in the OpenLink Data Explorer (ODE). Based on my current understanding, the results are part of the sponging that takes place in Virtuoso during dereferencing. Is this listserv the right place to ask, or is there an ODE listserv? Here's fine. Go ahead by all means. :) Cheers, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
[Virtuoso-users] Announcing Virtuoso Open-Source Edition version 6 Technology Preview 1
Hi, OpenLink Software is pleased to announce a Technology Preview release of Virtuoso, Open-Source Edition, version 6.0-TP1. Currently best suited to developers, this introduces a new branch for Virtuoso with: * ANY ORDER Queries * Anytime Queries * Client-level resource accounting * Expressions in "IN" predicate * Facet Browsing Engine * Inverse Functional Property Value enhanced Identity * Key compression * Transitive subqueries in both SQL and SPARQL For more details, see the release notes: https://sourceforge.net/project/shownotes.php?group_id=161622&release_id=677866 Other links: Virtuoso Open Source Edition: * Home Page: http://virtuoso.openlinksw.com/wiki/main/ * Download Page: http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload OpenLink Data Spaces: * Home Page: http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef OpenLink AJAX Toolkit (OAT): * Project Page: http://sourceforge.net/projects/oat * Live Demonstration: http://demo.openlinksw.com/oatdemo * Interactive SPARQL Demo: http://demo.openlinksw.com/isparql/ OpenLink Data Explorer (Firefox extension for RDF browsing): * Home Page: http://ode.openlinksw.com/ Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Insert data fast
Yrjänä Rankka wrote: Sören Auer wrote: Ivan Mikhailov wrote: Unfortunately, we can offer plain INSERTs only, but they're not bad, esp. when parametrized. You mean wen run as prepared statements? Yes. You prepare statement, then exec it repeatedly with parameters - this is the fastest way of inserting bulk. Whatever language/connectivity method you're using, arrange for this to happen: a) drop index ; b) begin work; prepare insert into table values ? ? ?...; repeat N { bind parameters ; execute } commit c) create index...; Choose an N that reflects a trade-off of block-size of rows between speed and confidence that all the inserts therein are going to work; life's faster if it doesn't have to autocommit every row inserted individually (hence beginning and committing a transaction around block-loads at a time), but if a given transaction fails for any reason, all the rows in that block will be omitted. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Limited number of SPARQL inserts ?
Alexander De Leon wrote: I'm inserting RDF triples into Virtuoso Open Source 6.0.0-tp1. The triples are inserted one by one using the following code: for (StmtIterator i = rdf.listStatements(); i.hasNext();) { Statement stmt = i.nextStatement(); sparql = "INSERT INTO GRAPH <" + graphUri + "> { " + NTripleStamentWriter.writeStament(stmt) + " }"; if (LOG.isDebugEnabled()) { LOG.debug(sparql); } VirtuosoUpdateRequest vqe = VirtuosoUpdateFactory.create(sparql, virtGraph); vqe.exec(); if (progressMonitor != null) { progressMonitor.setProgress(++counter, total); } } After exactly 28229 triples has been inserted. The following exception is thrown by the next insert: Caused by: com.hp.hpl.jena.update.UpdateException: Convert results are FAILED.: at virtuoso.jena.driver.VirtuosoUpdateRequest.exec(Unknown Source) at com .dumontierlab .pdb2rdf .dao .impl .VirtuosoTripleStoreDaoImpl.insert(VirtuosoTripleStoreDaoImpl.java:88) ... 2 more Caused by: virtuoso.jdbc3.VirtuosoException: Connection failed: Cannot assign requested address at virtuoso.jdbc3.VirtuosoConnection.connect(Unknown Source) at virtuoso.jdbc3.VirtuosoConnection.connect(Unknown Source) at virtuoso.jdbc3.VirtuosoConnection.(Unknown Source) at virtuoso.jdbc3.Driver.connect(Unknown Source) at java.sql.DriverManager.getConnection(DriverManager.java:582) at java.sql.DriverManager.getConnection(DriverManager.java:185) ... 4 more I know it happens exactly at the insert number 28230 because I tried with different datasets and I get the same exception. When I look at the graph statistics, it tells me that there are 28229 triples. This code used to work fine with virtuoso 5.0.10. Hi, Confusing; why should it want to be (re)connecting via JDBC at that point? What errors are there in the server logs? You should probably run with some of the trace_on() options enabled and server in foreground mode (virtuoso-t -df) - see http://docs.openlinksw.com:80/virtuoso/fn_trace_on.html for more. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] What is the best way of migrating large RDF database from Virtuoso 5.0.x to 6
Matthias Samwald wrote: Dear all, I am facing a relatively simple problem, but it seems like there is no mechanism to really address this issue: I have a large RDF database (>400 million triples, dozens of named graphs) in a Virtuoso 5 instance that I want to transfer to a Virtuoso 6 instance. What is the best way of doing that? The main problem is re-creating the named graphs. Virtuoso still has no mechanism to dump RDF data including graph provenance (correct?), You can write a simple enough stored procedure to do that. -- Dump a graph to specified filename in DAV create procedure me..dumpgraph (in iri varchar, in fname varchar) { declare res, spq, state, msg, maxrows, metas, rset, ses, triples, s, path any; spq:=sprintf('sparql CONSTRUCT { ?s ?p ?o . } from <%s> WHERE { ?s ?p ?o . }',iri); -- first dump to TTL files dbg_printf('Preparing query..\n'); ses:=string_output(); exec (spq, state, msg, vector(), maxrows, metas, rset); path:=sprintf('/DAV/home/me/dumps/%s.ttl', fname); dbg_printf('Path is: [%s]', path); triples := rset[0][0]; rset := dict_list_keys (triples, 1); DB.DBA.RDF_TRIPLES_TO_TTL (rset, ses); s := string_output_string (ses); DAV_RES_UPLOAD (path, s, 'application/rdf+xml', '110100100NM', 'me', null, 'me', 'me'); -- Then dump to RDF/XML files dbg_printf('Preparing query..\n'); ses:=string_output(); exec (spq, state, msg, vector(), maxrows, metas, rset); path:=sprintf('/DAV/home/me/dumps/%s.rdf', fname); dbg_printf('Path is: [%s]', path); triples := rset[0][0]; rset := dict_list_keys (triples, 1); DB.DBA.RDF_TRIPLES_TO_RDF_XML_TEXT (rset, 1, ses); s := string_output_string (ses); DAV_RES_UPLOAD (path, s, 'application/rdf+xml', '110100100NM', 'me', null, 'me', 'mypassword'); -- Log the graph IRI/fname mapping spq:=sprintf('sparql PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>\ninsert into graph <http://localhost:8892/dumps/> { <%s> <http://localhost:8892/dumps/%s.rdf> }', iri, fname); dbg_printf('Updating quadstore with [%s]\n', spq); exec (spq, state, msg, vector(), maxrows, metas, rset); }; Obviously you don't have to choose DAV output if you don't want, just as long as the filesystem dir is listed in DirsAllowed in the ini-file. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] hosting_php.so
Sebastian Hellmann wrote: Hi all, I'm currently analising the structure of Virtuoso, PHP and VAD, because I'm trying to create an OntoWiki VAD. My problem is that I could not locate hosting_php.so Specs: Ubuntu 9.04, I compiled it myself, standard options. I tried version 6.0-tp1 and also 5.011 13:27:46 { Loading plugin 7: Type `Hosting', file `hosting_php.so' in `/opt/virtuoso-opensource-6.0.0-tp1/lib/virtuoso/hosting' 13:27:46 FAILED plugin 7: Unable to locate file } I used "find . | grep hosting_php", but could not find it anywhere. Should it not be created automatically? You need to specify ./configure --with-php5=/usr/local/php5 so it finds a version of php5 which was built with the correct options. I've just updated the documentation at http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VOSBldPHP (note: our required options for building PHP5 have changed a bit) and will be adding a more comprehensive document on Virtuoso+PHP shortly. As a second issue. I tried to analyze the mediawiki_fs.vad . It would be nice to see be able to see the inside and the VAD ticket to reuse it. Is the source of the VAD for it or another php project like phpBB or Wordpress available. There's a Tutorial on PHP hosting that incorporates a WebCalendar project: http://demo.openlinksw.com/tutorial/hosting/ho_s_30/ho_s_30.vsp http://localhost:8890/tutorial/hosting/ho_s_30/ho_s_30.vsp then have a rummage around in binsrc/tutorial/hosting/ especially binsrc/tutorial/hosting/ho_s_30/WebCalendar/ HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] hosting_php.so
Sebastian Hellmann wrote: Thanks for your help Tim. I still didn't succeed. Could you verify the steps I took and see if I'm missing anything: sudo su Downloaded iodbc latest version ./configure --prefix=/opt/lib/iODBC make make install Downloaded php-5.2.10 ./configure --prefix=/opt/lib/php5 --enable-maintainer-zts --with-tsrm-pt… …hreads --enable-embed=shared --disable-static --with-config-file-path=. --disa… …ble-cgi --disable-cli --disable-ipv6 --disable-pdo --without-mysql --without-p… …ear --with-zlib --with-iodbc=/opt/lib/iODBC make make install Downloaded virtuoso-opensource-6.0.0-tp1 ./configure --prefix=/opt/virtuoso-opensource-6.0.0-tp1 --with-readline=/u… …sr/lib/libreadline.so --with-php5=/opt/lib/php5 make make install You're along the right lines here; the critical --with-php5=somewhere bit, and the configure command for php5, seem correct. I could not find a file called hosting_php.so anywhere, what could I be doing wrong? If needed, I could also provide the compile logs. It might be easiest to see the config.log for virtuoso - search backwards through it for `php' and look for obvious errors. Or post a copy on the list and we'll have a look. Furthermore, I tried the debian package by Will Daniels, but it seems to come without php Do you think it would be better to try with Virtuoso 5.0.11 ? I'm using 5.0.11 as a baseline in my own tests here, so it might be wisest if you can't get 6.0.0-tp1 cranking easily. Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] hosting_php.so
Sebastian Hellmann wrote: ok, still no luck with 5.0.11 here is some output: cat config.log | grep php $ ./configure --prefix=/opt/virtuoso-opensource-5.0.11 --with-readline=/usr/lib/libreadline.so --with-php5=/opt/lib/php5 config.status:912: creating binsrc/hosting/php/Makefile php4_CFLAGS='' php4_LDFLAGS='' php5_CFLAGS='' php5_LDFLAGS='' cat config.log | grep PHP HAVE_PHP4_FALSE='' HAVE_PHP4_TRUE='#' HAVE_PHP5_FALSE='' HAVE_PHP5_TRUE='#' The log can be found here: http://db0.aksw.org/downloads/config.log Still no hosting_php.so in sight anywhere. Maybe the plugin path in the ini is wrong? [] I've just been reminded: it should be --enable-php5=/opt/lib/php5, rather than --with; this would explain why configure effectively ignores your directive in the log. Could you try this? Cheers, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] hosting_php.so
Sebastian Hellmann wrote: Hi, here some feedback: I finally succeeded. Besides the --enable-php5 option, ./configure also needs --with-iodbc=/path/to/iODBC otherwise compilation will fail Good news! Then it is also necessary to copy the libphp5.so, which is mentioned in the ini (Load7 = attach, libphp5.so), to the hosting directory. the file can be found somewhere in the compiled php folder. hosting_php.so is in place after make install. Yes, this is true. Also any PHP extensions you wish to use must be copied into hosting/php or similar. I hope my findings will make it into the docu at: http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VOSBldPHP Actually they are already in the upcoming document I'm working on :) Thanks for your help, now I will try to create the ontowiki vad. Good luck - let us know if you need a further hand by all means :) ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] hosting_php.so
Steve Judkins wrote: While we are on this topic... Does connecting an from an external install of php via iODBC give you exactly the same functionality? Do the Wordpress and Drupal scripts (for ODS integration) work without requiring the php hosting? Hi, I see no reason why you couldn't host in apache and use Virtuoso just for the data backend, if you wanted: for example, drupal's settings.php contains a line $db_url = 'odbc://drupal:ignored@Local Virtuoso/drupal'; I plan on trying this again soon but my last effort to use the php hosting stalled because I couldn't get some of my required php plugins working properly. How so? For the record, I have a php-5.2.10 I built myself as per that VirtBldPHP webpage, with custom APC module from source - so something's possible, for sure. Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] hosting_php.so
Steve Judkins wrote: [] The issue may be particular to how PHP packages are installed on Ubuntu. It's been over 3 months since I tried it but I vaguely recall the problem was the directory where the php.ini was expecting the extension_dir to load plug-ins from. Ubuntu debian packages had moved around (cleaned up) where some of the plug-ins and their config.ini files are placed (e.g. /etc/php5/apache2/conf.d/). I couldn't get Virtuoso's hosted PHP to find them. Beware. Ubuntu's php5 build is lacking the configure options: --enable-maintainer-zts \ --with-tsrm-pthreads \ so attempting to use the standard system-wide PHP library with Virtuoso on Ubuntu is probably unwise. From a quick inspection of their debian/rules file, I can see they move extension modules around the filesystem (mentions of --with-jpeg-dir=shared,/usr \ --with-xpm-dir=shared,/usr/X11R6 \ --with-png-dir=shared,/usr \ ...) However, when virtuoso starts, if it can't load a module listed in php.ini, it does tell you (in the virtuoso.log) what it was looking for. Example: 16:25:33 PHP Warning: PHP Startup: Unable to load dynamic library '../hosting/php/apc.so' - ../hosting/php/apc.so: cannot open shared object file: No such file or directory in Unknown on line 0 HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] VOS PHP URI rewrite
Hugh Williams wrote: Hi Sebastian, Virtuoso support URL rewriting for Linked Data deployment as detailed at: http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtDeployingLinkedDataGuide_Introduction#AncmozTocId502192 As an additional note, I recommend having a play in the Conductor, virtual hosts and directories, where you edit rewrite rules on individual directory-mapping entities. Additionally, you can export a vhost/vdir specification as a SQL statement straight from the conductor, thereby giving a template for programmatic re-creation as part of a VAD package installation. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] VAD, virtuoso php POST data not arriving
Sebastian Hellmann wrote: Hello, I succeded in producing the vad file. We have a very strange problem with it. The data from the login form is collected by javascript and submitted as a post request. Firebug shows that the post is completely valid, see below for details. The problem is that the data never arrives at the receiving php side, i.e. $_POST is empty. Interesting. I can assure you that empty $_POST is not a normal problem, having just set up a test here with a dummy form for the purpose. So presumably it's something more local to your environment. What versions of components (php, virtuoso) are you using? I'll grab the VAD and have a poke around tomorrow. Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
[Virtuoso-users] Announcing iODBC version 3.52.7
Hi, OpenLink Software are pleased to announce the release of the iODBC Driver Manager, version 3.52.7. This version includes the iODBC graphical Administrator component for Mac OS X (Tiger, Leopard and Snow Leopard) released for the first time in open-source formt. The iODBC CFM Bridge for Mac OS X is included, facilitating connections from Microsoft Office (Excel/Query). Additionally, windows in the GTK-based administrator are now resizeable alongside other minor bugfixes. We are also happy to announce a new redesigned website for iODBC, at http://www.iodbc.org/ . Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Cannot shut down Virtuoso server
Ghazzaoui, Ramez (NIH/NLM/LHC) [C] wrote: Hi there, I am running virtuoso open-source 5.0.11 on my Linux box and I needed to shut it down. I entered isql and typed “shutdown;” The command was apparently sent to the server, but nothing happened then. isql is hung (I suppose I can kill it with Ctrl-C), and Virtuoso is still running (ps –ef | grep virtuoso) Is it normal for the shut down procedure to take so long? Depends a bit. If the machine is slow and there are other transactions pending, it might take a while; otherwise, generally no, it will shut down in a few seconds. You might want to point another isql session at it and run status(); to see what it's doing. ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] SPARQL Query doesn't return uploaded triples
Taalai Djumabaev wrote: Hi all, I have created user "tman" with password gxa and upload rdf file using: $ curl -i -T myTriples.rdf http://localhost:8890/DAV/home/tman/rdf_sink/myTriples.rdf -u tman:gxa (and also tried uploading using webDAV browser) and got the result EN">201 CreatedCreatedH1>Resource /DAV/home/tman/rdf_sink/myTriples.rdf has been created.BODY> the WebDAV Browser shows me that the file is there but when I run query (using end point, tereminal and even internal SPARQL execution) default graph uri is : http://localhost:8890/DAV/home/tman/rdf_sink query: select * where {?s ?p ?o} (I tried many different queries) returns empty table s-p-o same happens when I run query form terminal curl -F "query=SELECT DISTINCT ?p FROM <http://localhost:8890/DAV/home/tman/rdf_sink/ > WHERE {?s ?p ?o}" http://localhost:8890/sparql What can be the reason for that? Hi, It could be a couple of things: you should check the sponger-related properties in the rdf_sink collection using the Conductor's WebDAV Browser, to be sure that it's enabled and check what destination graph it should be using: virt:rdf_sponger should be on virt:rdf_graph should be set to the desired graph IRI You can also execute the query SELECT distinct ?g WHERE { GRAPH ?g { ?s ?p ?o } } (via /sparql or /isparql or isql by prepending the "sparql" keyword), or again use the conductor (RDF / Graphs tab), to see what graphs are known in the store; hopefully there should be some mention of tman in there after having attempted your import. HTH, ~Tim -- Tim Haynes Product Development Consultant, OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
[Virtuoso-users] Announcing Virtuoso Open-Source Edition v5.0.12
Hi, OpenLink Software is pleased to announce a new release of Virtuoso, Open-Source Edition, version 5.0.12 This version includes: * Database engine - Added Public Key Infrastructure UI in conductor - Added failover/roundrobin support for all client layers - Added support for vectors in IN predicate - Added various small engine optimizations and enhancements - Refactored JDBC driver - Imported PCRE version 7.9 from upstream project - Fixed XA support - Fixed performance of sprintf_more when using large buffers - Fixed memory leaks - Fixed HTTP various issues with HEAD and POST - Fixed serialization on HTTP connection cache - Fixed allow client to run during online backup - Fixed small bugs and compiler warnings * SPARQL and RDF - Added SPARQL graph-level security - Added new RDFa parser - Added support for Concise Bound Description - Added optimization for bif:COUNT - Added optimization for OPTIONAL - Added support for SCORE_LIMIT in bif:contains - Added support for text/n3 mime type - Added support for nvarchar, bigint in sparql/rdfviews - Added support for exclude-result-prefixes - Added support to crawl with multiple threads - Added support for NQUAD, JSON and N-Triples - Added support for DSA certificates - Added MS Docs, Open Office, Google app cartridges - Added CNET, YELP, TESCO, ZILLOW cartridges - Added Goodrelations, Geonames, Bestbuy cartridges - Added Alchemy, Yahoo Boss, Picasa, haudio cartridges - Added cache for common ontologies - Improved support for rdf:XMLLiteral exp in RDF loaders - Fixed handling of special characters in IRI - Fixed RDF view generation - Fixed and enhanced description.vsp - Fixed and enhanced iSPARQL - Fixed charset handling for cartridges * ODS Applications - Added checks for dynamic local - Added expiration so sponger can track changes - Added support for conversations - Added 'Group By' handling for listed messages - Added 'Related' section in posts - Added new API and Ubiquity commands - Added hCard microformat - Added Ontology based editing - Added OpenSearch support - Added support for Smart Folders - Fixed openid, FOAF+SSL - Fixed upstreaming attachements - Fixed RDF gems - Fixed UI profile - Fixed mail filters - Fixed atom-pub protocol - Fixed rewrite rules - Fixed tag URIs - Fixed small bugs Other links: Virtuoso Open Source Edition: * Home Page: http://virtuoso.openlinksw.com/wiki/main/ * Download Page: http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload OpenLink Data Spaces: * Home Page: http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef OpenLink AJAX Toolkit (OAT): * Project Page: http://sourceforge.net/projects/oat * Live Demonstration: http://demo.openlinksw.com/oatdemo * Interactive SPARQL Demo: http://demo.openlinksw.com/isparql/ OpenLink Data Explorer (Firefox extension for RDF browsing): * Home Page: http://ode.openlinksw.com/ Regards, ~Tim -- Tim Haynes Product Development Consultant, OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
[Virtuoso-users] Announcing OpenLink Virtuoso Open-Source Edition v6.0.0
Hi, OpenLink Software is pleased to announce the official release of Virtuoso Open-Source Edition, Version 6.0.0: New product features include: * ANY ORDER Queries * Anytime Queries (basic and complex business intelligence style analytics queries) * Client-level resource accounting * Expressions in "IN" predicate * Faceted Data Exploration Engine & Web Services (REST or SOAP) for high-performance disambiguated entity search & find, across entity type and property dimensions * Inverse Functional Property Value enhanced Identity * Key compression * Transitive subqueries in SQL, SPARQL, and SPASQL (ODBC, JDBC, ADO.NET, OLEDB, XMLA) * Enhanced Sponger Middleware Layer * DBMS hosted Public Key Infrastructure for FOAF+SSL based Federated Identity. Related Links: Virtuoso Open Source Edition: * Home Page: http://virtuoso.openlinksw.com/wiki/main/ * Download Page: http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload Amazon EC2: * Installation and configuration page * How use pre-configured and pre-loaded Virtuoso instances via publicly shared Elastic Block Storage Devices (e.g. DBpedia, BBC Music & Programmes, etc.) OpenLink Data Spaces: * Home Page: http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef URIBurner Service: * Home Page: http://uriburner.com Linked Open Data Cloud Cache: * Home Page: http://lod.openlinksw.com OpenLink Data Explorer (Extensions & Bookmarklets for Browsing & Exploring Linked Data): * Home Page: http://ode.openlinksw.com/ OpenLink AJAX Toolkit (OAT): * Project Page: http://sourceforge.net/projects/oat * Live Demonstration: http://demo.openlinksw.com/oatdemo * Interactive SPARQL Demo: http://demo.openlinksw.com/isparql/ Faceted Browser: * http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtuosoFacetsWebService Regards, ~Tim -- Tim Haynes Product Development Consultant, OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Changing DAV permissions programatically
Aldo Bucchi wrote: Hi, I upload a file via WebDAV like so curl -u $CREDENTIALS -T "file.txt" http://server.com/DAV/home/dav/folder/ where /folder/ has readable by anyone. However, the uploaded file does not inherit permissions ( unless I am missing something ). [] Or, just definitely upload using briefcase API. briefcase.resource.store ( path varchar, content varchar, type varchar default null, permissions varchar default '110100100RM' ) Now, if I still want to stick to WebDAV upload, what would be the way to go? In what table can I modify the flag? #include See: create trigger dav_fix_perms after insert on ws..sys_dav_res referencing new as N { set triggers off; update ws..sys_dav_res set res_perms='110100100RM' where res_id = N.res_id; }; http://docs.openlinksw.com/virtuoso/TRIGGERS.html#createtrigger HTH :) ~Tim -- Tim Haynes Product Development Consultant, OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Virtuoso 6 problematic background activity
James Marsh wrote: Hi Hugh, On Tue, Oct 27, 2009 at 15:33, Hugh Williams <mailto:hwilli...@openlinksw.com>> wrote: Can you please provide a copy of your Virtuoso Configuration file (virtuoso.ini) and Virtuoso log file (virtuoso.log) for review. The log shows nothing unusual - the usual startup/roll forward and then nothing but checkpoints. I've included the ini at the end if this email. I've not had tracing turned on before the point the problems occur yet. Which trace_on arguments are most helpful in debugging? I could perhaps leave them enabled in the ini file for a while. From http://docs.openlinksw.com/virtuoso/fn_trace_on.html, you could leave trace_on('errors') ticking away happily. It's useful, but verbose, to use trace_on('exec') as well - may be best for interactive debugging. As for other parameters, either you'll know you want them (maybe client_sql?) or they pertain to the VDB layer. [] Should anymore deadlocks start occurring can you provide the output of running the following query from the isql prompt: select top 10 * from sys_l_stat order by deadlocks desc; Will do. And another trick to bear in mind: isql -D. [] Regards, ~Tim -- Tim Haynes Product Development Consultant, OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Speed up Virtuoso start
Sebastian Trueg wrote: > Virtuoso Maintainer wrote: >> If you kill virtuoso with a SIGTERM, it will initiate a fast shutdown, >> without performing a checkpoint. >> >> If you want it to perform a complete shutdown of the database, you >> either use the isql tool to perform a shutdown command, or you can kill >> it with SIGINT. >> >> However be aware that depending on the size of your transaction file >> (.trx), this can take a while to perform, which may not be what you want >> when you shutdown the machine. I would strongly advice against using >> this in some rc.d script, > > I see. Thanks a lot. I am not sure yet what to do. You are right that I > don't want to much delay when shutting down. I will figure it out. :) Have you considered tweaking CheckpointInterval? The more it checkpoints whilst running, assuming a consistent flow of transactions, the less it'll have to do commit on shutdown or restart. HTH, ~Tim -- Tim Haynes Product Development Consultant http://www.openlinksw.com/ http://twitter.com/openlink/
Re: [Virtuoso-users] virtuoso / isql / ubuntu [mini howto]
Nathan wrote: > ahh well deduced, and as you say all works (virtuoso isql is much better)! > > # /usr/local/virtuoso-opensource/bin/isql localhost: dba dba > Connected to OpenLink Virtuoso > Driver: 06.00.3124 OpenLink Virtuoso ODBC Driver > > consider it symlink'd; [] This is not so much an Ubuntu issue (unless you've repackaged it differently) as a general clash of executable names with unixODBC, combined with your PATH picking up /usr/bin before wherever you installed Virtuoso. When I wrote the initial debian packaging I made a point of renaming virtuoso's isql to isql-v for this reason. From debian/rules in the source distribution: env CFLAGS="$(CFLAGS)" LDFLAGS="-Wl,-z,defs" ./configure $(CROSS) --with-layout=debian --program-transform-name="s/isql/isql-v/" --with-readline As far as I know Virtuoso does not ship with any scripts that rely on the existence of isql per se, so you should be safe to perform this rename (either during configure, or after the build with mv(1)) yourself, and then imagine the docs refer to isql-v throughout instead. (If you're using the DBpedia load-script, that *may* have a dependency on isql; I haven't checked.) HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Urgent: Virtuoso crashes when free text search fora specific term
Magnus Haraldsen Amundsen wrote: I haven’t tried against VOS 5.0.12. No core file is produced and I can’t trace nothing in the logs. I think I’ll suggest to the customer that we upgrade our Virtuoso installation. In addition to Hugh's `ulimit -c unlimited', it might be wise to run the server in the foreground (virtuoso-t -df) and execute isql> trace_on('errors'); just before attempting the failing query. Then you stand a chance of seeing high and low level reasons for a crash. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] How to replace a resource URI
Sebastian Trueg wrote: Is there a query that would replace one URI with another one in all graphs? In other words: I need to "rename" one resource and make sure that all statements in all graphs are updated accordingly. Currently I am doing that on the client side which is rather slow. Personally I'd consider: update rdf_quad set s=iri_to_id('http://some/new/thing') where s=iri_to_id('http://some/old/thing'); Adjust for ?p and ?o columns to taste. It touches on potentially many rows in the quad-store, but the iri_to_id() calls can be optimized to happen only once each and the lookup will be fast between hash-values. Beware of caching IRI lookups, however: the above might require a server-restart to take effect. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] virtuoso gobbling 400% of cpu
Kurt J wrote: Hello, I have a virtuoso instance running that backs up the http://dbtune.org/myspace service. Today i had to kill it b/c it was using like 400% cpu. I checked the 'virtuoso.log' file and it was of no help - just a bunch of 'check point made' statements. Can i log the queries made somehow??? So i know what caused the horrible cpu usage? What Patrick said, plus: isql> status(); and maybe even `isql -D' if need be. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Detect graph and ask results without knowing the query
Sebastian Trüg wrote: Hello, me again. This time I would like to know if there is a clean way to determine the type of query result from the results columns (without fetching a row)? At the moment I am using a rather hacky way: I check if the result has only one column named "__ASK_RETVAL". If that is the case I treat it as an ask/boolean result. But then I need to find out if it is a graph result and checking for name "callret-0" is just ridiculous. So I thought if it would be feasible to check if the returned data is a BLOB. Is that possible and using which odbc call? Hi, ODBC has SQLDescribeCol() for the very purpose: http://msdn.microsoft.com/en-us/library/ms716289(VS.85).aspx HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] problem loading RDF...
Egon Willighagen wrote: Hi all, I am trying to load a RDF document (made with a PHP script from a MySQL database) into Virtuoso with isql, but running into this exception: SQL> DB.DBA.RDF_LOAD_RDFXML_MT(file_to_string_output('/tmp/compounds.rdf', 'http://pele.farmbio.uu.se/chembl'); *** Error 37000: [Virtuoso Driver][Virtuoso Server]SQ074: Line 1: syntax error at line 4 of Top-Level: DB.DBA.RDF_LOAD_RDFXML_MT(file_to_string_output('/tmp/compounds.rdf', 'http://pele.farmbio.uu.se/chembl') I have run it through 'xmllint -sax -noout' and there are least no well-formedness problems... nor can I find empty elements or missing resource IDs... Can you share some of the content of this compounds.rdf file please? Amongst other checks, you could try running it through rapper as well - see if you can convert it to ntriples or xml-abbrev serializations, perhaps. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Trim all varchar cells in a table efficiently
Aldo Bucchi wrote: Hi, I have a table that has random spaces appended to random varchar values. ( that's just a FOL ). I would like to run a procedure against the table and trim each varchar value "in place" so that, after running the procedure on a table, I could be assured that all cells are correctly trimmed. i.e. trim_all_cells_in_table( 'DB.DBA.MY_TABLE' ); What's the correct way to do this? Iterate over the cursor and write in-place? There may be other ways, but you could start from this: create procedure trim_stuff(in tbl varchar) { declare sql varchar; for (select distinct COLUMN_NAME as cn from db.information_schema.columns where table_name=tbl and data_type='VARCHAR') do { sql:=sprintf('update %s set %s=trim(%s);', tbl, cn); exec(sql, ..);-- see docs for exec() function }; }; Some of these tables have 10s of millions of rows so performance is definitely an issue. I have no idea how (in)efficient the above will be, so will leave better suggestions to others to contribute; but one tweak to consider is that you could add the clause ... where %s like '% ' to make it only update & trim values that need it, but like is itself expensive so that would depend on the *proportion* of offending rows. Thinking about it some more, consider the nature of the columns in question: *if* you know a field is only going to have a finite number of distinct values when normalized, then you could use a lookup table for the permitted values, as in a star-schema. That should be easy to construct and replace once, then with foreign-key relationships you'd never have the problem again and integer comparisons would be way fast. That may or may not be appropriate, however. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Error creating wiki application for ODS user
Mark James wrote: Hi, I've created an ODS user with the following roles - Primary Role = WikiAdmin, Others = WikiUser. I can log in as that user just fine. When trying to create and launch a wiki application with this user I get the following error? What am I doing wrong. 42WV9 [11001] System user account "Internal" does not exist or can not be used for Wiki purposes; can not register Wiki user "Internal" A user with the Administrator role can create a wiki application no problems. Hi, I can't seem to reproduce this off-hand. I have created a new ODS user, gone in through conductor to set their primary and auxiliary roles as you say, logged out from and back in to ODS, and this user can create new instances of wiki just fine. What version of Virtuoso are you using, as the above works fine in the recently released v6.1.0? Cheers, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Storing uris
Alexander Sidorov wrote: Hi Nathan, But Virtuoso will do all right even if I save uri value as literal "http://a.uri"; :) For example: scienceConferenceUri typeOfScience "http://uri#mathematics"; When I save object properties values I always see some kind of dualism :) On the one hand, object property is a uri (reference to some individual) and I should add it using uri syntax <http://uri#mathematics>. On the other hand, Virtuoso at the moment doesn't support object/data properties semantics that's why I can store value as literal. Now I do it the second way because it unifies my SPARQL queries: I can search literals and uri values the same way. What I mean by unifying is that if you add the value using uri syntax and then try to query it using literal syntax it won't work (obviously). I have created this post to find out some unique features of both approaches. Assuming I understand you right here, maybe a step back is useful: a) a subject (entity) must be a URI b) a predicate (attribute) must be a URI c) an object (value) may be either a URI or a literal value. A string that looks like a URI may be entered either as a literal (using "" around it) or as a URI (using <> in your N3/ttl). From the point of building a large corpus of data, work on the principle that if you're going to want to make statements *about* a URI, ie regard it as a subject later, it *must* be stored as a URI. Ie, it daisy-chains that, as long as you're talking URIs, one statement's object/value is another statement's subject/entity. If you absolutely must do string operations on a URI, that's what the SPARQL str() function is for, but meanwhile, store it as a URI. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Programmatically putting RDFs into Virtuoso
Rameswara Sashi Kiran Challa wrote: I want to programmatically (in Java) put the RDF files I get, into virtuoso. I am planning to use HTTP put. I could make a system call, use curl and do it on Unix. How could I do it on Windows ? There's a load of ways to insert RDF into Virtuoso: http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtRDFInsert If you have RDF files, then maybe the easiest would be the ttlp() function: either put your RDF files in the same directory as the virtuoso database instance, or edit virtuoso.ini and change DirsAllowed to include the path to the files, then run ttlp( And do I have to start my instance, push my RDF file into virtuoso and stop the instance every time ? ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] How to start ./virtuoso-t with a non-forked/daemonized parameter?
Ceriel Jacobs wrote: Hi list, Correctly starting Virtuoso on Mac OS X with launchd (a .plist) fails. Virtuoso-t starts, that is not the problem. But the process cannot be controlled any further with launchctl commands. When looking further into launchctl, you see that the originally start process died, and a new one is created: [user@dev ~]$ sudo launchctl list PID Status Label 12378 - 0x10031fb20.anonymous.virtuoso-t - 0 com.openlinksw.vos My guess is that virtuoso forks itself. Forking is not good behavior when starting processes with launchd, see launchd.plist documentation: <http://developer.apple.com/mac/library/documentation/Darwin/Reference/ManPages/man5/launchd.plist.5.html> It is like watchdogd, and shares watchdogd's requirement that processes do not attempt to fork or daemonize on their own. If a process goes into the background launchd will lose track of it and attempt to relaunch it. Which parameter is available to start virtuoso in a non-forked/daemonized way? I'd expect -f (+foreground) should help here. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Programmatically putting RDFs into Virtuoso
(Oops, previous version sent too soon) Rameswara Sashi Kiran Challa wrote: I want to programmatically (in Java) put the RDF files I get, into virtuoso. I am planning to use HTTP put. I could make a system call, use curl and do it on Unix. How could I do it on Windows ? There's a load of ways to insert RDF into Virtuoso: http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtRDFInsert If you have RDF files, then maybe the easiest would be the ttlp() function: either put your RDF files in the same directory as the virtuoso database instance, or edit virtuoso.ini and change DirsAllowed to include the path to the files, then run ttlp() as documented at http://docs.openlinksw.com/virtuoso/fn_ttlp.html For bulk loading, there's http://docs.openlinksw.com/virtuoso/fn_ttlp_mt_local_file.html as well. And do I have to start my instance, push my RDF file into virtuoso and stop the instance every time ? Virtuoso's a database. Leave it running, then it'll always be available, and no it won't lose your RDF between restarts! ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] 6.1.0: README: getting started: command line isql example: inconsistent port 1112?
Nathan wrote: also worth noting that people should use the isql bundled with virtuoso and not the standard one which is often found on linux boxes - that's quite a gotcha! I have made this a FAQ: http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VOSMake ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] GPF: rltrx.c:1058 more locks than rows
Mirko wrote: [] So, my problem is 2-fold: - How can I restart Virtuoso without roll forward, which again leads to the GPF Hi, Normally, you'd delete the transaction file - rm virtuoso.trx or similar. In a real pinch, you can use the crashdump and restore options: http://docs.openlinksw.com/virtuoso/backup.html looks appropriate. I'll leave it to someone else to answer about the locks. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Querying on all the data in the triple store
Rameswara Sashi Kiran Challa wrote: Hello All, The way I used virtuoso is upload my file containing triples into triple store and with the Graph IRI I get, do sparql queries on that. Can I append say a new set of triples related to already existing ones, like have a common Graph IRI for all the data I push into virtuoso store ?? The way I have been adding adding triples into my triple store was by using a WebDAV client where in I write the triples into a file and upload the file into virtuoso. I get new set of triples say everyday and I want to put them into the triple store, so how do I have to make sure that I push that data onto the same graph IRI so that I can query the whole content at once ? Let's start with a sanity check: if you were using ttlp() to load data from file, then you could specify multiple files and one destination graph, and they would all be appended into it: SQL> ttlp (file_to_string_output ('./foo-1.n3'), '', 'http://mygraph.example.com'); SQL> ttlp (file_to_string_output ('./foo-2.n3'), '', 'http://mygraph.example.com'); ... SQL> sparql select * from <http://mygraph.example.com> where { ?s ?p ?o . }; s po http://localhost/ http://purl.org/dc/elements/1.1/titleThis is from file 1 http://localhost/ http://purl.org/dc/elements/1.1/titleThis is from file 2 2 Rows. -- 0 msec. Now, if you insert RDF data by uploading files into WebDAV (eg via cURL), then the rdf_sink/ collection into which you deposit files needs two properties set (by code or through browser): * virt:rdf_graph contains the name of the graph for uploads. * virt:rdf_sponger points to the upload method (should be 'on') So if you set virt:rdf_graph to a fixed graph IRI, it should also append data to that graph. (See http://www.openlinksw.com/dataspace/dav/wiki/Main/VirtuosoRDFSinkFolder as well.) HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Querying on all the data in the triple store
Rameswara Sashi Kiran Challa wrote: Thanks Tim. Could you please direct me to any documentation that has methods showing how to programmatically set virt:rdf_graph and virt:rdf_sponger properties. Probably best: http://docs.openlinksw.com/virtuoso/fn_dav_api_change.html see dav_prop_set(), etc. When you said browser, did you mean that I need to do it on the condutor ? If you wish. Use the web-based conductor DAV-browser for one-off configuration by hand, or the above functions for the programmatic approach as you wish. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] How to change default passwords without exposure ?
Obey Arthur Liu wrote: Hi, http://docs.openlinksw.com/virtuoso/newadminui.html#defpasschange explains that in order to change the default password, I have to first launch virtuoso with the default passwords. How can I change the password without exposing myself, or running a serving instance at all ? From virtuoso-t --help: ... +pwdoldOld DBA password +pwddbaNew DBA password +pwddavNew DAV password ... Also, what if I forgot my passwords ? I'm not aware of any one official recovery method. ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] query qith timeout
N.Stieler wrote: Hello All, I want to set a timeout for a query. I have already found this URL: http://docs.openlinksw.com/virtuoso/anytimequeries.html But I am using the JDBC Driver for Virtuoso. Is it possible to use a timeout there? Hi, I don't see why not. Remember that its scope is the current connection, and you should be able to execute it like any other SQL statement you'd run through JDBC. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Issue with iSPARQL installation
Nicolas Figay wrote: Hello, I'm installing virtuoso last version on Linux (Mandriva), open source version. * Version: 06.01.3127 * Build: May 21 2010 After installing iSparql VAD from administration panel, I put the address: http://myserver/iparql, and I have then a panel indicating there is an error: Initializing data structures and objects… Internal Error: TypeError: js.substr is not a function and iSparQL frame does not appear. Does anybody already have this error, and know where it comes from, and how I can resolve it? Hi, What browser are you using? ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] string manipulation within an rdf view
Mark James wrote: Hi, Is it possible to create an rdf attribute as a manipulation of 1 or more columns from a table or does this have to be done in a sql view prior to the rdf view? I attempted to perform a concat like the one below but got the error - SQ074: Line 46: SP031: SPARQL compiler: Table alias name is not specified for column concat. Hi, Yes, I believe it should be possible to use just about any virtuoso PL function assuming it's been promoted to be visible from sparql and the RDF meta-schema environment. http://virtuoso.openlinksw.com/Whitepapers/html/rdf_views/virtuoso_rdf_views_example.html has hints/example of how to do it - see the sections `Creating IRIs From Primary Keys /IRI Classes' and Listings 3 and 4. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Paths in compiled from source Virtuoso on Ubuntu Lucid
On 12/07/2010 23:08, Peter DeVries wrote: > I decided to try to do the source install of the latest version of Virtuoso > Open Source on Ubuntu Lucid. > > * This is different than installing *virtuoso-opensource* via the package > manager. > > Following the default configuration using default path settings, I am > getting virtuoso.ini in the following location > > /usr/local/virtuoso-opensource/var/lib/virtuoso/db/virtuoso.ini > > It is as if it is appending the path */var/lib/virtuoso/db/* to the assumed > install location of */usr/local/virtuoso-opensource/* > * > * > I am wondering if this is a bug in the installer script? It's normal behaviour. Virtuoso already caters for alternative layouts for various distributions using ./configure --with-layout. Please see <http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VOSMake#Installation>. There's nothing to stop you using any directory you like to store a database instance: it just takes a virtuoso.ini file somewhere, start the virtuoso-t daemon against it and off you go. > Should I be using the following in my installation procedure? > > * > > ./configure --prefix=/usr/local/virtuoso-opensource If you wish. It would be wise to create symlinks such as cd /usr/local/bin ln -s ../virtuoso-opensource/bin/{isql,virtuoso-t} . so the useful executables would be somewhere in your PATH. > It is also not clear to me if the Ubuntu lucid package will be updated to > the new version or if it will stay at the previous version? It's up to Ubuntu to decide when they'll upgrade the package. > P.S. For the packaged version this is all that I needed to do to get > virtuoso installed. > > sudo apt-get install virtuoso-opensource > sudo apt-get install virtuoso-vad-doc > sudo apt-get install virtuoso-vad-isparql > sudo apt-get install virtuoso-vad-rdfmappers > > Then edit this file /etc/default/*virtuoso-opensource-6.0* > > so it reads this at the end > > # Set to 'yes' to start virtuoso, set to 'no' otherwise > RUN=yes Thanks for the tip. ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] SPARQL endpoint traffic logging
On 19/08/2010 14:04, Aldo Bucchi wrote: > Is there a way to enable logs for all SPARQL queries hitting an endpoint? Hi, One option that comes to mind: virtuoso.ini [HTTPServer] HTTPLogFile=somefile (More at http://docs.openlinksw.com/virtuoso/dbadm.html) HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] count triples per day
On 26/08/2010 16:08, Camila Dias wrote: > Hello , > > How can i see how many triples per day i have? Hi, It rather depends what you mean. I expect the key query is select count(*) from rdf_quad; and then it's up to you how you'd like it presented: a) use the scheduler to make things happen regularly: http://docs.openlinksw.com/virtuoso/dbadmin.html#eventscheduler b) you can store queries or their output in WebDAV, to be re-executed regularly: http://docs.openlinksw.com/virtuoso/admui.xmlservices.html#sqlxmlstmts c) you can create an entire RSS feed as a big SQL/X statement using functions like XMLAGG() and XMLELEMENT() etc if you want: http://docs.openlinksw.com/virtuoso/functions.html#xml d) you can write a stored procedure that adds a row to a log table, optionally calculating the difference between yesterday and today's figures, and invoke it via scheduler e) all of the above. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] SPARQL over ODBC and a literal's languages and datatypes
On 18/09/2010 17:40, William Waites wrote: > (1) check that the database is Virtuoso, > (2) check that the query was SPASQL (3) pre-emptively > go and collect type information before returning each > row. > > Is there a straightforward way to do (1) and (2) at all? Hi, pyodbc supports SQLGetInfo(): > In [35]: import pyodbc > > In [36]: conn=pyodbc.connect("DSN=virtdiscussion") > > In [37]: conn.getinfo(pyodbc.SQL_DBMS_NAME) > Out[37]: 'OpenLink Virtuoso' Presumably the obvious way to check a query for SPASQL is to see if the first word in the query is "sparql": > In [38]: import re > > In [39]: re.search("^\s*sparql ", "SPARQL select distinct * where { ?s ?p ?o > . };", re.I) > Out[39]: <_sre.SRE_Match object at 0x1053d55e0> > > In [40]: type(re.search("^\s*sparql ", "select distinct * where { ?s ?p ?o . > };")) > Out[41]: HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Really Impressed with Virtuoso All Around..
On 07/01/2011 14:57, Matthew Tedder wrote: Thanks for your kind words :) > That said, no software is ever perfect. To me, the clearest inhibitive > factor to popular adoption is the documentation. It's not horrible but could > be made much better organized, more explicit, and complete (not that it > should be too wordy, either). Agreed, room for improvement. > Also, on UNIX, the default install is not FHS > compliant but easily fixed. I take it you've noticed ./configure --with-layout=(default|gnu|debian|gentoo|redhat|freebsd|opt|openlink) ? HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] RDF sink default graph
On 08/02/2011 09:32, Adrian Gschwend wrote: > Hi group, > > I created a user in Virtuoso and added a RDF Sink folder for him. In the > properties of the folder I added the following virt:rdf_graph option: > > http://localhost:8080/DAV/home/dba/rdf_sink/ > > virt:rdf_sponger is "on" > > but all files I upload to the folder get this graph: > > http://local.virt/DAV/home/wa_sink/rdf_sink/wa_address_agents.rdf > > If I get that correctly I should be able to define any graph I want in > this option, right? If so, any ideas why it does not work? Tried some > other URIs as well but no luck. > Hi, Code snippet from a previous project: I used: DAV_PROP_SET (davLocation, 'virt:rdf_graph', iri, _uid, _pwd); with success; it used the given iri as the graph IRI when sponging stuff put in the rdf_sink/ collection davLocation. Could you try running the corresponding dav_prop_get, ie iSQL> select dav_prop_get('/DAV/home/dba/rdf_sink/', 'virt:rdf_graph', 'dba', 'dba'); and see what it has to say for itself? ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Implementing a simple ACL atop a SPARQL endpoint
On 14/04/2011 04:57, Aldo Bucchi wrote: > Hi, > > I have done this many times already, so I can tell it is a pattern. > I have a Virtuoso in an intranet, and one or more applications talk to > it via SPARQL HTTP. > > I would like to also allow selected external users (humans) and > applications to access the endpoint. Some with SPARQL Update > privilege. > > What's the recommended way to do this? Hi, I won't claim to be an expert but http://docs.openlinksw.com/virtuoso/rdfsparql.html looks interesting - WebID and our Policy Manager VAD, perhaps? HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Backing-up Virtuoso
On 03/05/2011 00:30, Alexandre Passant wrote: > Also, is there an easy way to create a full NQUAD archive from the content of > my RDF store ? Should be pretty easy, I think. a) devise a query that returns everything, for example select distinct * where { graph ?g { ?s ?p ?o . } } limit 1000 b) make it visible at a URL somewhere: I suggest one starting with /sparql and then all you have to do is curl(1) it off to a file as and when. :) c) There are more flexible, potentially faster, methods if you go via SQL: see Conductor / XML / stored queries where a SQLX query is persisted in WebDAV. You could even write a procedure to format the output as you wish and then make it a web-service/SOAP endpoint (also in the Conductor). HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Virtuoso segfault, blocking google from requesting each URI in a FCT view
On 10/05/2011 18:52, Peter DeVries wrote: > Hi > > I am getting the following usually at a particular time of day. > >May 9 23:32:25 lsd kernel: [358169.529945] virtuoso-t[4680]: segfault at > fffc ip 005b6fbe sp 7f032211ad90 error 4 in > virtuoso-t[40+955000] > > Any ideas as to what may be causing this? Hi, Unfortunately that doesn't point at any specific obvious reason. So, a) what version of linux is this, b) what version of virtuoso, c) and do you see any debug out just prior to the segfault if you run the server in the foreground (virtuoso-t -df)? > Also, how to I prevent google from requesting every URI in my FCT views? Probably the easiest way is to create a /robots.txt file[0] along the lines: User-agent: * Disallow: /fct Disallow: Crawl-Delay: 60 It's convenient to design your data URIs to have common prefixes, e.g. http://hostname/ontologies/foo in order that you can then block-off everything under /ontologies/ wholesale in robots.txt if you want. [0] Full spec/docs etc at http://www.robotstxt.org/ HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Regex-based renaming of graphs
On 24/05/2011 16:55, Alexandre Passant wrote: > I've seen doc at [1], but is there a way to do regex-based renaming of graphs > in Virtuoso ? > > E.g. rename all graphs with URI scheme http://example.org/foo/* into > http://example.org/bar/* > > Thanks > > Alex. > > [1] http://ods.openlinksw.com/wiki/main/Main/VirtTipsAndTricksGuideRenameGraph Hi, Yes, it should be possible. Consider the following: select distinct( iri_to_id( regexp_replace(id_to_iri(g), 'openlink', 'localhost') ) ) from DB.DBA.RDF_QUAD where regexp_match('openlink', id_to_iri(g)) Converting that to an update is left as an exercise :) HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Virtuoso sparql endpoint - setup for external access
On 24/05/2011 23:28, Robbet wrote: > Hello, > > i'm trying to access my Virtuoso sparql endpoint on my local server > using a dyndns client. > Unfortunately i get no access to xxx.dyndns.org:8890/sparql although the > nececessary port is forwarded and open (tried it using an external post > scanner). It does not work on the ip too so there is no problem with my > dyndns host. > > Any suggestions? Do i have to change something tin the virtuoso.ini? > Miss another port? Hi, Can you define `no access'? Is there a specific error message, and where does it come from? Are we to presume Virtuoso is running and listening on port 8890 (if on linux/unix, verify with netstat), and/or are you able to connect from localhost? Have you done anything in the virtuoso.ini or the Conductor to restrict the IP#s on which it listens? Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] starting virtuoso under mac os x
On 25/05/2011 11:46, Joe Corneli wrote: > I have Fink's virtuoso installed, > > Version 6.1.2.3127-pthreads as of Apr 29 2011 > Compiled for Darwin (i386-apple-darwin10.7.0) > > When I try to start the server (with or without sudo privileges), I > get messages like below (copied to the log file as well). However, > trying to connect via isql gives errors (further below). Any help is > appreciated! > > /sw/var/lib/virtuoso/db $ sudo virtuoso-t -f > > Wed May 25 2011 > 11:30:09 { Loading plugin 1: Type `plain', file `wikiv' in > `/sw/lib/virtuoso/hosting' > 11:30:09 FAILED plugin 1: Unable to locate file } > 11:30:09 { Loading plugin 2: Type `plain', file `mediawiki' in > `/sw/lib/virtuoso/hosting' > 11:30:09 FAILED plugin 2: Unable to locate file } > 11:30:09 { Loading plugin 3: Type `plain', file `creolewiki' in > `/sw/lib/virtuoso/hosting' > 11:30:09 FAILED plugin 3: Unable to locate file } > 11:30:09 { Loading plugin 4: Type `plain', file `im' in > `/sw/lib/virtuoso/hosting' > 11:30:09 IM version 0.5 from OpenLink Software > 11:30:09 Support functions for Image Magick 6.5.8 > 11:30:09 SUCCESS plugin 4: loaded from /sw/lib/virtuoso/hosting/im.so } > 11:30:09 { Loading plugin 5: Type `plain', file `wbxml2' in > `/sw/lib/virtuoso/hosting' > 11:30:09 WBXML2 version 0.9 from OpenLink Software > 11:30:09 Support functions for WBXML2 0.10.7 Library > 11:30:09 SUCCESS plugin 5: loaded from /sw/lib/virtuoso/hosting/wbxml2.so } > 11:30:09 { Loading plugin 9: Type `Hosting', file `hosting_perl.so' in > `/sw/lib/virtuoso/hosting' There's nothing too surprising about the above; all that's happened is that the virtuoso.ini packaged contains instructions to load those plugins but they've not been built. In any case, this is just a partial startup log - you should expect a small delay while it creates an empty database and possibly installs the Conductor VAD package into it, followed by: > ... > 16:48:10 INFO: Checkpoint finished, log reused > 16:48:12 INFO: HTTP/WebDAV server online at 8890 > 16:48:12 INFO: Server online at (pid n) Assuming you've got stuck on an initial startup and don't have anything to lose just yet, if you think the state of transaction files and temporary databases is inconsistent in the db/ directory, you can remove everything in it *apart from* the virtuoso.ini file. > /sw/var/lib/virtuoso/db $ isql.virtuoso -U dba -P dba > > *** Error S2801: [Virtuoso Driver]CL033: Connect failed to > localhost: = localhost:. > at line 0 of Top-Level: (-U and -P are unnecessary as dba/dba are the defaults) This is not surprising, if the server hasn't yet started - absence of `Server online' above. ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] starting virtuoso under mac os x
On 25/05/2011 13:14, Joe Corneli wrote: >> In any case, this is just a partial startup log - you should expect a small >> delay while it creates an empty database and possibly installs the >> Conductor VAD package into it, followed by: >> >>> ... >>> 16:48:10 INFO: Checkpoint finished, log reused >>> 16:48:12 INFO: HTTP/WebDAV server online at 8890 >>> 16:48:12 INFO: Server online at (pid n) > > It simply kicks me back to my shell prompt after printing the info I posted. > > [...] > 13:11:10 SUCCESS plugin 5: loaded from /sw/lib/virtuoso/hosting/wbxml2.so } > 13:11:10 { Loading plugin 9: Type `Hosting', file `hosting_perl.so' in > `/sw/lib/virtuoso/hosting' > /sw/var/lib/virtuoso/db $ OK, that's a bit weird. On a quick check here, VOS built normally on the Mac (ie no fink), when run with `virtuoso-t -f', works as I described. Is there anything in the virtuoso.log file? ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] VOS 5.0.14 make check fails on 10, passes on 9 Ubuntu
On 21/07/2011 21:36, Dondo, Brian wrote: > Hi. (am I supposed to say hi on mailing lists?) You can say hi if you want ;) > Building 6.1.3 and 5.0.14 VSO on Ubuntu 9.10 and 10.04. Builds on 32 bit > Ubuntu presents no problems with either release of VSO. > > It's worth mentioning right away I'm using the -with-iodbc=DIR option. (=DIR > because for some reason in 10.04 the make isn't able to figure the absolute > path when it needs it) That's ok, as long as you have libiodbc2-dev installed on all platforms involved. > However, we're planning on going live using 64-bit compilations on 64-bit > servers. The other combinations were done because I'm stuck working the > angles on this. > > The targeted combination is 5.0.14 VSO on 10.04 Ubuntu 64-bit. This is where > it gets weird. I can make and make check 5.0.14 on Ubuntu 9.10 64-bit with > no problems BUT on 10.04 it compiles clean but I can't run a successful make > check. There're a couple flashes of errors near the beginning of the check > and then things go well until it eventually grinds to a halt(ish) when > "Running a subset of TPC-D queries against " > > And this is where it gets weirder still. If I run the make on 10.04 64-bit, > tarball the make directory over to a 9.10 64-bit OS and run the make check > there, it runs clean! > > Is there a quirk in Ubuntu that could be causing this? Is it the test suite > on 10.04? The 10.04 compile tests clean on 9.10. Can I trust the binaries on > 10.04 if I package them up and install them using Debian utilities? It's certainly possible there might be quirks; could be that you have older versions of required packages[0]; could be locale settings[1] at fault (gawk has been known to be problematic on utf-8 locates before now). [0] Please double-check against <http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VOSMake#Package%20Dependencies> [1] Please check the output of `locale` on all environments Best bet is if you send us the various tsuite log files, mostly binsrc/tests/suite/testall*{output,log} so we can look for more precise errors. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Request for Code Review - Relocating Database Files
On 08/08/2011 16:55, Dondo, Brian wrote: > Like I said, it seems to work. Does that pretty well cover it? Yep, seems reasonable to me. I'd cast an eye over the virtuoso.ini file manually, checking for mentions of `var' and what it does for the DirsAllowed parameter (if you've changed it at all) and where it looks for hosting libraries. If you want to be really pedantic, ls -l /proc/*/fd | grep virtuoso and make sure there's no dangling references to the old location. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Virtuoso 6.1.3 on FreeBSD-9: conductor does not work
On 01/09/2011 17:15, Mathias Picker wrote: > 18:12:00 ERROR: Error compiling a server init statement : 37000: SQ074: Line > 18: syntax error at '' -- create method > xmla_discover_keywords () returns any for xmla_discover > { > declare kwds, res any; > d... > 18:12:01 ERROR: Error compiling a server init statement : 37000: SQ074: Line > 78: syntax error at '%' before 's' -- create method vc_render () for > vspx_browse_button > { > if ( not self.vc_enabled) > return; These are the interesting messages... Looks to me like the build environment was a bit wonky. a) Please double-check versions of all required dependencies against <http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VOSMake#Package%20Dependencies> - especially flex and gawk. b) Please check your locale settings - if you have a regional and/or utf8 locale specified, it might be better to switch to C for the duration of the build. I presume this was a straightforward 6.1.3 tarball you downloaded from SourceForge? HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] viewing components of a soap_client call
On 18/10/2011 02:15, Peter Secomb wrote: > Is there anyway to extract the value that IS being received from the > soap_client call (eg a string, or something else, or even NULL)? The debug > option returns the partially built xml string then the error to stdout. Hi, >From something I'm working on atm - might find this useful: soapresp:=soap_client( url=> ... ); soapresp:=xml_tree_doc(soapresp); string_to_file('./response.xml', blob_to_string_output(soapresp), -2); Or if you're using the isql tool in the Conductor, select xml_tree_doc( soap_client( ... should display something. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
[Virtuoso-users] Announcing OpenLink Virtuoso, Open Source Editing, v6.1.4
x p1 ?o1 ; p2 ?o2 . optional { ... } . filter (?o1 = ?o2) - Fixed map OpenLink Zillow ontology to geo:lat/long - Fixed map oplog:likes_XXX property to like:likes - Fixed minor issues - Fixed SPARUL LOAD INTO command creating duplicate graphs - Fixed translation from nodeID://xxx to _:xxx - Fixed url encoding issues in RDF/XML - Fixed when dropping a graph, also check if there is a quad map for it * ODS Applications - Added ACL eXecute flag - Added RDF/XML and TTL representations to Offers - Added SIOC object services - Added WebID verification service - Added annotation rules - Added app discussion rules - Added discussion IRIs - Added header and head links for IRIs - Added ldap schema support to WebID - Added mail verification service - Added support for WebID idp - Added user's rewrite rules - Added user/mail availability action - Updated CKEditor to version 3.6.1 - Fixed ++ - Fixed ACL using patterns - Fixed API functions - Fixed call auth check only when needed - Fixed changing/deleting events does not trigger re-sync with publication - Fixed Delicious import/publish - Fixed description presentation - Fixed Facebook UI - Fixed IE JS problems - Fixed import atom sources - Fixed move/copy API with wrong source/destination - Fixed navigation and UI - Fixed Offers, Likes and Dislikes, Topic of Interest - Fixed search RSS problem - Fixed SIOC RDF links API functions - Fixed typo in messages - Fixed WebDAV selection Other links: Virtuoso Open Source Edition: * Home Page: <http://virtuoso.openlinksw.com/wiki/main/> * Download Page: <http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload> OpenLink Data Spaces: * Home Page: <http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex> * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): <http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef> OpenLink AJAX Toolkit (OAT): * Project Page: <http://sourceforge.net/projects/oat> * Live Demonstration: <http://demo.openlinksw.com/oatdemo> * Interactive SPARQL Demo: <http://demo.openlinksw.com/isparql/> OpenLink Data Explorer (Firefox extension for RDF browsing): * Home Page: <http://ode.openlinksw.com/> Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] How to stop running query
On 02/13/2012 02:43 PM, Maxime Teissèdre wrote: For some details. Il use status(); and i see that for exemple: Running Statements: Time (msec) Text 5183 SPARQL SELECT ?g COUNT(*) { GRAPH ?g {?s ?p ?o.} } GROUP BY ?g ORDER BY DESC 2 22 status() But, if i want to kill the SPARQL request, i don't know how. If the request is in an infinite loop for example. Hi, The only thing I can think of is txn_killall(): http://docs.openlinksw.com/virtuoso/fn_txn_killall.html HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
[Virtuoso-users] Announcing OpenLink Virtuoso, Open Source Edition, v6.1.5
Hi, OpenLink Software is pleased to announce the official release of Virtuoso Open-Source Edition, Version 6.1.5: New product features as of March 15, 2012, V6.1.5, include: * Database engine - Added support for SPARQL 1.1 WITH, USING, NAMED - Added support for SPARQL 1.1 Update - Added support for SPARQL 1.1 Functions - Added support for SPARQL Macro Library syntax - Added support for SPARQL DESCRIBE modalities via pragma options "OBJCBD" (object-slot-based concise bound description) and "SCBD" (symmetrical concise bound description) - Added support for SPARQL DESCRIBE/CONSTRUCT to return 3 column resultset when using SPASQL (SPARQL inside SQL) via ODBC/JDBC/.NET by default mode ( _JAVA_ or _UDBC_ for exceptions) - Added support for wide strings in all SPARQL serializers - Added common infrastructure for RDF-specific XML parsers - Added new RDF/XML serializer (faster + pretty printing) - Added TRIG formatter - Added support for R2RML for generating Linked Data Views over ODBC/JDBC accessible data sources and/or native Virtuoso RDBMS data - Added support for HTML+Microdata - Added human-readable HTML output for DESCRIBE (list and table) to SPARQL endpoint - Added support for SELECT scalar_expression subqueries without FROM clause to avoid extra lock on fake subqueries - Added DBpedia vad package - Added support for scoping ACL to a virtual folders - Added new Visual Studio 11 project files for both 32bit and 64bit builds - Fixed RDF/XML parser that passes W3C tests dated 2003-Nov. - Fixed JSON-LD syntax to match recent draft of the spec - Fixed CONSTRUCT with constant string objects with language - Fixed output of bnodes in RDF/XML format - Fixed support for sparql load i.e. file: scheme URI with absolute path from system root - Fixed issue with uninitialized variables - Fixed use portable method for escaping symbol for gawk 3 and 4 - Fixed issue with semaphores on Mac OS X 10.7 - Fixed compiler warnings - Fixed memory leaks - Updated documentation * SPARQL and RDF - Added new cartridges for LinkedIn, Angel List,Klout, New York Times Article, Social Statistics and Stackoverflow etc. - Added new ontolgies for Angel List, X.509 Certificates, Crunchbase, DBpedia Spotlight, NYT, LinkedIn, OpenLink Basic, OpenLink Web etc. - Added support for extracting all meta and link head-element data from XHTML documents - Added post-processing script for generating owl:sameAs links for co-reference resolution - Added support for get:soft "add" pragma for progressive Linked Data graph construction via Sponger - Added support for paging over large collections to FB cartridge - Fixed Amazon cartridge now works with new Product Advertising API - Fixed handling of # in About header - Fixed visually qualifying opl:mentions property values with source cartridge identifier - Fixed social-profile-url property across social cartridges * ODS Applications - Added support for WebID 1.0 spec - Added support for CalDAV and CardDAV protocols - Added ACL editing for DETs - Added folder selecton for SyncML - Added option to import rdf data from file - Added rule for briefcase folder IRIs - Added VCARD Property Grouping - Added private graphs data - Added option to deactivate user Other links: Virtuoso Open Source Edition: * Home Page: <http://virtuoso.openlinksw.com/wiki/main/> * Download Page: <http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload> OpenLink Data Spaces: * Home Page: <http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex> * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): <http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef> OpenLink AJAX Toolkit (OAT): * Project Page: <http://sourceforge.net/projects/oat> * Live Demonstration: <http://demo.openlinksw.com/oatdemo> * Interactive SPARQL Demo: <http://demo.openlinksw.com/isparql/> OpenLink Data Explorer (Firefox extension for RDF browsing): * Home Page: <http://ode.openlinksw.com/> Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
[Virtuoso-users] OpenLink Virtuoso, Open-Source Edition, moving to Github
Hi, OpenLink Software is pleased to announce it has switched the development of Virtuoso Open-Source Edition over to GitHub: <http://github.com/openlink/virtuoso-opensource> Developers who want to actively track progress of the Virtuoso source code and contribute bug fixes or enhancements to the project, are cordially invited to join us there. Links: Virtuoso Open Source Edition: * OpenLink Open-Source Archives on GitHub: <http://github.com/openlink> * VOS Wiki: <http://virtuoso.openlinksw.com/wiki/main/> * Download Page: <http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload> Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Cannot allocate Buffers for more than 2GB RAM
On 03/22/2012 03:47 PM, sherif kandel wrote: My Machine has 8GB of RAM , I have about 7GB of them free, but I cannot allocate more than 17 Max Buffers, it always tells me "GPF: ..\libsrc\Wi\disk.c:1370 Cannot allocate memory for Database buffers, try to decrease NumberOfBuffers INI setting" it always says that, even though I have more than 7GB free of my RAM, it doesn't go away unless I decrease the Buffers to be less than 2GB in memory I think it's something with the server being run on a 32 bit settings ? does it run on 32bit by default ? I didn't change anything about that, if so, where can I increase that? Hi, What OS is this on and how did you install Virtuoso? As a rule, a 32-bit process can only address up to 2GB RAM. ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Cannot allocate Buffers for more than 2GB RAM
On 03/22/2012 04:19 PM, sherif kandel wrote: I installed virtuoso exactly like it's mentioned in the documentation, using the commands in the command line virtuoso-t +screate ...etc On Thu, Mar 22, 2012 at 5:56 PM, sherif kandel mailto:sherifkand...@gmail.com>> wrote: I am running a windows 7 x64 ultimate machine with 8GB of RAM , I figured it's a 32bit process, but how can I make it a 64 bit to be able to address more RAM ? Which file did you download from Sourceforge? The 64-bit build is available from <http://sourceforge.net/projects/virtuoso/files/virtuoso/6.1.5/>. Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] non-fatal errors during sponge
On 04/17/2012 05:32 AM, Quentin wrote: Hi, I'm doing a sponge of a large JSON file using a custom cartridge and if I turn TRACE_ON() then somewhere during the import, I'm seeing pages and pages of errors that look like: "02:49:56 ERRS_0 42001 XPQ?? Magnitude is too big (950061485) to be packed into int" It doesn't seem to hurt the sponging any but I'm curious what it is and whether it's evidence of something I'm doing wrong or something I should worry about in the future? Hi, Could you post the code you're using (the PL procedure implementing the cartridge) and some sample data to reproduce it? Is it acceptable to consider using floats instead, trading size for a certain amount of precision? Cheers, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Stored Procedures, shell scripts, and execution check
On 05/10/2012 02:02 PM, bmillemathias@orange.com wrote: Hi there, I’m working to script recurrent operations we do on virtuoso (like data loading, clearing graph, backup, …) with a mix of virtuoso/PL stored procedures and shell scripts; it works almost fine but I’m stuck because I don’t know: * how to know if a command inside a stored procedure succeed or failed. If you're using system()[0] then this seems to return 0 on success, non-zero otherwise. * how to return status result from the stored procedure back to the shell. Could you point me some documentation / help ? To make virtuoso execute my procedures, I do this way: echo “DB.DBA.sp_clear_graph(‘<_http://foobar.net_>’) | isql-vt –U $myuser $mygraph” If your procedure either has a return value or calls result()[1], these will appear when you select the procedure rather than merely calling it: Compare: SQL> create procedure tdh_test() { return 123; }; echo 'tdh_test();' | isql-vt echo 'select tdh_test();' | isql-vt Additional tips: 1) "recurrent". Might the Scheduler help at all? 2) "backup". Is the online backups facility any use? Both are accessible in the Conductor under the SysAdmin tab. HTH! [0] http://docs.openlinksw.com/virtuoso/fn_system.html [1] http://docs.openlinksw.com/virtuoso/fn_result.html ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Duplicate graphs and "empty" graphs
On 05/15/2012 08:42 AM, Quentin wrote: Aah, both problems have the same cause. It's "localhost" being helpfully substituted into the uri by some operations. Now I have a localhost/... version of the graph as well as a a.b.c./... version of it. And a localhost version of a graph that was created by an "INSERT INTO " that must be addressed as to get results. You might want to have a look at your virtuoso.ini: [URIQA] DynamicLocal = 0 DefaultHost = mybox:8889 [SPARQL] DefaultGraph = http://mybox:8889/dataspace HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] import graphs virtually into another
On 07/02/2012 05:35 PM, Jonas Brekle wrote: i wondered, can I configure Virtuoso to virtuall import a graph into another? What I mean is: /-- A G <--- B \-- C Where G, A, B, C are graphs and when I query G, I get results as if I queried G, A, B, C (four FROMs). Implementing a owl:import inference. If I query A or B or C alone, I get only results from this single graph. How can I do this? Sounds suspiciously like our Graph Groups: http://docs.openlinksw.com/virtuoso/rdfgraphsecurity.html#rdfgraphsecuritygroups That any use? HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] Number of I/Os Statistics
On 07/26/2012 02:08 PM, Alex wrote: Hi again, Is it possible to obtain statistics e.x., number of I/Os after running a java application via the java virtuoso driver? For example: obtain statistics run application obtain statistics realize the differences... Hi, Yes; there are two approaches to performance - see http://docs.openlinksw.com/virtuoso/databaseadmsrv.html#perfdiag and http://docs.openlinksw.com/virtuoso/databaseadmsrv.html#ptune Also you can call status() from isql for an immediate overview. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
[Virtuoso-users] Announcing OpenLink Virtuoso, Open-Source Edition, v6.1.6
folder definition + Added default values for cartridges + Added support for WebDAV DET + Added support for private graphs + Fixed bad owner in some DET resources + Fixed permission problem for some DETs + Updated S3 DET folders re. support for WebID ACLs - Merged ODS Briefcase VAD + Added ACL for IMAP DET folder + Added mail notification for webid sharing + Fixed problem with editing mounted resources + Fixed resource server side encryption problem + Fixed sponger association with DETs feature - Merged ODS Calendar VAD + Added CalDAV, CardDAV DETs and RESTful CRUD + Fixed WebID write access + Fixed daylight savings time on import to calendar - Merged ODS Framework VAD + Added Help links + Added JSON output option for certgen + Added link tags to user's pages + Fixed 'Enable Automatic WebID Login' value + Fixed private graphs init + Fixed quotes on sparql vars + Fixed remove session when acl is altered + Fixed rest interface page + Fixed Semantic Pingback protocol + Fixed void dset + Updated CKeditor to version 3.6.3 Other links: Virtuoso Open Source Edition: * Home Page: <http://virtuoso.openlinksw.com/wiki/main/> * Download Page: <http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload> OpenLink Data Spaces: * Home Page: <http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex> * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): <http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef> OpenLink AJAX Toolkit (OAT): * Project Page: <http://sourceforge.net/projects/oat> * Live Demonstration: <http://demo.openlinksw.com/oatdemo> * Interactive SPARQL Demo: <http://demo.openlinksw.com/isparql/> OpenLink Data Explorer (Firefox extension for RDF browsing): * Home Page: <http://ode.openlinksw.com/> Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink>
Re: [Virtuoso-users] caching problems with sparql endpoint + "on the fly" XSLT transform using DAV directory and xslt-uri parameter?
On 03/18/2013 11:44 AM, Thomas Michaux wrote: Is there any caching system I need to force transform processor for refreshing XSLT stylesheet ? stopping and restarting Virtuoso will do the job but it's not really a solution:) Hi, Yes, there's xslt_stale('url...'); http://docs.openlinksw.com/virtuoso/fn_xslt_stale.html will tell you it does what it says on the tin :) HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink> smime.p7s Description: S/MIME Cryptographic Signature -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
[Virtuoso-users] Announcing OpenLink Virtuoso Open-Source Edition v6.1.7
Hi, OpenLink Software is pleased to announce the official release of Virtuoso Open-Source Edition, Version 6.1.7: New product features include: * Database engine - Added JDK 1.7 / JDBC 4.1 driver - Added new WebDAV API enhancements and Dynamic Extension Types (DETs) - Upgraded Conductor including new WebDAV UI for File Save, Create, and Share UX pattern exploitation - Upgraded Database Engined Hosted Facet Browser - Fixed issues with JDBC catalog metadata calls - Fixed issue with HTTP content length - Fixed issue with SQL relating to transitive closures - Fixed issue with XPath Query appearing twice in same tree - Fixed small issues in Cost Based Query Optimizer - Fixed memory leaks - Updated documentation * SPARQL and RDF Data Management - Added support for SPARQL 1.1 ASSUME, BIND, VALUES clauses - Added support for SPARQL 1.1 Update Protocol - Added support for SPARQL 1.1 Functions and Aggregates - Added support for ?graph parameter in SPARQL 1.1 Graph Protocol - Added SPARQL expression optimizations - Added support for live Hyperlinks for IRIs in HTML output from SPARQL endpoint - Added Jena 2.10.x connector - Added Sesame 2.7.x connector - Added new pretty-print option for Turtle output from SPARQL endpoint - Fixed processing of OPTION clauses for SPARQL-FED - Fixed support for untyped strings and xsd:string strings - Fixed issues associated with scalability of graph level security for RDF data - Fixed issues in Transitive option - Fixed missing RDF_QM_DEFINE_LITERAL_CLASS_WITH_FIXED_LANG - Fixed compilation of queries with deeply nested ?:globals - Fixed issues with Transitivity, Inference, and SPARQL 1.1 Property Paths * ODS Applications - Merged newer versions of the ODS applications Other links: Virtuoso Open Source Edition: * Home Page: <http://virtuoso.openlinksw.com/wiki/main/> * Download Page: <http://virtuoso.openlinksw.com/wiki/main/Main/VOSDownload> * GitHub: <https://github.com/openlink/virtuoso-opensource/tree/stable/6> OpenLink Data Spaces: * Home Page: <http://virtuoso.openlinksw.com/wiki/main/Main/OdsIndex> * SPARQL Usage Examples (re. SIOC, FOAF, AtomOWL, SKOS): <http://virtuoso.openlinksw.com/wiki/main/Main/ODSSIOCRef> OpenLink AJAX Toolkit (OAT): * Project Page: <http://sourceforge.net/projects/oat> * Live Demonstration: <http://demo.openlinksw.com/oatdemo> * Interactive SPARQL Demo: <http://demo.openlinksw.com/isparql/> OpenLink Data Explorer (Firefox extension for RDF browsing): * Home Page: <http://ode.openlinksw.com/> Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/> <http://twitter.com/openlink> smime.p7s Description: S/MIME Cryptographic Signature -- See everything from the browser to the database with AppDynamics Get end-to-end visibility with application monitoring from AppDynamics Isolate bottlenecks and diagnose root cause in seconds. Start your free trial of AppDynamics Pro today! http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] Virtuoso as a web content management system
Emiliano Heyns wrote: Hi, I'm looking for a web DAV-enabled CMS, so that the content editors can use nVu the edit the pages, and upload documents, images, etc; the CMS would allow the editors to model the menu links, and the CMS would take care of putting it all together. Is this feasible with Virtuoso? Is a ready-made environment available? Hi, Yes, Virtuoso can help here. In the first instance, you can use our WebDAV implementation from applications or as a filesystem (eg mounting it using Finder, Explorer or dav-fs depending on OS). As for ready-made environments, Virtuoso has the ODS suite of web applications, built around common XML data and publishing formats; ODS-Wiki will be of particular interest for content-management, with readily changeable templates and page content stored as files in WebDAV for behind-the-scenes editing if you wish. I recommend reading through http://virtuoso.openlinksw.com/wiki/main/Main/Ods and http://virtuoso.openlinksw.com/wiki/main/Main/OdsWiki . BTW, http://docs.openlinksw.com/virtuoso/support.html says community support is available on news.openlinksw.com (which appears to be entirely unavailable) or news.openlinksw.co.uk (which is available but nobody seems to be using it anymore). Sorry about that - slow turnaround. HTH, ~Tim -- Tim Haynes OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Licensing (Was: Virtuoso Open Source Edition and distributed SPARQL queries)
Emiliano Heyns wrote: [] I've been thinking about this, and I am still not certain about how to read the licensing. If I were to build that CMS, who would get to use it? Only private persons? Only approved (by whom?) OSS projects? Only OSS Projects that use the GPL exclusively? Would a commercial user be required to get an virtuoso license? Would and ISP offering it need one, or would its users need one? I get the proprietary vs. open source bit, but the commercial vs. non-commercial is not clear to me. After conferring with Kingsley and others, I'd like to set the record straight on licensing. First, the GPL says nothing about commercial use or otherwise. It is permitted as long as you abide by the GPL terms, notably: * if your application directly uses Virtuoso's sources or libraries (eg libvirtuoso), then the GPL forces your application to be released under the GPL too; * modifications to system table, stored-procedures and related source code etc. must be licensed under the GPL also; * making source code available when requested. Second, Virtuoso is a platform providing various languages (SQL/PL, VSP, VSPX), a WebDAV store and a means of packaging (VAD), in which you can write your own application(s). As author, you have copyright on the original code you write, and can therefore choose your own distribution license terms on your own VAD packages. To someone maintaining such a package, Virtuoso is a "dependency". Third, contributions of modifications to the Virtuoso open-source project must be under the terms of the GPL. If you have questions concerning Virtuoso's licensing and your own projects, please contact us at vos.ad...@openlinksw.com. We will be updating the website with these clarifications in the near future. Regards, ~Tim -- Tim Haynes OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Licensing (Was: Virtuoso Open Source Edition and distributed SPARQL queries)
Emiliano Heyns wrote: [] Yes, agreed. That does mean that application builders must take extra care when including other non-GPL libraries. I've been in discussions where applications that use JDBC, .Net providers and ODBC fall; the "contact surface" of the application is not directly with the libraries that the GPL app delivers to facilitate these conduits, but they do live in the same address space as the calling app. I am not sure whether that constitutes derivative use; most of the discussions I was in petered out before a conclusion was reached; my reading of the GPL says (but I am not a lawyer by any stretch of the imagination) that the letter would allow non-GPL use, while the intent is perfectly clear that it would be regarded as derivative use. Maybe the GPLv3 addresses this, I'm not up to speed with it. You'll be pleased to know we're also adding the following exemption for exactly this case: > Client Protocol Driver exemptions > In addition, as a special exemption, OpenLink Software gives permission to use the unmodified client libraries (ODBC, JDBC, ADO.NET and OleDB providers) > in your own application whether open-source or not, with no obligation to use > the GPL on the resulting application. In all other respects you must abide by the terms of the GPL. This will be in the next release and website update. Regards, ~Tim -- Tim Haynes OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] [Virtuoso-devel] Guidelines for 'users' v. 'devel' Postings?
Michael K. Bergman wrote: To List Moderators, Do you have any general guidelines for what you'd prefer posted to the 'users' v. 'devel' lists? Hi, Not officially / specifically, but off the top of my head I would suggest: a) if you have a lengthy discussion topic, a problem, a question or some uncertainty, it's probably -users; b) if you have a specific confirmed and reproducible bug to report, or a patch to fix it, it's probably -devel; c) there are whole grey areas that don't necessarily imply either list (eg benchmarks). In general, think about the target audience - either developers working on Virtuoso itself or other users who'll benefit from seeing the mail archive later and use your judgment accordingly :) Regards, ~Tim -- Tim Haynes OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] [Virtuoso-devel] Guidelines for 'users' v. 'devel' Postings?
Michael K. Bergman wrote: Hi Tim, Actually, you got to the crux of my question. You seem to suggest that -devel is for the actual developers of the Virtuoso code, not those who are doing development with Virtuoso or extending it. In other words, if it doesn't go into CVS it does not belong in -devel (e.g., "working on" v. "working with"). Is my interpretation correct? Well, if it touches on virtuoso's sources, ie belongs in CVS, then -devel is likely the best place, yes. Actually:: -- I would prefer -devel to be for any developments or extensions using Virtuoso and its cousins (both "working on" AND "working with" the code, but not simply using). This has potential. We can work with this, and if it becomes a distraction later, create a new list at a later date. -- I agree with your -users distinctions: use questions, applications, documentation, questions about functionality, installation, deployment, problems (but not yet diagnosed bugs), etc. -- I would then suggest that the Tracker be the preferred medium for bugs and feature requests, since those provide true tracking systems. Yes, particularly for handling larger diffs. We have size limits on both lists (slightly larger for -devel, but not much), so Tracker can be useful too. HTH, ~Tim -- Tim Haynes OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Virtuoso Build Problem
Rajeev J Sebastian wrote: Hello friends, I am trying to build Virtuoso 5.0.0 ... i hit a curious problem, which noone seems to have reported! The problem is that, virtuoso-opensource-5.0.0/libsrc/Wi/sql_code.c is not being generated properly. Many of the procedures are not quoted. A short example is: static const char *proc62 = [] "--src system.sql:850\n"; I'm guessing that the sql_to_c.awk script is failing to add the quotes around these lines. Since I do not know awk, I hope that someone could help me resolve this problem to build virtuoso. Hi, What version of awk do you have and on what platform is this? You might also like to peruse http://virtuoso.openlinksw.com/wiki/main/Main/VOSMake quickly, if not already. Regards, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Virtuoso Build Problem
Rajeev J Sebastian wrote: Hello Tim, On 5/24/07, Tim Haynes wrote: What version of awk do you have and on what platform is this? You might also like to peruse http://virtuoso.openlinksw.com/wiki/main/Main/VOSMake quickly, if not already. Thanks for the quick response .. I have GNU Awk 3.1.5. I am running Pardus Linux 2007.1, and I was planning on making a pisi package for VOS. The VOSMake page mentions 3.1.1 ... is VOS build system picky about this ? Interesting. One of my test boxes here uses 3.1.5 (on Gentoo) and the build is fine. Idea. Some distributions do compile gawk with locale-sensitive configure options. So check your LANG and LOCALE settings - mine are: zsh 2:59PM tim/ % locale LANG= LC_CTYPE="POSIX" LC_NUMERIC="POSIX" LC_TIME="POSIX" LC_COLLATE="POSIX" LC_MONETARY="POSIX" LC_MESSAGES="POSIX" LC_PAPER="POSIX" LC_NAME="POSIX" LC_ADDRESS="POSIX" LC_TELEPHONE="POSIX" LC_MEASUREMENT="POSIX" LC_IDENTIFICATION="POSIX" LC_ALL= > zsh 2:59PM tim/ % awk --version GNU Awk 3.1.5 Copyright (C) 1989, 1991-2005 Free Software Foundation. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Virtuoso Build Problem
Rajeev J Sebastian wrote: [] Idea. Some distributions do compile gawk with locale-sensitive configure options. So check your LANG and LOCALE settings - mine are: doing: LC_ALL=POSIX make seems to work. I'll give you the results when it is complete. Excellent, OK. I have a question regarding VOS. What is the Inference capability of VOS for RDF ? Is there any documentation regarding that ? Dynamic generation of triples in the result-sets is described as follows: Virtuoso SPARQL supports RDF Schema subclasses and subproperties. The predicates rdfs:subClassOf and rdfs:subPropertyOf are recognized when they appear in graphs included in a rule set. When such a rule set is specified as a context for a SPARQL query, the following extra triples are generated as needed. For every ?s rdf:type ?class, a triple ?s rdf:type ?superclass is considered to exist, such that ?superclass is a direct or indirect superclass of ?class. Direct superclasses are declared with the rdfs:subClassOf predicate in the rule set graph. Transitivity of superclasses is automatically taken into account, meaning that if a is a superclass of b and b a superclass of c, then a is a superclass of c also. Cyclic superclass relations are not allowed. If such occur in the rule set data, the behavior is undefined but will not involve nonterminating recursion. For every ?s ?subpredicate ?o, a triple ?s ?superpredicate ?o is considered to exist if the rule context declares ?superpredicate to be a superpredicate of ?predicate. This is done by havingthe triple ?subpredicate rdfs:subPropertyOf ?superpredicate as part of the graphs making up the rule context. Transitivity is observed, thus if a is a subpredicate of b and b a subpredicate of c, then a is also a subpredicate of c. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>
Re: [Virtuoso-users] Build problem with VOS 5.0
Rajeev J Sebastian wrote: Hello friends, I have hit on the next problem. [] = = STARTED RDF Mappers PACKAGING = Thu May 24 23:47:02 IST 2007 = Shutdown Virtuoso Server... VAD Sticker vad_dav.xml creation... VAD Sticker vad_fs.xml creation... Virtuoso.ini creation... The VDBMS server process terminated prematurely after opening the database. Waiting Virtuoso Server start on port ... Waiting Virtuoso Server start on port ... [] Waiting Virtuoso Server start on port ... Waiting Virtuoso Server start on port ... make[1]: *** [rdf_mappers_dav.vad] Interrupt make: *** [all-recursive] Interrupt The line "Waiting Virtuoso Server start on port ..." keeps repeating a lot. I tried restarting the build with "sudo" ... still same problem. Any hints ? Hi, Check the binsrc/rdf_mappers/*.log; I suspect you'll find the server is failing to listen on port because of a /tmp/virt_ file lying around. If so, remove it and all should be well again. HTH, ~Tim -- Tim Haynes Product Development Consultant OpenLink Software <http://www.openlinksw.com/>