The approach mentioned by Paul worked for me perfectly, many thanks!!!
Best
Andy
Von: Paul Houle [mailto:ontolo...@gmail.com]
Gesendet: Donnerstag, 30. April 2015 18:37
An: Nolle, Andreas
Cc: Hugh Williams; virtuoso-users@lists.sourceforge.net
Betreff: Re: [Virtuoso-users] more than 1048576 query results
Something that is more scalable than OFFSET is to compare on keys, so if you
ORDER BY a "key" node, LIMIT it, then add something to the query to get just
keys that are greater than the last one, you move the paging logic out of the
db and you get way better results.
This is a common tactic in the relational db world, see
http://docs.spring.io/spring-batch/trunk/reference/html/readersAndWriters.html#pagingItemReaders
On Thu, Apr 30, 2015 at 5:29 AM, Nolle, Andreas
<no...@hs-albsig.de<mailto:no...@hs-albsig.de>> wrote:
In the meantime I’ve upgraded to Version 7.2.0_p1.3212-pthreads and the issue
is still the same!
Best
Andy
Von: Nolle, Andreas [mailto:no...@hs-albsig.de<mailto:no...@hs-albsig.de>]
Gesendet: Donnerstag, 30. April 2015 08:21
An: Hugh Williams
Cc:
virtuoso-users@lists.sourceforge.net<mailto:virtuoso-users@lists.sourceforge.net>
Betreff: Re: [Virtuoso-users] more than 1048576 query results
Hi,
the version I use is:
Version 7.1.0.3207-pthreads as of Apr 15 2014
Compiled for Linux (x86_64-unknown-linux-gnu)
The exception I’ve got in my application using the OWL and Sesame API is:
Connection refused: connect
After that the virtuoso instance isn’t available anymore and the service just
hanged up without any log entry.
Best
Andy
Von: Hugh Williams [mailto:hwilli...@openlinksw.com]
Gesendet: Donnerstag, 30. April 2015 03:08
An: Nolle, Andreas
Cc:
virtuoso-users@lists.sourceforge.net<mailto:virtuoso-users@lists.sourceforge.net>
Betreff: Re: [Virtuoso-users] more than 1048576 query results
Hi Andy,
1048576 is a known limit on the size of a Virtuoso result set, thus using limit
and offset is the way to go if you really need this many results.
What Virtuoso version are you using “virtuoso-t -?”
When the server crashes is an error returned on the client and is and error
reported in the “virtuoso.log” file or the system log ?
Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc. // http://www.openlinksw.com/
Weblog -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter -- http://twitter.com/OpenLink
Google+ -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers
On 29 Apr 2015, at 15:49, Nolle, Andreas
<no...@hs-albsig.de<mailto:no...@hs-albsig.de>> wrote:
Hi all,
I’ve tried to retrieve more than 1048576 query results (I know this is much ;)
through the SPARQL endpoint, but with no success.
I’ve also tried to retrieve the results by using LIMIT and OFFSET, but the
server crashes on querying the second 1048576 results.
Is there a way to enable this?
If not, is there an alternative way to dump these query results?
Best
Andy
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net<mailto:Virtuoso-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net<mailto:Virtuoso-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
--
Paul Houle
Applying Schemas for Natural Language Processing, Distributed Systems,
Classification and Text Mining and Data Lakes
(607) 539 6254 paul.houle on Skype
ontolo...@gmail.com<mailto:ontolo...@gmail.com>
https://legalentityidentifier.info/lei/lookup<http://legalentityidentifier.info/lei/lookup>
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
