Something that is more scalable than OFFSET is to compare on keys, so if
you ORDER BY a "key" node, LIMIT it, then add something to the query to
get just keys that are greater than the last one, you move the paging
logic out of the db and you get way better results.
This is a common tactic in the relational db world, see
http://docs.spring.io/spring-batch/trunk/reference/html/readersAndWriters.html#pagingItemReaders
On Thu, Apr 30, 2015 at 5:29 AM, Nolle, Andreas <no...@hs-albsig.de> wrote:
> In the meantime I’ve upgraded to Version 7.2.0_p1.3212-pthreads and the
> issue is still the same!
>
>
>
> Best
>
> Andy
>
>
>
>
>
>
>
> *Von:* Nolle, Andreas [mailto:no...@hs-albsig.de]
> *Gesendet:* Donnerstag, 30. April 2015 08:21
> *An:* Hugh Williams
>
> *Cc:* virtuoso-users@lists.sourceforge.net
> *Betreff:* Re: [Virtuoso-users] more than 1048576 query results
>
>
>
> Hi,
>
>
>
> the version I use is:
>
> Version 7.1.0.3207-pthreads as of Apr 15 2014
>
> Compiled for Linux (x86_64-unknown-linux-gnu)
>
>
>
> The exception I’ve got in my application using the OWL and Sesame API is:
> Connection
> refused: connect
>
> After that the virtuoso instance isn’t available anymore and the service
> just hanged up without any log entry.
>
>
>
> Best
>
> Andy
>
>
>
>
>
>
>
> *Von:* Hugh Williams [mailto:hwilli...@openlinksw.com
> <hwilli...@openlinksw.com>]
> *Gesendet:* Donnerstag, 30. April 2015 03:08
> *An:* Nolle, Andreas
> *Cc:* virtuoso-users@lists.sourceforge.net
> *Betreff:* Re: [Virtuoso-users] more than 1048576 query results
>
>
>
> Hi Andy,
>
>
>
> 1048576 is a known limit on the size of a Virtuoso result set, thus using
> limit and offset is the way to go if you really need this many results.
>
>
>
> What Virtuoso version are you using “virtuoso-t -?”
>
>
>
> When the server crashes is an error returned on the client and is and
> error reported in the “virtuoso.log” file or the system log ?
>
>
>
>
>
> Best Regards
>
> Hugh Williams
>
> Professional Services
>
> OpenLink Software, Inc. // http://www.openlinksw.com/
>
> Weblog -- http://www.openlinksw.com/blogs/
>
> LinkedIn -- http://www.linkedin.com/company/openlink-software/
>
> Twitter -- http://twitter.com/OpenLink
>
> Google+ -- http://plus.google.com/100570109519069333827/
>
> Facebook -- http://www.facebook.com/OpenLinkSoftware
>
> Universal Data Access, Integration, and Management Technology Providers
>
>
>
> On 29 Apr 2015, at 15:49, Nolle, Andreas <no...@hs-albsig.de> wrote:
>
>
>
> Hi all,
>
>
>
> I’ve tried to retrieve more than 1048576 query results (I know this is
> much ;) through the SPARQL endpoint, but with no success.
>
> I’ve also tried to retrieve the results by using LIMIT and OFFSET, but the
> server crashes on querying the second 1048576 results.
>
> Is there a way to enable this?
>
> If not, is there an alternative way to dump these query results?
>
>
>
> Best
>
> Andy
>
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
>
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y_______________________________________________
> Virtuoso-users mailing list
> Virtuoso-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
>
>
>
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Virtuoso-users mailing list
> Virtuoso-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
>
>
--
Paul Houle
*Applying Schemas for Natural Language Processing, Distributed Systems,
Classification and Text Mining and Data Lakes*
(607) 539 6254 paul.houle on Skype ontolo...@gmail.com
https://legalentityidentifier.info/lei/lookup
<http://legalentityidentifier.info/lei/lookup>
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
