Re: How to control the distribution??

2019-10-24 Thread Mikael
Hi! You can always use node filter to control where the cache is, I am not sure if there is a way to control distribution though, I guess it might be possible to use affinity keys and some kind of custom affinity function that is able to distribute the keys depending on some custom criteria,

Query execution in ignite

2019-10-24 Thread Prasad Bhalerao
Hi, When SQL is executed, does ignite always scan only primary partitions of all available nodes in cluster irrespective of cache mode partitioned or replicated? Thanks , Prasad

Re: Support for hdfs caching

2019-10-24 Thread Denis Magda
Robert, Could you please describe your use case? There several options that might suit your needs. Denis On Thursday, October 24, 2019, Munoz, Robert wrote: > Hello, > > > > With the removal of Hadoop accelerator from ignite binaries, are there any > other options for using HDFS as persistence

How to control the distribution??

2019-10-24 Thread BorisBelozerov
Normally, Apache Ignite distribute data equally to nodes How can I control this distribution? I want to distribute more data to some nodes, and less data to other nodes I also want to choose node to store cache Thank you!! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

[no subject]

2019-10-24 Thread ARSENAL 1886
Normally, Apache Ignite distribute data equally to nodes How can I control this distribution? I want to distribute more data to some nodes, and less data to other nodes I also want to choose node to store cache Thank you!! Sent from Mail for Windows 10

Re: Apache Spark + Ignite Connection Issue

2019-10-24 Thread sri hari kali charan Tummala
I got it so I have to build a jar move to aws ignite cluster node and run it on the node. Thanks Sri On Thursday, October 24, 2019, Denis Magda wrote: > Sri, > > That's wrong to assume that the Ignite thin client is the only way to > access data stored in AWS or other cloud environments. The pr

RE: Invalidate specific cache partitions

2019-10-24 Thread alexanderkor12
Hi! You can use IgniteCache.close() -- https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/IgniteCache.html#close-- Or IgniteCache.destroy() -- https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/IgniteCache.html#destroy-- To close or destroy a specific

RE: Support for hdfs caching

2019-10-24 Thread Munoz, Robert
Hello, With the removal of Hadoop accelerator from ignite binaries, are there any other options for using HDFS as persistence store? Thanks, Robert Munoz This message contains confidential information and is intended only for the individual named. If you are not the named addressee, you shou

Invalidate specific cache partitions

2019-10-24 Thread Prasad Bhalerao
Hi, 1)Is there any way to invalidate specific cache partitions? 2) is there any way to invalidate the complete cache? Thanks, Prasad

Re: Apache Spark + Ignite Connection Issue

2019-10-24 Thread Denis Magda
Sri, That's wrong to assume that the Ignite thin client is the only way to access data stored in AWS or other cloud environments. The problems you are experiencing are caused by the fact that your application is running on the laptop while the cluster (server nodes) is within an AWS network. If y

Re: Striim support for Ignite

2019-10-24 Thread Denis Magda
Looping in dev list. Folks, does anybody have any experience with Striim or ready to research? https://www.striim.com/sources-and-targets/ It might be an option for change-data-capture scenarios from Ignite clusters (with and without persistence) to other stores like RDBMS or Cassandra. - Denis

Re: Write python dataframe to ignite table.

2019-10-24 Thread Denis Magda
Andrey, Alexey, Nikolay, Do we have any solutions for calling Ignite + Spark implementation from Python? - Denis On Tue, Oct 22, 2019 at 3:41 AM Muhammed Favas < favas.muham...@expeedsoftware.com> wrote: > Hi, > > > > Is there a way to bulk load python dataframe values to ignite table? > > > >

Re: Error while adding the node the baseline topology

2019-10-24 Thread Denis Magda
Hi, What is the application doing while you are changing the topology? Is the cluster under the load? Generally, we've added critical failure handlers in the latest version of Ignite and the message reported is printed out by them: https://apacheignite.readme.io/docs/critical-failures-handling -

Re: Durable message topic subscriptions?

2019-10-24 Thread Denis Magda
Hey, Are you already using Ignite together with JMS and what is the primary reason for the JMS replacement? - Denis On Wed, Oct 23, 2019 at 4:41 AM pauld wrote: > I have a system that uses JMS topics with a durable subscription to process > events between different applications, and the durab

Re: Multiple embedded Ignite instances as replicated cache

2019-10-24 Thread Denis Magda
Hi Cihan, Is there any reason why you cannot separate applications from Ignite as a store/database? The embedded mode makes sense for low-latency use cases while the standard client-server deployment option is better in terms of manageability, scalability: https://www.gridgain.com/docs/latest/inst

Ignite meetup in NY and details of Postgres acceleration scenarios

2019-10-24 Thread Denis Magda
Ignite user and dev community, Next Tuesday I'll be in NY conducting in-memory computing essentials session for one of the biggest meetup communities of the city [1]. Stop by if you're around. Let's meet in person. Once the main track is over we can stay and have a couple of beers/sodas discussing

Re: Node stopped.

2019-10-24 Thread John Smith
Is it possible this is somehow causing the issue of the node stopping? On Thu, 24 Oct 2019 at 11:24, Ilya Kasnacheev wrote: > Hello! > > This likely means that you have reachability problems in your cluster, > such as, xxx.xxx.xxx.68 can connect to xxx.xxx.xxx.82 (on range > 47100-47200) but not

Re: Issue with adding nested index dynamically

2019-10-24 Thread Hemambara
Result should not be same, could you please share your logs. Couple of issues here. 1) *With out fix *- I got null instead of "Address.street" value [[1, Person{name='john', address=Address{street='baker', number=221}}, john, Address{street='baker', number=221}, *null*]] *With fix* [[1, Pe

Re: Multiple embedded Ignite instances as replicated cache

2019-10-24 Thread Cihan Keser
Thanks for the info, Ilya! Do you think it would have any actual risk to use PartitionLossPolicy.IGNORE with my configuration? Because as I understand the data is fully replicated on each node, so it cannot really lose a particular partition; or do I misunderstand? Is there a ticket/link where

Re: Multiple embedded Ignite instances as replicated cache

2019-10-24 Thread Ilya Kasnacheev
Hello! You will soon be able to use topology auto-adjust. Until then, I guess you will have to fix topology on entry of every node. -- Ilya Kasnacheev чт, 24 окт. 2019 г. в 14:52, Cihan Keser : > Hi, > > I have a case where I'm trying to use Ignite (embedded i.e.: > Ignition.getOrStart(igniteC

Re: Ingite node in SpringBoot App

2019-10-24 Thread Ilya Kasnacheev
Hello! I start ignite-client but it never does anything, and in thread dump I don't see any relevant threads. Can you perhaps make the error more apparent? I have trouble understanding your scenario. You can start client node (by setting cfg.clientMode=true) to avoid having cache data locally.

Re: Ignite transactions dont work on multiple cache

2019-10-24 Thread Ilya Kasnacheev
Hello! I have noticed that you have READ_COMMITTED isolation when reading. It will doubtlessly lead to situation when you read value from TXN-1 to set1 while TXN is in progress, and then will read value from TXN to set2 because it is committed already. Don't you see it as a problem? Regards, --

Re: Node stopped.

2019-10-24 Thread Ilya Kasnacheev
Hello! This likely means that you have reachability problems in your cluster, such as, xxx.xxx.xxx.68 can connect to xxx.xxx.xxx.82 (on range 47100-47200) but not the other way around. Regards, -- Ilya Kasnacheev пн, 21 окт. 2019 г. в 19:36, John Smith : > I also see this printing every few s

Re: Does ignite support FULL OUTER JOIN ?

2019-10-24 Thread Ivan Pavlukhin
Hi, FULL OUTER JOIN is not supported as it is not supported in H2 [1] (Ignite uses H2 internally for query processing). [1] https://github.com/h2database/h2database/issues/457 чт, 24 окт. 2019 г. в 14:03, DS : > > I am giving the syntax as : > > SELECT * FROM person Outer join city ON person.

Multiple embedded Ignite instances as replicated cache

2019-10-24 Thread Cihan Keser
Hi, I have a case where I'm trying to use Ignite (embedded i.e.: Ignition.getOrStart(igniteConfiguration) called in a Spring bean definition) in a multi-node Spring Boot application with active-active setup. My goal is to utilize Ignite as a shared, atomic, and persistent key-value store. For t

Does ignite support FULL OUTER JOIN ?

2019-10-24 Thread DS
I am giving the syntax as : SELECT * FROM person Outer join city ON person.city_id = city.city_id Same query works well with inner ,left ,right join . Please correct me if i am doing something wrong. P.S. Both tables have index over city_id column -- Sent from: http://apache-ignite-users

Re: Issue with adding nested index dynamically

2019-10-24 Thread Ivan Pavlukhin
Hi Hemambara, I rewrote my example in form of a junit test [1]. And I suppose that it should pass to make the feature useful. Could please check it and tell me if my understanding is wrong. I tried this test with proposed fix and without it. Result was the same. [1] https://gist.githubuserconten