Re: Crash when uploading large data sets

2011-05-13 Thread James Cipar
04 SIGXFSZ: [libjvm.so+0x4ab9d0], sa_mask[0]=0x7ffbfeff, sa_flags=0x1004 SIGILL: [libjvm.so+0x4ab9d0], sa_mask[0]=0x7ffbfeff, sa_flags=0x1004 SIGUSR1: SIG_DFL, sa_mask[0]=0x, sa_flags=0x SIGUSR2: [libjvm.so+0x4ab380], sa_mask[0]=0x, sa_flags=0x1004 SIGHUP:

Re: Crash when uploading large data sets

2011-05-12 Thread James Cipar
@172-19-149-62:~$ Also, this is pretty subjective, so I can't say for sure until it finishes, but this seems to be running *much* slower after setting the heap size and setting up JNA. On May 12, 2011, at 7:52 PM, James Cipar wrote: > It looks like MAX_HEAP_SIZE is set in cassandra

Re: Crash when uploading large data sets

2011-05-12 Thread James Cipar
his is > just create a symlink into your Cassandra lib directory (note: replace > /home/techlabs with your home dir location): > ln -s /usr/share/java/jna.jar /home/techlabs/apache-cassandra-0.7.0/lib > > Research: > http://journal.paul.querna.org/articles/2010/11/11/enabling-jna-in-cassandra/ &g

Crash when uploading large data sets

2011-05-12 Thread James Cipar
I'm using Cassandra 0.7.5, and uploading about 200 GB of data total (20 GB unique data), to a cluster of 10 servers. I'm using batch_mutate, and breaking the data up into chunks of about 10k records. Each record is about 5KB, so a total of about 50MB per batch. When I upload a smaller 2 GB da

Re: Consistency model

2011-04-18 Thread James Cipar
th this guarantee. > > /*** > sent from my android...please pardon occasional typos as I respond @ the > speed of thought > / > > >> On Apr 17, 2011 10:04 AM, "James Cipar" wrote: >> >> > For a se

Re: Consistency model

2011-04-17 Thread James Cipar
at, and wanted to see A >> in #2 until success in #1. But, I wanted to get to state B, and if #1 >> retries until guaranteed success, do I care if I set B earlier than I >> expected? I'm thinking no. >> >> I guess in terms of distributed algorithms/reasoning abou

Re: Consistency model

2011-04-17 Thread James Cipar
m >>>> A >>>> and B is merged, sequence number 2 is the newest and is returned. A read >>>> repair is pushed to B and C, but they don't yet update their data. >>>> 4. Reader process reads again, gets a response from B and C (before >>>

Re: Consistency model

2011-04-17 Thread James Cipar
quence number 2 is the newest and is returned. A read > >> repair is pushed to B and C, but they don't yet update their data. > >> 4. Reader process reads again, gets a response from B and C (before > >> they've > >> repaired). These both report

Re: Consistency model

2011-04-16 Thread James Cipar
M, Tyler Hobbs wrote: > James, > > Would you mind sharing your reader process code as well? > > On Fri, Apr 15, 2011 at 1:14 PM, James Cipar wrote: > I've been experimenting with the consistency model of Cassandra, and I found > something that seems a bit unexpected.

Consistency model

2011-04-15 Thread James Cipar
I've been experimenting with the consistency model of Cassandra, and I found something that seems a bit unexpected. In my experiment, I have 2 processes, a reader and a writer, each accessing a Cassandra cluster with a replication factor greater than 1. In addition, sometimes I generate backgr