spark git commit: [SPARK-4841] fix zip with textFile()

2014-12-17 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.2 76c88c668 -> 0429ec308 [SPARK-4841] fix zip with textFile() UTF8Deserializer can not be used in BatchedSerializer, so always use PickleSerializer() when change batchSize in zip(). Also, if two RDD have the same batch size already, the

spark git commit: [SPARK-4841] fix zip with textFile()

2014-12-15 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master c7628771d -> c246b95dd [SPARK-4841] fix zip with textFile() UTF8Deserializer can not be used in BatchedSerializer, so always use PickleSerializer() when change batchSize in zip(). Also, if two RDD have the same batch size already, they di