Hi,
could anybody please help me to figure out following error with
group-by-key fn?
(defn sorted-tuple [p f]
(if (< (.compareTo p f) 0)
(spark/tuple p f)
(spark/tuple f p)))
(defn tuples-list [[p & frens]]
(map #(spark/tuple (sorted-tuple p %) frens) frens))
(->> (spark/parallelize sc ["100 200 300 400 500 600", "200 100 300 400", "300
100 200 400 500", "400 100 200 300", "500 100 300", "600 100"])
(spark/map #(split-at-space %))
(spark/flat-map #(tuples-list %))
(spark/group-by-key))
CompilerException java.lang.IllegalArgumentException: No matching field found:
groupByKey for class org.apache.spark.api.java.JavaRDD, compiling:
I'm trying hard to figure out but could not. It works if I replace
'group-by-key' with
(spark/group-by #(._1 %))
but that's not what I want.
Anybody please?
thanks
-tilak
On Wednesday, January 7, 2015 at 6:23:42 AM UTC-6, chris_betz wrote:
>
> Hi,
>
>
> we just released Sparkling (https://gorillalabs.github.io/sparkling/),
> our take on an API to Apache Spark.
>
>
>
> With an eye on speed for very large amounts of data we improved clj-spark
> and flambo to get us the speed we need for our production environment.
>
>
> See https://gorillalabs.github.io/sparkling/articles/getting_started.html
> for a quickstart or dive directly into our playground project by
> git clone https://github.com/gorillalabs/sparkling-getting-started.git
>
>
>
> Happy hacking
>
> Chris
> (@gorillalabs_de <https://twitter.com/gorillalabs_de>)
>
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to [email protected]
Note that posts from new members are moderated - please be patient with your
first post.
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to the Google Groups
"Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
