[
https://issues.apache.org/jira/browse/PIO-61?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985054#comment-15985054
]
ASF GitHub Bot commented on PIO-61:
-----------------------------------
Github user mars commented on a diff in the pull request:
https://github.com/apache/incubator-predictionio/pull/371#discussion_r113494975
--- Diff: storage/s3/build.sbt ---
@@ -0,0 +1,44 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+import PIOBuild._
+
+name := "apache-predictionio-data-s3"
+
+libraryDependencies ++= Seq(
+ "org.apache.predictionio" %% "apache-predictionio-core" % version.value
% "provided",
+ "com.google.guava" % "guava" % "14.0.1"
% "provided",
+ "com.amazonaws" % "aws-java-sdk-s3" % "1.11.118",
+ "org.scalatest" %% "scalatest" % "2.1.7" %
"test")
+
+parallelExecution in Test := false
+
+pomExtra := childrenPomExtra.value
+
+assemblyOption in assembly := (assemblyOption in
assembly).value.copy(includeScala = false)
+
+assemblyShadeRules in assembly := Seq(
+ ShadeRule.rename("org.apache.http.**" ->
"shadeio.data.s3.http.@1").inAll,
+ ShadeRule.rename("com.fasterxml.**" ->
"shadeio.data.s3.fasterxml.@1").inAll
+)
--- End diff --
Hi @marevol,
We're building a [predictionio-incubating branch to add authentication to
the Elasticsearch REST
client](https://github.com/apache/incubator-predictionio/pull/372) with Scala
2.11 & Spark 2.1.
I believe it was during a runtime ES REST client call to `performRequest`
suddenly an underlying method signature could not be located in
`org.apache.http` package. @dszeto helped me to discover that the
`shadeio.data` name was being incorrectly resolved. So, I tried [removing the
shade
rule](https://github.com/apache/incubator-predictionio/pull/372/files#diff-55cfeb297edd310e1efa8b6ac8bdbae6L39)
and it started working. No more errors for that branch.
Maybe the difference is that we're using Spark 2.1?
> Add S3 Model Data Repository
> ----------------------------
>
> Key: PIO-61
> URL: https://issues.apache.org/jira/browse/PIO-61
> Project: PredictionIO
> Issue Type: Improvement
> Reporter: Shinsuke Sugaya
>
> To put/get model data to AWS S3 directly, using aws-java-sdk-s3, add
> storage/s3 implementation.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
