[
https://issues.apache.org/jira/browse/PIG-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated PIG-5388:
------------------------------------
Priority: Major (was: Minor)
https://github.com/apache/hadoop/blob/trunk/hadoop-project/pom.xml#L65 has avro
version as 1.11.5. When running with Hadoop 3.x, Pig runs into
{code}
Unknown datum class: class com.fasterxml.jackson.databind.node.NullNode
{code}
Also for non-existing fields, older avro version defaulted to null, but now
fails with error
{code}
Error: org.apache.avro.AvroRuntimeException: Not a valid schema field: xxxxx
at org.apache.avro.generic.GenericData$Record.get(GenericData.java:282)
{code}
https://github.com/apache/pig/blob/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigSchema2Avro.java#L350
JsonNode defaultvalue = (inputField != null) ? inputField.defaultValue() : null;
should be changed to have JsonProperties.NULL_VALUE;
> Upgrade to Avro and Trevni 1.12.x
> ---------------------------------
>
> Key: PIG-5388
> URL: https://issues.apache.org/jira/browse/PIG-5388
> Project: Pig
> Issue Type: Improvement
> Reporter: Nándor Kollár
> Assignee: Rohini Palaniswamy
> Priority: Major
> Fix For: 0.19.0
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
