Hi Deepti, I think you probably just have to test your application (built against 3.3.3) against a 2.7.3 cluster and see what the result is. We have run 2.x clients against 3.x clusters and 3.x clients against 2.x clusters, and things generally work, although there is occasionally something like HDFS-15191 where wire compatibility gets broken by accident. I would not be surprised at all if there is such an issue with a 2.7.3 client and a 3.3.3 cluster, since those are six years apart in time, and 2.7.3 has been EOL for a while, but I think the only way to find out is to try in a test environment. If there is a problem, I suspect it would be considered "won't fix" due to 2.7.3 being EOL, but I'm not a committer, so can't say for sure.
Best, Steve On Fri, Aug 5, 2022 at 12:23 AM Deepti Sharma S <[email protected]> wrote: > Hello Hema & team, > > > > Can you please help in below query, this is little urgent for us. > > > > > > Regards, > > Deepti Sharma > * PMP® & ITIL* > > > > *From:* Deepti Sharma S <[email protected]> > *Sent:* Thursday, August 4, 2022 9:50 AM > *To:* Hema Kumar <[email protected]> > *Cc:* [email protected]; Deepak Nangia <[email protected]>; > [email protected] > *Subject:* RE: Backward Compatibility for HDFS 2.7.3 > > > > Hello Hema, HDFS Team, > > > > I shall explain the use case based on which we have posted the queries > below. > > Our product contains one of the activities which uses HDFS client driver > to distribute files to HDFS server. HDFS server is installed separately & > is not part of our product packaging. > > We are planning to move HDFS Client Driver to latest stable version of > HDFS 3.3.3 in our future release of product. > > > > When our customer upgrades to our latest version of product, this will > imply that HDFS Client Driver shall be version of HDFS 3.3.3. Here arises > the use case where there is a possibility of HDFS Client being on latest > version 3.3.3 v/s HDFS Server being on older version of 2.7.3. Customer may > eventually upgrade HDFS Server to latest stable version 3.3.3 as well but > there is a possibility that HDFS Server upgrade shall not be done > simultaneously. > > > > So my query is as below: > > > > 1. Use Case1: HDFS Client Driver on latest stable version of HDFS > 3.3.3 while HDFS Server is on older version 2.7.3: > > > 1. Can you please let us know if there are any HDFS Client level API > changes in 3.3.3 version from older version of 2.7.3 which are not backward > compatible. > 2. Suppose we move HDFS Client to version 3.3.3 and HDFS Server > remains on older version 2.7.3. Is there any functionality present in older > HDFS Client version 2.7.3 which shall not work if we upgrade HDFS Client to > version 3.3.3 with HDFS Server still on older release 2.7.3? > > > 1. I have gone through this Hadoop documentation link > > <https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Compatibility.html#Wire_Protocols> > (Apache Hadoop 3.3.3 – Apache Hadoop Compatibility > > <https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Compatibility.html#Wire_Protocols>) > where there is mention of “forward compatible across minor releases within > a major version“. However I am not able to find mention of compatibility > across Major versions. > 1. Could you please point me to compatibility matrix and/or > statement which can be used to deduce the compatibility of the new > client > driver with old released Hadoop servers & vice-versa > > > > > > > > Regards, > > Deepti Sharma > * PMP® & ITIL* > > > > *From:* Hema Kumar <[email protected]> > *Sent:* Wednesday, August 3, 2022 10:01 AM > *To:* Deepti Sharma S <[email protected]> > *Cc:* [email protected]; Deepak Nangia <[email protected]>; > [email protected] > *Subject:* Re: Backward Compatibility for HDFS 2.7.3 > > > > Hi Deepti, > > I have a question regarding the use case, What is the benefit you are > getting from updating only client? > > > > -- Hema Kumar > > > > On Tue, Aug 2, 2022 at 11:04 PM Deepti Sharma S < > [email protected]> wrote: > > Hello Team, > > > > We are currently using Hadoop HDFS version 2.7.3 at HDFS Client Driver & > HDFS Server. We have following queries: > > > > 1. We are planning to move HDFS Client Driver to latest stable version > of HDFS 3.3.3. > > > 1. Can you please let us know if there are any HDFS Client level API > changes in 3.3.3 version from older version of 2.7.3 which are not > backward > compatible. > 2. Suppose we move HDFS Client to version 3.3.3 and HDFS Server > remains on older version 2.7.3. Is there any functionality present in > older > HDFS Client version 2.7.3 which shall not work if we upgrade HDFS > Client to > version 3.3.3 with HDFS Server still on older release 2.7.3? > > > > 1. I have gone through this Hadoop documentation link > > <https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Compatibility.html#Wire_Protocols> > where there is mention of “forward compatible across minor releases within > a major version“. However I am not able to find mention of compatibility > across Major versions. > > > 1. Could you please point me to compatibility matrix and/or statement > which can be used to deduce the compatibility of the new client driver > with > old released Hadoop servers & vice-versa. > > > > > > > > Regards, > > Deepti Sharma > * PMP® & ITIL* > > > >
