Yes, Even in HDFS(3.1.1), I have seen the performance degradation compared with 2.7.2. I have done the DFSIO test following are the details.
Test: DATA SIZE: 1TB No of Files : 1000 File size : 1GB *Hadoop-3.1.1::* *DFSIO Write : 1420.99 sec* *Hadoop-2.7.2::* *DFSIO Write : 1297.971 sec* so,there is degradation compare to 2.7.2..Any pointers to this?? Thanks Harshakiran Reddy From: bilwa st <[email protected]> Date: Fri, 22 Nov 2019 at 9:09 PM Subject: Performance issue To: <[email protected]> Hi, Tera sort is slow by 9mins(26%) in 3.1.1 compared to 2.7.2 I could see some JIRA open for the same issue ie MAPREDUCE-6735 Has anyone else faced the same issue? Thanks, Bilwa ST -- *Regards* Harshakiranreddy.Boreddy
