John Zhuge created HADOOP-14764:
-----------------------------------
Summary: Über-jira adl:// Azure Data Lake Phase II: Performance
and Testing
Key: HADOOP-14764
URL: https://issues.apache.org/jira/browse/HADOOP-14764
Project: Hadoop Common
Issue Type: Improvement
Components: fs/adl
Affects Versions: 3.0.0-alpha2
Reporter: John Zhuge
Assignee: John Zhuge
Uber JIRA to track things needed for Azure Data Lake to be considered stable
and adl:// ready for wide use.
Based on the experience with other object stores, the things which usually
surface once a stabilizing FS is picked up and used are
* handling of many GB files, up and down, be it: efficiency of read, when the
writes take place, file leakage, time for close() and filesystem shutdown
* resilience to transient failures
* reporting of problems/diagnostics
* security option tuning
* race conditions
* differences between implementation and what actual applications expect
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
