connorlwilkes opened a new issue, #781:
URL: https://github.com/apache/incubator-uniffle/issues/781

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the 
[issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### Describe the bug
   
   When attempting to deploy the latest release of Uniffle on Kubernetes with 
an emptyDir mount that mounts to /mnt/disk1 I am seeing initialization errors 
for the local storage. It's strange because there are no actual exceptions 
logged or thrown. Through some debugging I have found that it is likely due to 
the new way that storageMedia is deterrmined following 
https://github.com/apache/incubator-uniffle/issues/410. 
   
   I have discovered that this new method is seemingly unable to determine the 
storage type of this mounted disk and therefore seems to return UNKNOWN which 
breaks the storage initialization. 
   
   The only actual error that is thrown is:
   
   ```
   23/03/29 10:16:47 ERROR ShuffleServer: Errors on initializing shuffle 
server.                                                                         
                                                                                
                                                  java.lang.RuntimeException: 
Initialize 1 local storage(s) failed, specified local storage paths size: 1, 
the conf of rss.server.localstorage.initialize.max.fail.number size: 0          
                                                                                
                   at 
org.apache.uniffle.server.storage.LocalStorageManager.<init>(LocalStorageManager.java:150)
                                                                                
                                                                                
                           at 
org.apache.uniffle.server.storage.StorageManagerFactory.createStorageManager(StorageManagerFactory.java:36)
                                         
                                                                                
                                                  at 
org.apache.uniffle.server.ShuffleServer.initialization(ShuffleServer.java:184)  
                                                                                
                                                                                
                                     at 
org.apache.uniffle.server.ShuffleServer.<init>(ShuffleServer.java:85)           
                                                                                
                                                                                
                                     at 
org.apache.uniffle.server.ShuffleServer.main(ShuffleServer.java:103)           
   ```
   
   It is possible to use "rss.server.storageMediaProvider.from.env.key" and set 
the type that way which resolves this but this is not very well documented and 
it took me a while to work out the exact issue. 
   
   I can provide more information as required
   
   ### Affects Version(s)
   
   master/0.7-rc4
   
   ### Uniffle Server Log Output
   
   _No response_
   
   ### Uniffle Engine Log Output
   
   _No response_
   
   ### Uniffle Server Configurations
   
   _No response_
   
   ### Uniffle Engine Configurations
   
   _No response_
   
   ### Additional context
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to