SarahAsad23 opened a new issue, #4296: URL: https://github.com/apache/texera/issues/4296
### Feature Summary Currently, workflows are executed using the system Python environment. This limits users who need custom packages to run their workflows. In addition, some workflows may contain multiple UDF operators that require different dependencies. The Python Virtual Environment feature addresses this limitation by allowing users to create multiple environments with custom installed packages. Users can then select the desired environment for each UDF operator through the operator’s property panel, enabling different operators within the same workflow to run in different environments. ### Proposed Solution or Design In the first iteration of our design, environments will be stored on the local volume of each computing unit. The Python UDF operator will include a dropdown menu that allows users to select from the available environments. During execution, when a UDF operator is encountered, the system will spawn a Python process using the Python executable from the selected virtual environment. ### Impact / Priority (P1)High – significantly improves user experience ### Affected Area Workflow Engine (Amber) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
