shohamyamin opened a new issue, #10909:
URL: https://github.com/apache/iceberg/issues/10909

   ### Feature Request / Improvement
   
   ### Summary:
   We would like to request the addition of a new feature in the Iceberg REST 
catalog that would allow the catalog to return a row filter expression for a 
table and a column mask expression for each column.
   
   ### Rationale:
   This feature would enable query engines, such as Trino and Spark, to obtain 
crucial information from the catalog regarding how to handle requested 
resources. Specifically, it would inform the engines if any filtering or 
masking is required when accessing the data, ensuring that sensitive 
information is appropriately protected and that data access policies are 
consistently enforced.
   
   ### Proposed Implementation:
   **Row Filter Expression:** For each table, the REST catalog should be able 
to return an expression that defines the rows that should be visible to the 
querying entity.
   **Column Mask Expression:** For each column, the REST catalog should return 
an expression that defines how the column's data should be masked before it is 
made available to the query engine.
   Benefits:
   
   **Consistency Across Engines:** By centralizing the row filtering and column 
masking logic in the catalog, all supported query engines (Trino, Spark, etc.) 
will handle data access uniformly, reducing the risk of inconsistencies.
   ### Security: This feature enhances data security by ensuring that sensitive 
data is filtered or masked before being accessed by different query engines.
   Simplified Data Governance: It simplifies the enforcement of data governance 
policies by allowing them to be defined once in the catalog and applied 
consistently across all query engines.
   ### Conclusion:
   Implementing this feature would greatly improve the integration of Iceberg 
with various query engines by providing a standardized way to enforce data 
access policies. We believe this would be a valuable addition to the Iceberg 
ecosystem and would help drive broader adoption of Iceberg as a unified data 
platform.
   
   ### Query engine
   
   None
   
   ### Willingness to contribute
   
   - [ ] I can contribute this improvement/feature independently
   - [X] I would be willing to contribute this improvement/feature with 
guidance from the Iceberg community
   - [ ] I cannot contribute this improvement/feature at this time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to