fresh-borzoni opened a new pull request, #2956:
URL: https://github.com/apache/fluss/pull/2956

   ## Summary                                                                   
                                                                                
                                                                                
      
                                                                                
                                                                                
                                                                                
    
   Adds batch read for lake-enabled log tables. When a table has datalake 
enabled, reads combine lake storage (Paimon/Iceberg) with Fluss log tail. Lake 
and log are planned as separate Spark partition, lake tasks read from lake 
storage without Fluss connections, log tail tasks reuse the existing reader. 
Falls back to pure log reads when no snapshot exists. Only enabled in FULL 
startup mode. 
   
   Tests cover both Paimon and Iceberg.
                                                                                
                                                                                
                                                                                
        
     **Follow-up PRs**   
                                                                                
                                                                                
                                                                    
     - PK table lake reads (sort-merge with lake snapshot)                      
                                                                                
                                                                                
        
     - Streaming with lake bootstrap                                            
                                                                                
                                                                                
        
     - Filter/partition/limit push-down to lake source
     - DV support for Paimon


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to