littleDrew commented on issue #13438: URL: https://github.com/apache/iceberg/issues/13438#issuecomment-3086480558
> [@littleDrew](https://github.com/littleDrew): We are in the very early steps on the integration, and I see a **long road ahead** before it could work out of the box. > > We are working on the early steps to enable plugging in new File Formats into Iceberg ([#12298](https://github.com/apache/iceberg/pull/12298)). Lance is only one of the possible candidates, and the Iceberg community needs some more discussion on the next steps. > > I'm not sure what you mean by the 2nd way (use lance table format to integrate with Iceberg) - Hi @pvary, **can you explain in detail as for above` long road`**, what feature and work is needed in ahead. If you have detail design doc as for integrating Iceberg with lance file format, hope you can have a share and discuss together. - Another question, i am consider w**hat's kinds of benefit can we achive to integrate lceberg with lance file format**(may be the random access performance will not be good as in native lance), what's your idea as this question. - As for the 2nd way, here may refers **integrate with lance fragment**(treat this as one data file in iceberg), corresponding doc is provided by lance developer "jack ye", this may may can use fragment level metadata and index, and also use lance file level index(chunk index) esaliy, but here may have some effort, how do you like about this. https://docs.google.com/document/u/0/d/1AUAO2M_kmVvoCA2GYCBFvAcaM8zieU2fJmHVYuiew9o/edit?tab=t.0&pli=1&authuser=0#heading=h.3fnc1e5nn72y -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
