amogh-jahagirdar commented on PR #14838: URL: https://github.com/apache/iceberg/pull/14838#issuecomment-3650131583
>Generally I have seen req / response api's being consistent with the spec and the spec says clearly its deletes corresponding to the filescan task, so this case is not possible. I understand our intention was to optimize the pay load to reference the index in FS task. I think we should keep additional watch on other lang impl like python for this. Ultimately, this doesn't really matter since what we're talking about here is the library implementation not exposing ways for a client ways to produce invalid output. A client could do this today in the current implementation if I'm not mistaken and I'd say a good implementation would just avoid it by not exposing that mechanism to begin with. For the optimizing the payload part, that's an orthogonal concern from the library API. The API just exposes the minimal way to set things, which is the file scan tasks, and serialization/deserialization of tasks is an internal detail based on the file scan tasks in that response structure. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
