JadavD opened a new issue, #14880: URL: https://github.com/apache/pinot/issues/14880
DateTimeFieldSpec validation in schema validate (#5706) Repository Version: Apache Pinot v0.10.0 Key Words / Search Terms: DateTimeFieldSpec, Schema Validation, Time Column, Table Configuration, Data Ingestion Description: There is currently no validation for the alignment of the time column name and type between the schema and the table configuration, leading to potential errors during data ingestion and querying. This issue proposes adding validation to prevent such mismatches. Expected Behavior: The system should ensure the time column name and type match between the schema and table configuration before processing. If mismatched, an error should be displayed. Current Behavior: No validation exists for time column consistency, potentially leading to errors. Steps to reproduce: 1. Create a schema with a DateTimeFieldSpec for the time column. 2. Create a table configuration with a mismatched time column name or type. 3. No validation occurs when adding or updating the configuration. Use cases: Inconsistent schema and table configurations can cause data processing errors, particularly in real-time analytics where data integrity is crucial. This feature would prevent such issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
