I am use daft to read SQL server tables and write ...
# generalp
Phil Chen
10/02/2024, 2:02 AMI am use daft to read SQL server tables and write to s3 bucket as parquet files. From time to time, I am seeing this error pops up:
ERROR tiberius:tdsstream:token The function 'PERCENTILE_DISC' must have an OVER clause. code=10753
I'm not using PERCENTILE_DISC function in my SQL query. Wondering if this is from SQL statement generated by the Daft?
c
Colin Ho
10/02/2024, 2:09 AMYes, daft executes a PERCENTILE_DISC query to determine the partition bounds
Colin Ho
10/02/2024, 2:09 AMIf it fails, daft will retry using MIN and MAX
p
Phil Chen
10/02/2024, 2:15 AMI see, if I understand correctly, I can ignore this error. By the way, according to the error, it complains about missing OVER clause. Is this an issue with the generated SQL statement?
c
Colin Ho
10/02/2024, 2:23 AMYes you can ignore it. And yes it’s an issue with the generated sql 😓
👍 1
2 Views