Does daft have an implementation for writing to s3Tables before I try to reinvent the wheel
k
Kevin Wang
12/10/2024, 7:21 PM
you mean the recently announced Iceberg-compatible S3 table right? We haven't tried Daft on it specifically yet, but Daft does support writing to Iceberg and S3 already. Maybe you can try it out and let us know if anything is missing!
j
Jake Waller
12/10/2024, 8:24 PM
I’ve been trying it out with PyIceberg and it doesn’t work natively out the box as the S3Tables are originally created via Datalake and aren’t shared in Glue by default (unless you set up resource link).
k
Kevin Wang
12/10/2024, 8:48 PM
Gotcha. Would you mind helping me by filing an issue on our Github repo with the feature request and your findings?