@sherlockbeard let the cat out of the bag! 😛 https://www.linkedin.com/posts/deltalake_high-performance-querying-on-massive-delta-a[…]?utm_source=combined_share_message&utm_medium=member_desktop Here’s a blogpost we’ve been working on with some of the folks at Delta Lake for Daft’s

daft.read_delta_lake

support. Really excited that we now have support for Iceberg, Delta Lake and Hudi!

@jay Out of curiosity, any reason to not add pyspark numbers in delta benchmarking.

Oh haha we weren’t able to run it on EMR/Athena 😓 We’re planning on a follow-up blogpost soon where we can share more results on a larger dataset. And after we’ve figured out why EMR Spark can’t read our S3 data…