Community for the Daft project and all things distributed data

Distributed Data Community

Hey <@U042126MG49> <@U071FMQUR7W>, when you guys get the chance, could you please give this a review? Maybe even try giving it a run. I have an example usage up there.

<https://github.com/Eventual-Inc/Daft/pull/3619>

<@U06N1KAUCUV> Tagging you in this as well since you may like to try this out.

Cory gave me some valuable feedback on how he'd interact with the tool. Would like to get yours as well.

Please try checking out the branch `tpcds-wrapper`, and running the tpch and tpcds benchmarking launchers.

*Usage:*

For tpch:
`uv run tools/tpch.py --scale-factor=2 --num-partitions=2 --questions='1-10'`

For tpcds:
`uv run tools/tpcds.py --scale-factor=100 --questions='1-10'`