Yes we can eventually support Spark UDFs. We’ll want to have a little shim layer for our Python UDFs to call into the Spark UDF, but I think it shouldn’t be impossible to build out.
Definitely a lower priority though, since TPC-DS wouldn’t have Spark UDFs