Hi @Vincent Gromakowski !
With Daft v0.4, we will be making our new engine the default local engine. This engine is a “streaming execution” engine. It means that we execute batch-style workloads (joins etc) in a streaming way where possible.
However I’m guessing you’re asking more about workloads such as Flink? In that case we don’t yet have plans to support those workloads/APIs. Our new streaming execution engine might make it possible to start building towards it though.
There are many other projects trying to do streaming (e.g. Arroyo and risingwave) but from what we’ve seen the demand isn’t very high yet for these systems!