Hi there, is it possible to do embedding/similarity search in daft?

we do have a function for computing cosine on embedding types. You'll need to supply your own embeddings though. This is a good use case for UDF's

Is there plan to support ANN index like ivf_pq, hnsw or something like that?

we currently don't have indices on our roadmap, This seems like a usecase for a dedicated vector database such as LanceDB. They have great support for similarity search as well as the aforementioned indices. We support reading from their table format via

daft.read_lance

Thanks for the reply!