Hey team - any reason Daft doesn't emit a failure ...
# generalj
Jake Waller
10/15/2024, 11:39 AMHey team - any reason Daft doesn't emit a failure message when attempting to write a csv to a location that doens't exist?
j
jay
10/15/2024, 5:35 PMIt should give an error… What are you currently observing?
j
Jake Waller
10/15/2024, 6:47 PMIt was outputting the target location in stdout even if the target location didn’t exist
Jake Waller
10/15/2024, 6:48 PME.g if i write it in User/jake/documents/ it wouldn’t error but the location doesn’t exist - the correct one is
/User/jake/Documents/
(Not sure if it doesn’t error due to case sensitive)
j
jay
10/15/2024, 6:50 PMI’m guessing it will create the necessary folders and then write the CSVs — Would you expect different behavior?
jay
10/15/2024, 6:50 PMWe optimized the experience for S3 and cloud storage, which does differ from the experience with local filesystems a little bit because object stores don’t have the concept of folders
c
Colin Ho
10/15/2024, 9:22 PMI believe it is case insensitive, e.g. i just tried writing to "/Users/colinho/documents" and the write succeeds in "/Users/colinho/Documents"
j
Jake Waller
10/16/2024, 8:16 AMHmm - weirdly the behaviour didn’t work for me, nothing was written to the correctly cased location. I’ll double check again in a few hours.
Behaviour id expect is if the target write location doesn’t exist locally it would throw an error saying location doesn’t exist essentially, similiar to pandas
Jake Waller
10/16/2024, 9:07 AMMy Bad - looks like it is behaving as expected and was creating the folder without me realising
3 Views