at a point it probably makes sense to pair program...
# daft-deva
Andrew Gazelka
10/08/2024, 8:59 PMat a point it probably makes sense to pair program soon. (perhaps @Desmond Cheong )
trying to impl
https://github.com/Eventual-Inc/Daft/blob/b00d23c3e42ae506527341673847d27e52708fbe/src/daft-connect/src/command.rs#L9-L63
Andrew Gazelka
10/08/2024, 9:00 PM.
Andrew Gazelka
10/08/2024, 9:00 PMcould also be someone else
Andrew Gazelka
10/08/2024, 9:00 PMjust requires general daft knowledge probably
Andrew Gazelka
10/08/2024, 9:14 PMconnect.py
Andrew Gazelka
10/08/2024, 9:14 PMI heard we cannot do ranges in daft atm... how could I rewrite this to be a simple thing I can impl?
d
Desmond Cheong
10/08/2024, 9:18 PM Copy code
df = spark.range(5)
df.write.mode("overwrite").parquet("myparquet.parquet") Copy code
df.filter(col("id") > 2).withColumn("id2", col("id") + 2).show()a
Andrew Gazelka
10/08/2024, 9:58 PM@Desmond Cheong or @Colin Ho either of you willing to pair program? trying to impl somehing like this
Andrew Gazelka
10/08/2024, 10:00 PMim @Desmond Cheong @Colin Ho I am going to grab my shirt. I will be back
c
Colin Ho
10/08/2024, 10:08 PMhow did you get the image on the left?
a
Andrew Gazelka
10/08/2024, 10:08 PMimage on left is protobuf sent in @Colin Ho
Andrew Gazelka
10/08/2024, 10:08 PMprint("\nDataFrame content:")
df.show()
2 Views