I am a little confused: 1. what is the mean of the...
# daft-dev
c
I am a little confused: 1. what is the mean of the highlight code for? int and int will get the latter int? 2. should we generate only one GlobalLimit task? and it seems that we will generate a lot GlobalLimit? cannot understand. could you help me? @jay @Kevin Wang
j
Each task is per-partition! The code you highlighted is where we calculate the per-partition limit. It’s done by either: 1. None in the case where we don’t have a global remaining number of rows 2. Taking the minimum of the size of the partition and the global remaining number of rows