Am I understand correctly, that you proposing to collect all dataset in memory (from my side) and do intersection there? But isn't it almost the same? Anyway I will required to pull up huge amount of data