S

Monday, January 8th, 2024 10:57 AM

Run bulk numbers of rows in less time in CDQ

Hi All,

I am trying to run a dq job which has around 30,00,00,000+ rows and around 200+ columns. I did run the dataset with this data and it took me almost 4hrs to execute. Is there any option which Collibra DQ provides by which i can run these rows in batch wise (100000) per run with all 200+columns in a single go. I tried limit the rows option but i am not sure if it run the profiling on new rows for each run.

No Responses!
Loading...