I would like to run some daily tests together but I am not sure how without running them individually. Due to the various times and jobs, even though it is daily, it cannot be on a schedule to run at a specific time. EDIT: … It appears not

Collibra Data Quality and Observability is now available with the Pushdown for Snowflake feature. This feature enables customers to “push” the data quality processing to their Snowflake environment, removing dependency on a separate Spark compute plane. This reduces costs by removing data egress

Hello Data Citizenes. I hope you have great day. We have placed an idea on Ideation Portal. If you find it useful, please upvote it. Hopefully, it will increase the priority and push it to further stage. Thank you. Ideation Platform – Collibra | Product Resource Center

Hello Data Citizens, Is there a quick way to remove some of OOTB rules from Rule Libraries. We are looking to remove US based customization(State, Postcode etc) from Collibra DQ. Your help would be appreciated.

Hello All, Can someone with experience help me on how to connect with the JDBC Athena connection, I keep getting a security token error, but all my configurations seem correct following the example in the documentation. https://dq-docs.collibra.com/connecting-to-dbs-in-owl-web/supported-drivers/conn

Hi, I’m trying to find out the way to import the Excel or CSV file into Collibra DQ for checking the Quality. Has anyone know on how to import the excel data into the Collibra DQ.

Hello Data Citizens, I hope you are well Can someone provide an update on the release plan of Databricks Pushdown for CollibraDQ. I have heard that it will be available as part of May release. Thank you. Cheers, Muhammad

Hello Data Citizen, I hope you are well We are building a Databricks notebook to run DQ Scan from data pipelin. However, The notebook is throwing following error randomly. annotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.owl.org.postgresql.util.PSQLException

With the increasing amount of data generated by organizations every day, ensuring data quality, reliability, and accessibility has become a major challenge. Businesses want rapid value generation through intuitive data products that they can trust. In this webinar, we will explore the latest advance

Hello DQ Experts, Can we use non-default database user for connectivity in Databricks environment. Additionally, What are the minimum permissions required for the metastore database users? Would be great, if anyone can share documentation for it. Thank you.

Hi Everyone I am facing an issue with AWS Clusters, our jobs scheduled on certain clusters fail. . The error message that I can see on the YARN timeline server shows that the job failed with exit code 13. We tried multiple troubleshooting steps to fix this but none has worked so far. Has anyone els

Hello CollibraDQ Folks, A quick clarification about difference in using Databricks Notebook or Spark-Submit for calling CollibraDQ JObs. Does Spark based CollibraDQ API internally use Spark-Submit or Databrick Cluster for data quality job execution? Is Collibra supporting production Spark-Submit jo

Hello Data Quality folks, I am facing some funny issue during opening of DQ notebooks available at Kirk repo at Github. The files are avallable in JSON format. However, once I do open the file in VCode or Databricks, it shows raw JSON code. Is there a way to convert it into actual notebook. Please s

Hello Fellow Data Citizens, I hope you are well! I have read that Spark-Submit is an available option to execute CollibraDQ jobs. However, It has some limitations. Can I please request more clarification/information. Thank you. Spark-Submit path is not supported in Production by Collibra support te

Hello Folks, We are planning to build an Enterprise Data Quality Framework which will automate the data quality rules scan on incoming data from different data sources like DataBricks, SQL Server, Oracle etc. Can I request to share some best practices or recommendations? Additionally, it would be gr

Hello Folks, I have seen a brief youtube video on integration between CollibraDQ and Databricks through Spark Notebook. Is it possible to get the sample code for further understanding. Additioally, it would be great, if someone can post the link of development documentation as well. Thank you so muc

Hi Guys, We have a use case where we need to schedule DQ jobs based only on the incremental loads on a table. For example, if 10 new rows have been added since the last DQ job, we only need to schedule/run the DQ job for those 10 rows. Is this use case possible via Collibra DQ?

For the first time, Collibra was recognized by Gartner in the Magic Quadrant for Data Quality Solutions. Access the 2022 Gartner Magic Quadrant for Data Quality Solutions report to discover: How the approach to data quality has been evolving How you can use the Gartner evaluation criteria to choose

Hi Everyone We have a use case where we need to run a native Snowflake query rule which is around 10K characters in length, while configuring the same we get an error. If we reduce the character length we are able to set up this rule. Is this a know limitation or am i doing something wrong.

Hi. We are in the process of implementing Collibra DQ for the first time (we are in Australia) and have had a number of issues trying to use Collibra DQ with our Databricks environment in AWS. The first few times we were not able to run DQ jobs at all on Databricks and after re-installing different