A startup script is a file that performs tasks during the startup process of a virtual machine (VM) instance. We are going to configure our DQ instance to be able to start Collibra DQ (Postgre, Spark, OwlAgent OwlWebapp) automatically when the instance is started. For more information about how this

Hi All - curious to see if anyone has encountered reference data checks and how collibra DQ handles it. 1. Table A (has values), Table B (has codes and values). Want to be able to validate/cross check the values in Table A against values in Table B to identify records with no match. Tables could be

In this post we are going to review the DQ connector configuration step by step. Prerequisites Edge Create an Edge site via Collibra Data Intelligence Cloud Settings. Install the Edge site close to the data source you want to access. Collibra Data Quality Install Collibra Data Quality. Con

I am not able to find the download link for Linux standalone installation. I need to play with my Linux machine with DQ on my interest, can anyone help me with the download link " Download full package tarball using the signed link to the full package tarball provided by the DQ Team. Replace <sig

Microsoft Azure allows us to create images. These images contain the configuration for creating instances. A managed image resource can be created from a generalized virtual machine (VM) that is stored as either a managed disk or an unmanaged disk in a storage account. You can launch multiple VMs fr

In order to restart an agent in a Kubernetes deployment, please review the guidance below: Open Google Cloud Console Navigate to Kubernetes Engine Select Workloads Tab Identify your correct namespace e.g. Collibra DQ Dev / Test / Prod Identify your workload name e.g. collibradq-agent-dev which corr

GCP allows us to create Images. These images contain the configuration for creating instances. You can launch multiple instances from a single image when you need multiple instances with the same configuration. This post explains how to configure Collibra DQ from a GCP image with DQ installed. Click

Rules / General: Popular Questions Q: Can You Select Rules Altogether And Apply To Dataset? A: Yes, Select One By One For Now; Currently We Are Doing Custom But Productizing That Feature Is In Our Backlog Q: Is there a library of OOTB rules? A: Yes, please refer to the Rule Library Q: Can You Weight

Profiling Q: Does Collibra DQ help identify PII / sensitive data? A: Yes, users can run customized PII discovery using OOTB RegEx or bring your own RegEx. A: https://dq-docs.collibra.com/dq-visuals/data-concepts-and-semantics will be included in 2021.11 Collibra DQ release Agent Q: How exactly does

AWS allows us to create AMI (Amazon Machine Images). This AMI contains the configuration for creating an instance. You can launch multiple instances from a single AMI when you need multiple instances with the same configuration. This document explains how to configure Collibra DQ installed in an AMI

Has anyone users connected Collibra DQ to an in-house exception tracking tool? I would be interested to hear how successful it was and any lessons learned.

A prospective client asked a fine question regarding “auditing the change of the custom rules.” After some research and testing this, indeed we do have auditing of rule changes at this level of granularity: Audit columns: dataset = Any rule is associated with a Dataset. So this is the name of the

Below are some helpful resources to get you started with the Collibra DQ Integration released in the 2021.07 release of Collibra Data Intelligence Cloud Top Links Collibra Native DQ Connector Complete Documentation, FAQ, Troubleshooting Guide: [Click Here] Collibra Native DQ Connector Supplemental D

Alerts only trigger off of the finished DQ score from a run, correct? I’m looking for a solution for when a job take longer than X hours.

When setting the row limiter on the profiling setup screen. Is this simply the first 1000 sequential rows to be pulled back from the select? is there an option to make this a random subset or even systematic? Secondly what does the escape character represent in this section?

Is there a place online where customers can look at our DQ API’s to get a grasp of our functionality and how they might integrate with their solution? I see JSON REST and CLI APi’s within the demo environment but of course I cant share this. Thanks

Hi Community, Sharing my experience below in trying to stand up the AMI instance in the Collibra AWS environment in case helpful for others. https://owl-analytics.gitbook.io/user-guide/-La5sAxci8GhitOM0qCp/learning-the-ropes-of-owldq-ami I was told that the AMI must be updated with a new SPRING_DAT

Python and Py4J code: owl.owlCheck() fails with an exception: File “/opt/spark/python/lib/py4j-0.10.9-src.zip/py4j/java_gateway.py”, line 1305, in call File “/opt/spark/python/lib/pyspark.zip/pyspark/sql/utils.py”, line 128, in deco File “/opt/spark/python/lib/py4j-0.10.9-src.zip/py4j/protocol.py”,

Hi, I’m looking at the AR rules and how they change over time to show the value of not having to go back and adjust manual rules over time. I noticed that the “Condition” which describes what the rule (198.7 - 3599) (See attached image) does not match the latest “learning” values 0-4586. My questio

Question: When we run DQ job against the temp file and i can’t see “estimate job” button. that is valid scenario ? Answer : yes. Thats valid scenario Question: Are we doing any compute when upload the temp file ? Answer : No. We cannot do any kind of compute at any sort of scale in Web itself