dmytrolugovyi's profile

Monday, February 22nd, 2021 1:38 PM

OMRE (Operating Model Reverse Engineering)

This topic is created to discuss the current version of the OMRE (https://marketplace.collibra.com/listings/operating-model-reverse-engineering-omre/) as well as the possible improvements that could make this solution better.

1.2K Messages

3 years ago

The OMRE workflow shows the characteristics of an assignment as complex relation “Assignment Characteristics” which works fine and shows all the characteristics (attributes, relations) for a certain assignment of a specific asset type.
It would be good to add one more attribute to the complex relation type “Assignment Characteristics”, e.g. “Sequence Number” and populate this attribute with the actual sequence number of the characteristic in the assignment. The order of attributes and relations for a certain asset is quite important and it would be good if we reflect this also in the result of the OMRE workflow. Then a user could see the characteristics of a certain asset type assignment in the same order as an admin user sees them in the settings.

43 Messages

Hi @klemens.mathauer, it make sense. I will try to update OM and workflow in the next release.
If you have any other ideas how OMRE can be improved please post them here :slight_smile:

2 Messages

Actually if we could use regular relations instead of complex ones it would make looking for things easier.

43 Messages

With assignments it’s not really possible since we have additional Cardinality attributes which also should be controlled. Basically, everywhere where it was possible the simple relations have been used. But I agree with you, in some use cases complex relations are not the best “thing” to use

16 Messages

3 years ago

In my opinion Collibra should make this functionality as core of their product and not just offer it towards Collibra Lab.
I appreciate this integration as it delivers valuable information (lacking from the core product) ,
but since R2021.01 release it broke multiple times.
At the time of writing I face the following error:
Caused by: com.collibra.dgc.core.exceptions.DGCException: Attribute Type has not been found
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

Can someone of Collibra Lab contact me in debugging this please?
We currently are on the latest version 1.1.2

Kind regards
Axel

43 Messages

Hi @axel.schots.telenetgroup.be, could you please create new support ticket and share your log-file there. I will try to help.

43 Messages

@axel.schots.telenetgroup.be did you manage to solve this issue or you still have this error? It seems that one of the attribute types required for OMRE doesn’t exist on your instance.

70 Messages

3 years ago

@tracy.williams - You may want to follow this thread and post your questions here about the OMRE workflow.

Thanks!

5 Messages

3 years ago

I also think the OMRE is terrifically useful. If it could be integrated into the base product it would be extremely beneficial for a lot of organisations.

3 years ago

Dear @lugovyi.dmytro ,
Thanks for opening this topic. We use OMRE in our company heavily. We have also expanded by adding several new columns. In the area of user management for example we use it to track inactive users (who left the company for example) so that we relocate assets they owner to a new owner. Our data governance council counts on it.

We noticed that OMRE is getting slower with each additional feature added. I agree with previous ideas to make it a core functionality of Collibra, have it fully supported and be able to run it faster than now.

Unfortunately it also has some known bugs like the maximum of 100.000 counted assets per type which would be hopefully fixed by integrating it into the product.
Thanks for taking this into considerations for the OMRE roadmap :wink:

Regs,
Vlado

43 Messages

I don’t add any new functionality at this moment, only fixing bugs.
Actually more content we add to Collibra more time required for OMRE execution. How long the extraction is currently takes for you?
Btw, 100.000 is not the but it’s the restriction I will remove in 1.1.3 quite soon. And if you know about other bugs please post them here.

2 Messages

3 years ago

We are considering within our team to use the OMRE asset model and a dedicated community to document the view of the OM that apply to our company specifically. We would use it to do meta-govern as well as to do some form of change control. E.g. changes to the OM are drafted in our community, approved and applied to the actual platform settings via Workflow+API. By comparing the OMRE output with our community, we could confirm successful deployment/implementation of the change. Maybe this is too far fetch for the original intent of OMRE.

43 Messages

This is great example of how OMRE can be used. Actually, it was one of the use cases for the OMRE creation.
You can also assign additional relation type to the OMRE assets to design Operating Model of you current/future use cases and then view them in traceability diagram.
I heard about this approach already (@klemens.mathauer).

Hello Dmytro, I just executed the OMRE workflow for the 1st time in our production instance, after installing the latest version found on the Marketplace. The results are mostly OK, except the appearance of a System Resource domain called “Issues” (domain type Issues Vocabulary Type) belonging to each single community. This domain is “hidden”, ie not visible in the Browser. I created a support ticket. Has any one in Data Citizens already encountered this?

7 Messages

3 years ago

We also think OMRE is very useful for us. This week we find the following error:
WARN o.f.e.i.b.b.ScriptTaskActivityBehavior - Exception while executing scripttask_omre : problem evaluating script: javax.script.ScriptException: java.util.NoSuchElementException: Cannot access first() element from an empty List
[jobExecutor-2] ERROR c.c.d.c.w.a.WorkflowExceptionHandler - Error starting workflow with id: scriptOperatingModelReverseEngineering
It took some time to find out which list was empty.
Cause was renaming a domain and creating a new domain with the old name.
Are these situations fixed in the new version?

Kind regards, Ingrid

43 Messages

Hi @ingrid.dapper Ingrid,
could you please describe the steps how to reproduce this error? As I understood:

  • run OMRE
  • rename existing domain
  • create a new domain with the old name
  • run OMRE
    is it correct?

7 Messages

Hi Dmytro,
yes that’s correct!

3 years ago

Hello, Collibra Support’s reply is that this normal, because “Issues” is a system domain. I have contacted the publisher to know if it can be avoided.

43 Messages

Hi @marie-aude.magarshack, Collibra Support provided the right answer. The thing is that “Issues” domain exists in every Community where users created Data Issues at least once.
Why we can’t ignore it, because other OM objects such as workflows can be related to them.
For the same reason we extract system asset types, to demonstrate all the aspects of the Operating Model.
Could you please explain, why it’s critical for you?

3 years ago

Hello @dmytro.lugovyi@collibra.com, thank you for replying. No data issues have been recorded in any community, we are not using this feature yet. image . It cannot be the right explanation.
It is not critical, but it is disturbing for our Collibra users. They are mostly unhappy with their initial user experience and adoption is still low. I hoped to have good news to share with them with the OMRE information. But this system domain is going to raise a lot of unnecessary questions.

43 Messages

3 years ago

Hi @marie-aude.magarshack, the screenshot you shared shows the out-of-the-box asset types. They can’t be removed. I was referencing Issue Domains which will be created automatically if you create a new data issue and assign it to one of the communities.
There are a lot of benefits from using OMRE, such as - it should help advanced users understand the Collibra Operating Model better or it will help you to control changes in the Operating Model and build governance processes on top. But for users who just started to use Collibra, I would recommend using another approach.
There is a quite new course at the Collibra University that may help you with some ideas on how to increase the adoption of the platform. How to find it - go to the Collibra University and search for the course "Supporting User Adoption of the Collibra Platform”. There are a few sections in this course and at the end of each session, you will find the links to the documents and templates you can download.

3 years ago

Hello Dmytro, I still do not understand your reply “Issue Domains which will be created automatically if you create a new data issue and assign it to one of the communities”. We have not created any data issue. Never mind.
Thank you for the heads-up about this new course, I will listen to it.
Best regards

1.2K Messages

It looks like the OMRE is just reporting on what exists in your instance. Those domains definitely exist, if you open one of the domains in the OMRE, at the bottom of the page you’ll see a link which will take you to the hidden domain.

Out of curiosity, if you’re exposing the outputs of the OMRE to your end-users, because all the OMRE does is create Assets that reflect your operating model, what’s stopping you from deleting the Issue Domain Assets?

Deleting those Issue Domain Assets should only take a few minutes.

Hello Alvin, thank you for jumping in. There are no Assets in this Issue Domain, ie there is nothing to delete.
Best regard

1.2K Messages

Sorry, I meant deleting the OMRE assets for the Issues Domains not the Issues domain itself or any asset in it.

The OMRE creates assets based on your operating model. As with any other asset in Collibra, you can update/ delete them.

To give you a bit of context, when we run the OMRE, we also get over 1000 hidden domains showing. We move all the issues domain assets to somewhere not viewable.

3 years ago

Hello Alvin, got your point, thank your for the guidelines! I am going to follow your tip and run the workflow again.

3 years ago

@lugovyi.dmytro, Hello Dmytro, I have another question regarding the OMRE workflow. I have executed it 2ce already, 2nd time with all the options that take more time: users, user groups, count of assets. I did not notice any degradation in the application performance and response time. Still, should we be careful here? Do you recommend to run the workflow out of usual business hours, in order not to impact the users?
Best regards

43 Messages

Hi @marie-aude.magarshack , creation or updating the assets with all characteristics takes a lot of time. So the first run when the workflow has to create thousands of objects and relations always takes a few hours. Every next time you will run OMRE the workflow will be creating only new objects and update those objects which have been updated since the last run. So if you extracted and counted all the OM objects including users once, you can try to run OMRE one more time and compare the time of the execution. It shouldn’t take more than an hour this time. You can run OMRE at any time, but if we talk about the production server I’d recommend doing this at non-business time, as a standard best-practice.

3 years ago

Hello @lugovyi.dmytro, thank you for the recommendation. Well noted.

3 years ago

Hi Dmytro,
I worked with Chris Brewer on the WF and he recommended you for the further questions. My WF is up and running but wanted to explore 2 things.

  1. when we do upgrade, we do validation from Pre and Post upgrade to ensure the metadata has been intact. what would the best way to validate them?
  2. Also, it was mentioned on User guide that we can run the Impact Analysis prior to any Change Management request. Would you mind helping me how we can facilitate it?

Thank you,
Ginger

43 Messages

Hi @gmillheim.deloitte.com, as the follow-up to our conversation and also to share some findings with other Data Citizens.

  1. OMRE is extremely powerful tool that can give you the ability to control all the changes in Operating Model. One of the use case scenarios is the upgrade of Collibra. How it could work? - You may execute OMRE before the upgrade and after it and see which objects have been changed or added in the new Collibra release.
  2. Having all the operating model objects in Collibra as assets you can easily use Collibra capabilities such as traceability diagram to easily identify potential impact from changes. How to do this? - Before making any changes to, let’s say, attribute type (for example, you would like to change the list of possible values), you can find it in OMRE and open the traceability diagram to see which asset types (+assignments) could be impacted. On top of it, you can design and develop your own workflow which will help you to automate the change management process before any changes will be applied to the existing operating model.
Loading...