Marketplace workflow - Operating Model Diagnostic

Operating Model Diagnostic - Collibra Marketplace

It seems the marketplace workflow recently released (2022 July 1st) for the Operating Model Diagnostic uses some outdated code and crashes.

Use of the deprecated rest v1 API
Old “builders” usage that is not documented anymore

//Attach file to the Resource
def exportFileUrl = applicationApi.getInfo().getBaseUrl() + "rest/1.0/file/" + exportFileId.getId()
attachmentApi.addAttachment(builders.get("AddAttachmentRequest")
    						  .baseResourceId(item.id)
    						  .baseResourceType(item.getType())
    						  .file(new FileReference(exportFileName, fileApi.getFileAsStream(exportFileId.getId())))
    						  .build()
    						  )

The official development guide proposes this code: Add an attachment with a workflow - Collibra - Developer

Add an attachment with a workflow

import com.collibra.dgc.core.api.dto.instance.attachment.AddAttachmentRequest
import com.collibra.dgc.core.api.component.instance.AttachmentApi
import com.collibra.dgc.core.api.component.file.FileApi
import com.collibra.dgc.core.api.model.file.FileInfo

UUID fileUUID = string2Uuid(file)
FileInfo fileInfo = fileApi.getFileInfo(fileUUID)
String fileName = fileInfo.getName()

InputStream fileStream = fileApi.getFileAsStream(fileUUID)

AddAttachmentRequest attachmentRequest = AddAttachmentRequest.builder()
    .baseResourceId(item.getId())
    .baseResourceType(item.getType())
    .fileStream(fileStream)
    .fileName(fileName)
    .build()

attachmentApi.addAttachment(attachmentRequest)

Will there be a new release soon, or is it better to update the workflow by ourselves?

Responses

alvinuseree

157 Messages

2 years ago

Thanks for flagging this workflow exists, definitely something I’ll be looking into.

I’d also be keen to understand what the official line is in such situations - @kristen.freer any chance you could do some digging internally?

For info, I figured out the problem: The workflow needs to be deployed at resource level (community, domain or asset), it cannot be global.
It seems the workflow has been developed a long time ago and was recently released. It provides statistics on the operating model that are useful for review.
e.g. How many attribute types are not assigned, how many custom asset types, etc.

2 years ago

Community_Alex

640 Messages

•

1.6K Points

@alvin.useree I’m hoping that @santanu.paul.collibra.com might chime in here. FYI, @ann.wuyts.

2 years ago

alvinuseree

157 Messages

2 years ago

Cheers for the info - out of curiosity does the workflow outputs give you anything you wouldn’t be able to get from a CMA export or the OMRE?

arthurburkhardt

1.2K Messages

Correct. The OMD workflow computes statistics about your environment and gives some recommendations.
It would be useful to analyze it with a Collibra architect to get some feedback on those statistics.

Statistics

Number of all existing users
Number of all available asset types
Number of all out of the box asset types
Number of all custom asset types
Number of all Attribute Types
Number of all Relation Types
Number of all Complex Relation Types
Number of custom Attribute Types
Number of custom Relation Types
Number of custom Complex Relation Types
Number of Attribute Types assigned to at least one asset type or complex relation type
Number of Relation Types assigned to at least one asset type
Number of Complex Relation Types assigned to at least one asset type
Number of custom Attribute Types created but not assigned to asset type or complex relation type
Number of custom Relation Types created but not assigned to asset types
Number of custom Complex Relation Types created but not assigned to asset types
Attribute Types which are in use but lack a description
Relation Types which are in use but lack a description
Complex Relation Types which are in use but lack a description
Relation Types with the same combination Source+Role+CoRole+Target
Relation types which are assigned to the target asset type but not to the source
Relation types which are assigned to the target asset type but not to the source
Relation types which are assigned to the source asset type but not to the target
Relation types which are assigned to the source asset type but not to the target
Number of all Domain Types
Number of all custom Domain Types
Custom Domain Types with names reserved for the OOTB Domain Types
Number of Domain Types with at least one domain created
Number of used Domain Types without a description
Number of unused custom Domain Types
Number of all Scopes
Scopes without domains or communities assigned
Scopes which are not assigned to any asset type
Domains which are included in more than one scope
Number of all Scopes without a description
Number of all Communities
Number of all Domains
Number of all Communities with configured view permissions
Number of all Domains with configured view permissions
Number of Communities without a description
Number of Domains without a description
Number of Domains with hyperlinking enabled
Number of empty Communities
Number of root Communities without a Community Manager
Number of Sub-Communities without an Owner
Number of Domains without Stewards
Number of JobServer Connections
Number of Scheduled JobServer Connections
Number of all Global Roles
Number of custom Global Roles
Custom Global Roles which use names reserved for the OOTB Global Roles
Number of Global Roles which have at least one user assigned
Number of unused custom Global Roles
Number of Global Roles without a description
Number of all Resource Roles
Number of custom Resource Roles
Custom Resource Roles which use names reserved for the OOTB Resource Roles
Number of Resource Roles which have at least one responsibility assignment for users
Number of custom Resource Roles which don’t have any responsibility assignments for users
Number of Resource Roles without a description
Number of all User Groups
Number of User Groups without users added
Number of User Groups not assigned to any resource
Number of all enabled Workflows
Number of all existing Workflows
Number of all global Workflows
Number of all global enabled Workflows
Number of all Workflows applied to assets
Number of all enabled Workflows applied to assets
Number of all Workflows applied to domains
Number of all enabled Workflows applied to domains
Number of all Workflows applied to communities
Number of all enabled Workflows applied to communities
Number of all Workflows without a description
Number of all enabled Workflows without a description
Number of all Workflows which can be started by any guest user
Number of all enabled Workflows which can be started by any guest user
Number of all Workflows which can be started by any signed-in user
Number of all enabled Workflows which can be started by any signed-in user
Number of all Workflows which are Event based
Number of all enabled Workflows which are Event based
Number of all Workflows which are Timer based
Number of all enabled Workflows which are Timer based
Number of all Asset Types with ratings enabled
Number of all Tags
Number of all Statuses
Number of all custom Statuses
Number of all custom unused Statuses
Custom Statuses which use names reserved for the OOTB Statuses
Number of all Comments
Number of Assets with Comments
Number of all Attachments
Number of Assets with Attachments
Number of all Validation Rules
Number of all Data Quality Rules
Number of users assigned per role
Number of all created Business Assets
Number of all created Data Assets
Number of all created Technology Assets
Number of all created Governance Assets
Number of all created Issue Assets
Number of all created assets
System asset types which have at least one asset created
System asset types without a description which have at least one asset created
Custom asset types which don’t have any assets created
Custom asset types which have at least one asset created
Custom asset types without a description which have at least one asset created
Custom Asset Types which use names reserved for the OOTB Asset Types
Root-level Asset Types
Number of empty Domains
Number of Domains with more than 50,000 assets inside
Users who have assigned responsibility on object but don’t have view permission on it
Users who have assigned responsibility on object but don’t have view permission on it
Number of all Deactivated users
Number of all Activated users
Number of all Disabled users
Number of all Enabled users
Number of all Author users
Number of all Consumer users
Number of users with Required [?] License ‘Author’
Number of users with Required [?] License ‘Consumer’

2 years ago

santanupaule93449

1 Message

2 years ago

Thank you @arthur.burkhardt, @alvin.useree for using this workflow and highlighting this. We would like to hear more on what kind of other info/stat to be include in the report would be useful for the community to align the operating model as per best practice. @arthur.burkhardt as you mentioned it has to be resource workflow. It’s also mentioned in the user guide. We’ve included this in the backlog for next release. @alvin.useree you can execute this as resource workflow and get the statistics and advice. I would suggest to go through the user guide once before using the workflow. Thanks @kristen.freer, @ann.wuyts for including in the discussion.

arthurburkhardt

1.2K Messages

Thanks @santanu.paul.collibra.com!
Overall, the quantity of metrics is already excellent.
On top of my head, some additional usage metrics might be interesting such as Unused workflows (not instantiated in the last X months).
I’ll try to think of additional inconsistencies that can be measured from the metamodel.

2 years ago

scottbenson

77 Messages

•

250 Points

8 months ago

@kristen.freer and @santanu.paul.collibra.com Has there been any progress on this? I liked the tool when I last used it- I was disappointed to find out that it doesn’t work anymore. ( I’ve been away from Collibra for the past year). When I load the WF as Global, I am able to execute it, but it fails. When I load it as a Resource, I am unable to execute it.

It was very useful - I miss it!

Thanks

paulmcgrath

1 Message

5 months ago

Has anyone been able to use workflow Operating Model Diagnostic recently? Was able to last year, but now get error Cannot invoke method getId() on null object'. Collibra Support says they do not support this workflow and sent me to Data Citizen hoping someone else figured it out. HELP!

Community

arthurburkhardt

Marketplace workflow - Operating Model Diagnostic

alvinuseree

arthurburkhardt

Community_Alex

alvinuseree

arthurburkhardt

santanupaule93449

arthurburkhardt

scottbenson

paulmcgrath

Related Tags

Related Conversations

Was this helpful?