cfxdm - dm:dedup

Remove duplicates from the data

dm:dedup: This cfxdm tag allows the user to remove the duplicate values from the queried data for a selected column or columns.

It can be used to find the unique values from a selected column or unique values from a more than one selected columns by looking at them as a combined value.

dm:dedup syntax:

  • columns (optional). Specify a column or columns (comma separated) on which de-duplication of the data to be applied.

In the below example, for a reference, we are going to use VMware vROps as an extension to query the data and ingest it into dm:dedup to remove any duplicate values from a selected column or columns.

Enter the below command to select VMware vROps Datastore Summary tag (*vrops:datastore_summary). (In this example, vrops name is used as a label to identify VMware vROps extension and it's tags. The label is defined while adding the extension in cfxdx configuration file or through UI)

tag *vrops:datastore_summary

Example 1: Remove duplicate datastore names from a selected column

Get the data from VMware vROps Datastore Summary tag (*vrops:datastore_summary) and remove duplicate datastore names from a selected column 'name'

data --> dm:dedup columns = 'name'

Example 2: Find the unique values in the combination of two selected columns (name & parent_datacenter)

When more than one column is selected, dm:dedup looks at the values of the selected columns as a single data string and find unique values.

Get the data from VMware vROps Datastore Summary tag (*vrops:datastore_summary) and find the unique values in the combination of two selected columns (name & parent_datacenter)

data --> dm:dedup columns = 'name,parent_datacenter'

Last updated