> For the complete documentation index, see [llms.txt](https://docs.cloudfabrix.io/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.cloudfabrix.io/rda/rda-userguide/rda-data-management-cfxdm/cfxdm-dm-dedup.md).

# cfxdm - dm:dedup

**dm:dedup:** This cfxdm tag allows the user to remove the duplicate values from the queried data for a selected column or columns.

It can be used to find the unique values from a selected column or unique values from a more than one selected columns by looking at them as a combined value.

**dm:dedup** syntax**:** 

* **columns (**optional**)**. Specify a column or columns (comma separated) on which de-duplication of the data to be applied.

In the below example, for a reference, we are going to use **VMware vROps** as an extension to query the data and ingest it into **dm:dedup** to remove any duplicate values from a selected column or columns.

Enter the below command to select **VMware vROps Datastore Summary tag (\*vrops:datastore\_summary**). (In this example, vrops name is used as a label to identify VMware vROps extension and it's tags. The label is defined while adding the extension in cfxdx configuration file or through UI)

```
tag *vrops:datastore_summary
```

![](/files/-MVdqUxBzyGEMfB4Lc_y)

**Example 1:** Remove duplicate datastore names from a selected column

Get the data from VMware vROps Datastore Summary tag (**\*vrops:datastore\_summary**) and remove duplicate datastore names from a selected column '**name**'

```
data --> dm:dedup columns = 'name'
```

![](/files/-MVhw_SLT9mboBdnAClp)

**Example 2:** Find the unique values in the combination of two selected columns (**name** & **parent\_datacenter**)

When more than one column is selected, **dm:dedup** looks at the values of the selected columns as a single data string and find unique values.

Get the data from VMware vROps Datastore Summary tag (**\*vrops:datastore\_summary**) and find the unique values in the combination of two selected columns (**name** & **parent\_datacenter**)

```
data --> dm:dedup columns = 'name,parent_datacenter'
```

![](/files/-MVhz9tKCBwvnKDxBgXs)