# cfxdm - dm:dedup

**dm:dedup:** This cfxdm tag allows the user to remove the duplicate values from the queried data for a selected column or columns.

It can be used to find the unique values from a selected column or unique values from a more than one selected columns by looking at them as a combined value.

**dm:dedup** syntax**:** 

* **columns (**optional**)**. Specify a column or columns (comma separated) on which de-duplication of the data to be applied.

In the below example, for a reference, we are going to use **VMware vROps** as an extension to query the data and ingest it into **dm:dedup** to remove any duplicate values from a selected column or columns.

Enter the below command to select **VMware vROps Datastore Summary tag (\*vrops:datastore\_summary**). (In this example, vrops name is used as a label to identify VMware vROps extension and it's tags. The label is defined while adding the extension in cfxdx configuration file or through UI)

```
tag *vrops:datastore_summary
```

![](/files/-MVdqUxBzyGEMfB4Lc_y)

**Example 1:** Remove duplicate datastore names from a selected column

Get the data from VMware vROps Datastore Summary tag (**\*vrops:datastore\_summary**) and remove duplicate datastore names from a selected column '**name**'

```
data --> dm:dedup columns = 'name'
```

![](/files/-MVhw_SLT9mboBdnAClp)

**Example 2:** Find the unique values in the combination of two selected columns (**name** & **parent\_datacenter**)

When more than one column is selected, **dm:dedup** looks at the values of the selected columns as a single data string and find unique values.

Get the data from VMware vROps Datastore Summary tag (**\*vrops:datastore\_summary**) and find the unique values in the combination of two selected columns (**name** & **parent\_datacenter**)

```
data --> dm:dedup columns = 'name,parent_datacenter'
```

![](/files/-MVhz9tKCBwvnKDxBgXs)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.cloudfabrix.io/rda/rda-userguide/rda-data-management-cfxdm/cfxdm-dm-dedup.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.