RDA - Terminology and Artifacts
Solution Packages: Solution packages are shareable bundles with data, pipelines, and configurations.
Pipelines: Pipelines are data operation workflows or Directed Acyclic Graphs(DAGs)
Bots: A bot deals with a particular task or a data function. There are three types of pre-fixes to a bot's name.
#: Bot is source filtered. It means the data queries and filters are applied while querying the data from datasource.
*: Bot is destination filtered. It means the data queries and filters are applied after retrieving the complete data from the datasource. It is not an efficient approach when dealing with a large amount of data, however, it can be used if the datasource does not support filtering capability while querying the data.
@: API Endpoint. This dataset is a wrapper for an API offered by a datasource.
Dataset: A dataset holds the data.
Configurations: A configuration stores information like credentials, which systems to connect, parameters, etc.
Plugins: A plugin defines which system to connect to and its credentials.