Data Steward
Role overview
Your mission: You manage and prepare data within your domain. Your goal is to ensure that data is structured, integrated, and ready to be made available.
Why your role is vital: You are the "Operator". You take structured and integrated data and turn it into usable DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.. Without your work, data remains inaccessible or not ready for use.
Defining your scope: You primarily work on DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. and their configuration. You also work with Data poolsData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices)., Data structures, Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network., Pipelines, and APIs within your domain to prepare data for review and release.
Your core responsibilities
- Manage domain-specific DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.: Create, configure, and maintain DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. and organize them in Data poolsData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices). where appropriate.
- Apply standards and guidelines: You use and apply Data structures and standards defined by the Data Architect.
- Create and manage data-related elements: You can create and manage Data structures and Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network. as part of your work.
- Ensure data readiness and manage the data lifecycle: You move DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. through Draft and Ready and prepare them for release.
Outside your scope
It is not your responsibility to define global standards or manage platform-wide data architecture.
If you are responsible for defining cross-domain standards and reusable patterns, the Data Architect role is likely the right role for you.
If you are responsible for approving and releasing DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions., the Data Owner role is likely the right role for you.
To work effectively with data-related elements, you need the correct permissions.
The access logic: Access is always the result of a User being assigned to a Group, and that Group being assigned a Role at a specific Scope.
Scopes: Roles can apply at Platform level, on a Data poolData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices)., or on specific data-related elements such as DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions., Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network., and Data structures.
You usually receive a Data Role for selected DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions., Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network., or Data structures via the Access Management tab. You can also update access on these elements by assigning or removing Groups and Roles. Many Data Stewards receive access through Data poolData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices). inheritance rather than direct DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. assignments.
When changing assignments, make sure not to remove your own access.
If you remove the Group or Role that gives you access to a data-related element, you may lose access to it.
If you cannot create Data structures, Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network., or DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions., your Group likely does not have a Data Role with create Permissions at Platform scope. Contact your TenantTenantAn isolated organizational partition that owns Data pools, Datasets, Users, Groups, and Roles. All access rules exist within their Tenant, and the Tenant is the widest Scope of a Role. Currently, one Tenant corresponds to the Platform. Admin to request the required access.
→ Deep Dive Authorisation
Typical tasks
Your work in CIVITAS/CORE focuses on managing data within your domain:
- Create and maintain DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.: Add metadata and configure DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.
- Create or adjust Data structures: Define or adapt structures based on existing standards
- Register Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network.: Connect and configure data relevant to your domain.
- Design pipelines: Model how data is ingested, transformed, and prepared for use
- Prepare DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. for further use: Ensure DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. are complete and ready for review by Data Owners
Your first steps
To start working as a Data Steward in CIVITAS/CORE:
- Ensure you have access to a DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. or Data poolData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices).
- Complete the DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. configuration
- Assign the DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. to a Data poolData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices). (if applicable)
- Edit or reuse Data structures and Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network.
- Build Pipelines and configure APIs
- Set the DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. status to Ready
Best practices & avoiding mistakes
- Follow defined standards: Create and adapt Data structures only within established guidelines
- Work within your domain: Focus on the data-related elements you are responsible for
- Do not define global standards: Leave cross-domain standards and reusable patterns to Data Architects
- Keep pipelines clear and maintainable: Avoid overly complex pipeline logic. Keep transformations understandable
- Reuse existing Data structures and Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network. before creating new ones
- Keep DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. consistent: Ensure metadata, structure, and pipelines are complete and aligned
- Use Data poolsData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices). whenever possible: Manage related DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. together and benefit from inherited permissions
Your permissions
| Permissions / Data-related elements | READ | CREATE | UPDATE | DELETE | RELEASE |
|---|---|---|---|---|---|
| DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. | 🟠 | 🟠 | 🟠 | 🟠 | |
| ↳ Payload | 🟠 | 🟠 | 🟠 | 🟠 | |
| Data sourceData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network. | 🟠 | 🟠 | 🟠 | 🟠 | |
| Data structure | 🟠 | 🟠 | 🟠 | 🟠 | |
| Data poolData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices). | 🟠 | 🟠 |
Key terms to know
To work effectively as a Data Steward, review these terms in our Glossary:
- Data structure: Defines the schema and structure of data.
- Data sourceData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network.: Represents the origin of data.
- DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.: A structured collection of data prepared for use.
- Pipeline: Defines how data is loaded, transformed, and stored.
- Data poolData poolA governed, centralized collection of Datasets that are managed together within the Platform. It provides a shared place to organize, discover, and access data, including associated metadata, ownership, and access permissions. With Data pools users can cluster their Datasets according to their organizational structure (e.g., by Departments, Offices).: Organizes related DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. and provides an additional scope for access management and Data sourceData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network. availability.
- Data Role: A Role that grants access to data-related elements.
- Scope: Defines where a Role applies, either on Platform level or on a specific data-related element.
- Status: Defines the lifecycle stage of a data-related element (Draft, Ready, Available).