Data Steward
Role overview
Your mission: You manage and prepare data within your domain. Your goal is to ensure that data is structured, integrated, and ready to be made available.
Why your role is vital: You are the "Operator". You take structured and integrated data and turn it into usable DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.. Without your work, data remains inaccessible or not ready for use.
Defining your scope: You primarily work on DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. and their configuration. You also work with Datapools, Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform., Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network., Pipelines, and APIs within your domain to prepare data for review and release.
Your core responsibilities
- Manage domain-specific DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.: Create, configure, and maintain DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. and organize them in Datapools where appropriate.
- Apply standards and guidelines: You use and apply Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform. and standards defined by the Data Architect.
- Create and manage data-related elements: You can create and manage Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform. and Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network. as part of your work.
- Ensure data readiness and manage the data lifecycle: You move DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. through Draft and Ready and prepare them for release.
Outside your scope
It is not your responsibility to define global standards or manage platform-wide data architecture.
If you are responsible for defining cross-domain standards and reusable patterns, the Data Architect role is likely the right role for you.
If you are responsible for approving and releasing DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions., the Data Owner role is likely the right role for you.
To work effectively with data-related elements, you need the correct permissions.
The access logic: Access is always the result of a User being assigned to a Group, and that Group being assigned a Role at a specific Scope.
Scopes: Roles can apply at Platform level, on a Datapool, or on specific data-related elements such as DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions., Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network., and Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform..
You usually receive a Data Role for selected DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions., Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network., or Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform. via the Access Management tab. You can also update access on these elements by assigning or removing Groups and Roles. Many Data Stewards receive access through Datapool inheritance rather than direct DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. assignments.
When changing assignments, make sure not to remove your own access.
If you remove the Group or Role that gives you access to a data-related element, you may lose access to it.
If you cannot create Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform., Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network., or DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions., your Group likely does not have a Data Role with create Permissions at Platform scope. Contact your TenantTenantAn isolated organizational partition that owns Data pools, Datasets, Users, Groups, and Roles. All access rules exist within their Tenant, and the Tenant is the widest Scope of a Role. Currently, one Tenant corresponds to the Platform. Admin to request the required access.
→ Deep Dive Authorisation
Typical tasks
Your work in CIVITAS/CORE focuses on managing data within your domain:
- Create and maintain DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.: Add metadata and configure DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.
- Create or adjust Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform.: Define or adapt structures based on existing standards
- Register Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network.: Connect and configure data relevant to your domain.
- Design pipelines: Model how data is ingested, transformed, and prepared for use
- Prepare DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. for further use: Ensure DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. are complete and ready for review by Data Owners
Your first steps
To start working as a Data Steward in CIVITAS/CORE:
- Ensure you have access to a DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. or Datapool
- Complete the DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. configuration
- Assign the DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. to a Datapool (if applicable)
- Edit or reuse Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform. and Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network.
- Build Pipelines and configure APIs
- Set the DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. status to Ready
Best practices & avoiding mistakes
- Follow defined standards: Create and adapt Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform. only within established guidelines
- Work within your domain: Focus on the data-related elements you are responsible for
- Do not define global standards: Leave cross-domain standards and reusable patterns to Data Architects
- Keep pipelines clear and maintainable: Avoid overly complex pipeline logic. Keep transformations understandable
- Reuse existing Data structuresData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform. and Data sourcesData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network. before creating new ones
- Keep DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. consistent: Ensure metadata, structure, and pipelines are complete and aligned
- Use Datapools whenever possible: Manage related DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. together and benefit from inherited permissions
Your permissions
| Permissions / Data-related elements | READ | CREATE | UPDATE | DELETE | RELEASE |
|---|---|---|---|---|---|
| DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. | 🟠 | 🟠 | 🟠 | 🟠 | |
| ↳ Payload | 🟠 | 🟠 | 🟠 | 🟠 | |
| Data sourceData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network. | 🟠 | 🟠 | 🟠 | 🟠 | |
| Data structureData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform. | 🟠 | 🟠 | 🟠 | 🟠 | |
| Datapool | 🟠 | 🟠 |
Key terms to know
To work effectively as a Data Steward, review these terms in our Glossary:
- Data structureData structureA versioned data-related element that defines the schema and organization of data. It specifies how data is structured and interpreted within the Platform.: Defines the schema and structure of data.
- Data sourceData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network.: Represents the origin of data.
- DatasetDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions.: A structured collection of data prepared for use.
- Pipeline: Defines how data is loaded, transformed, and stored.
- Datapool: Organizes related DatasetsDatasetA data-related element that contains processed data and makes it available for consumption. A Dataset is populated via Pipelines and carries Metadata and access permissions. and provides an additional scope for access management and Data sourceData sourceA data-related element that represents the origin of data. It defines how data is connected, accessed, and ingested into the Platform, such as an external database or sensor network. availability.
- Data Role: A Role that grants access to data-related elements.
- Scope: Defines where a Role applies, either on Platform level or on a specific data-related element.
- Status: Defines the lifecycle stage of a data-related element (Draft, Ready, Available).