CDISC Library data pipeline
This Work Instruction describes the steps for deploying CDISC standards metadata to CDISC Library using data pipelines.
This Work Instruction covers content deployment to CDISC Library's dev and qa environments.
Indicates if any pre-requisite(s) prior to carrying out this Work Instruction. Put "Not applicable." if this section is not applicable.
List terms (abbreviations, acronyms, technical jargon) referenced in this Work Instruction useful at adding clarity. Put "Not applicable." if this section is not applicable.
Term | Definition |
---|---|
OAS3 | Open API Specification Version 3. https://www.openapis.org/ |
Lists all roles and their responsibilities relevant to this Work Instruction.
Role | Responsibilities |
---|---|
CDISC Library API Architect | Design and maintain API specification. |
CDISC Library Software Developer | Create programming code to Implement software. |
Describe each step to be taken to complete the scope of this Work Instruction in the prescribed sequence. Use active verb in the Instructions column.
Step # | Role | Instructions | Notes |
---|---|---|---|
1.0 | CDISC Library API Architect | Design API specification in OAS3 format in team workspace hosted by Swaggerhub. | |
1.1 | CDISC Library API Architect | Inform CDISC Library Software Developer when API specification is ready for implementation. | |
2.0 | CDISC Library Software Developer | Implement API endpoints based on the API specification. | |
2.1 | CDISC Library Software Developer | Make update suggestions where applicable. | |
3.0 | CDISC Library Software Developer | Deploy software code to the development environment. | |
1.0 | Standards Development Project Manager | Informs Metadata Analyst a CDISC standard is ready for loading into CDISC Library. | |
2.0 | Metadata Analyst | Inspects standard's high-level metadata, where applicable. | SDTMIG's Content Control wiki is an example. |
2.1 | Metadata Analyst | Documents unique characteristics and specifics about this CDISC standard to a DevOps wiki. | A DevOps wiki includes, but not limited to source metadata location, changes to predecessor, exception handling, etc. |
3.0 | Metadata Analyst | Informs CDISC Library Software Developer to execute the data pipeline. | |
3.1 | Metadata Analyst | Informs Data Science Leadership a new data pipeline is required for novel CDISC contents. | |
4.0 | CDISC Library Software Developer | Collects run parameters from Metadata Analyst or DevOps wiki that are required to execute the data pipeline. | |
5.0 | CDISC Library Software Developer | Inspects program log. | |
5.1 | CDISC Library Software Developer | Communicates errors and warnings in program log with Metadata Analyst. | |
5.2 | Metadata Analyst | Determines action plan with the Standards Development Project Manager. | Repeats from 1.0 until all relevant issues are remediated and/or documented. |
6.0 | Metadata Analyst | Informs CDISC Library Software Developer metadata is ready to be loaded into the CDISC Library's dev environment. | |
7.0 | CDISC Library Software Developer | Uploads metadata content to the project repository in DevOps. | |
7.1 | Metadata Analyst | Performs metadata review using tools include, but not limited to Data Standards Browser and Diff report. | |
7.2 | Metadata Analyst | Communicates review observations with CDISC Library Software Developer. | |
7.3 | CDISC Library Software Developer | Adjusts data pipeline programming code and re-runs data pipeline. | Repeats from 7.0 until all relevant issues are remediated and/or documented. For changes outside of data pipeline, refer to Software Development Work Instruction. |
8.0 | Metadata Analyst | Informs CDISC Library Software Developer metadata is ready to be loaded into the CDISC Library's qa environment. | |
8.1 | CDISC Library Software Developer | Promotes metadata content to the qa environment. |
Include a general workflow diagram that summarizes this Work Instruction.
Diagram to be inserted.
List references pertinent to this Work Instruction, e.g., COP-001.