cwl-inputs-parser
A library for parsing the inputs field of Common Workflow Language (CWL) document. This library aims to use it as a CWL parser to generate a web form to execute the Workflow Execution Service (WES).
As a simple example, if you input tests/all_input.cwl, tests/all_input.json will be output.
The schema of the parsed results is cwl-inputs-parser-schema.json.
We are testing using the CWL v1.2 conformance test. The list of test IDs that will not pass is tests/cwl_conformance_test/failed_test_ids.txt.
Installation
Requires Python 3.6+
To install from PyPI:
$ pip install cwl-inputs-parser
$ cwl-inputs-parser --help
To install from source:
$ git clone https://github.com/suecharo/cwl-inputs-parser.git
$ cd cwl-inputs-parser
$ pip install .
$ cwl-inputs-parser --help
To install with docker:
$ docker run -t --rm ghcr.io/suecharo/cwl-inputs-parser:latest cwl-inputs-parser --help
Usage
It is deployed at https://cwl-inputs-parser.azurewebsites.net
The easiest way to use:
$ curl -X POST https://cwl-inputs-parser.azurewebsites.net \
-d '{"wf_location": "https://raw.githubusercontent.com/suecharo/cwl-inputs-parser/main/tests/cwl_conformance_test/v1.2/wc-tool.cwl"}'
[{"array":false,"default":null,"doc":null,"id":"file1","label":null,"required":true,"secondaryFiles":null,"type":"File"}]
As command line tool
Use as a command line tool:
$ cwl-inputs-parser /path/to/cwl_document (local file path | remote URL)
As REST API server
Start the server:
$ cwl-inputs-parser --server --host 0.0.0.0 --port 8080
* Serving Flask app 'cwl_inputs_parser.server' (lazy loading)
* Environment: production
* Debug mode: off
* Running on http://172.26.0.2:8080/ (Press CTRL+C to quit)
Request with curl
:
$ curl -X get localhost:8080/health
{"status":"ok"}
# {"wf_location": "https://path/to/workflow"}
$ curl -X POST localhost:8080 -d @tests/curl_data_location.json
...
# {"wf_content": "serialized CWL contents..."}
$ curl -X POST localhost:8080 -d @tests/curl_data_content.json
...
$ curl -X POST \
localhost:8080 \
-d '{"wf_location": "https://raw.githubusercontent.com/suecharo/cwl-inputs-parser/main/tests/cwl_conformance_test/v1.2/wc-tool.cwl"}'
[{"array":false,"default":null,"doc":null,"id":"file1","label":null,"required":true,"secondaryFiles":null,"type":"File"}]
Do cwltool's --make-template
:
$ curl -X POST localhost:8080/make-template -d @tests/curl_data_location.json
"file1: # type \"File\"\n class: File\n path: a/file/path\n"
$ curl -X POST localhost:8080/make-template -d @tests/curl_data_content.json
"file1: # type \"File\"\n class: File\n path: a/file/path\n"
As python library
Use as a python library:
$ python3
Python 3.8.12 (default, Oct 13 2021, 13:56:21)
[GCC 7.5.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from cwl_inputs_parser.utils import wf_location_to_inputs
>>> inputs = wf_location_to_inputs("./tests/cwl_conformance_test/v1.2/wc-tool.cwl")
>>> inputs.as_dict()
[{'default': None, 'doc': None, 'id': 'file1', 'label': None, 'type': 'File', 'array': False, 'required': True, 'secondaryFiles': None}]
Development
development environment:
docker-compose -f docker-compose.dev.yml up -d --build
docker-compose -f docker-compose.dev.yml exec app bash
testing:
pytest .
License
Apache-2.0. See the LICENSE.