Skip to content

[BUG] configure.arguments sending bad parameters to click functions #150

@odarotto

Description

@odarotto

When running the baseband-analysis pipeline, the tiedbeam step is failing due to the parameters being passed in a wrong format. This reformat happens in configure.arguments function.

defaults:
  event:
  - '194488374'
  site: canfar
  user: amdan
event_number: 194488374
event_str: '194488374'
name: amdan-baseband-processing
pipeline:
  steps:
  - name: stage-data
    stage: 1
    work:
      command:
      - datatrail
      - pull
      - chime.event.baseband.raw
      - '194488374'
      - -vvv
      - -f
      - -c
      - '4'
      pipeline: baseband-amdan-datatrail
      priority: 3
      tags:
      - lowDM
      - stage-data
      timeout: 7200
  - name: initialize
    stage: 2
    work:
      function: baseband_analysis.pipelines.cluster.cluster_cli.initialize
      parameters:
        event_number: 194488374
        site: canfar
      pipeline: baseband-amdan
      tags:
      - lowDM
      - initialize
      timeout: 600
  - matrix:
      job_id:
        range:
        - 1
        - 64
    name: singlebeam-tiedbeam
    stage: 9
    work:
      function: baseband_analysis.pipelines.cluster.cluster_cli.tiedbeam
      parameters:
        event_number: 194488374
        job_id: ${{ matrix.job_id }}
        parameters:
        - baseband_pipeline
        - singlebeam
        - job_size
        - '64'
        - files_per_group
        - '2'
        - get_parameters_from_h5
        - 'true'
        - ra
        - '29.503126'
        - dec
        - '65.716754'
        - dm
        - '348.76'
        site: canfar
      pipeline: baseband-amdan
      retries: 3
      tags:
      - lowDM
      - singlebeam
      - tiedbeam
      timeout: 1800
  - name: singlebeam-merge
    stage: 10
    work:
      function: baseband_analysis.pipelines.cluster.cluster_cli.merge
      parameters:
        event_number: 194488374
        parameters:
        - baseband_pipeline
        - singlebeam
        site: canfar
      pipeline: baseband-amdan
      tags:
      - lowDM
      - singlebeam
      - merge
      timeout: 1200
  - name: singlebeam-analysis
    stage: 11
    work:
      function: baseband_analysis.pipelines.cluster.cluster_cli.waterfall
      parameters:
        event_number: 194488374
        site: canfar
      pipeline: baseband-amdan
      tags:
      - lowDM
      - singlebeam
      - analysis
      - waterfall
      timeout: 1200
  - name: finalize
    stage: 12
    work:
      function: baseband_analysis.pipelines.cluster.cluster_cli.finalize
      parameters:
        event_number: 194488374
        site: canfar
      pipeline: baseband-amdan
      tags:
      - lowDM
      - finalize
      timeout: 1200
  - if: always
    name: unstage-data
    stage: 12
    work:
      command:
      - datatrail
      - clear
      - chime.event.baseband.raw
      - '194488374'
      - -vvv
      - -f
      pipeline: baseband-amdan-datatrail
      priority: 5
      tags:
      - lowDM
      - unstage-data
version: '2'

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions