Skip to content
Snippets Groups Projects

Flex_extract: Failed with following error - ECCODES ERROR : concept: no match for paramId=142

    • Closed Issue created by vi*****@n*****.s** via GitLab Support Bot @support-bot

    Dear all,

    I encountered the following error when downloading ERA5 data using flex_extract. The same script was working fine before. Are you familiar with this issue? Can you please help me resolve this issue? I am attaching the log file and CONTROL file. Thanks in advance for your help.

    ECCODES ERROR   :  concept: no match for paramId=142
ECCODES ERROR   :  concept: input handle edition=2, centre=ecmf
ECCODES ERROR   :  concept: input handle dataset=era
ECCODES ERROR   :  Please check the Parameter Database 'https://codes.ecmwf.int/grib/param-db/?id=142'
ECCODES ERROR   :  grib_set_values[0] edition (type=long) failed: Concept no match (message 961)
ECCODES ERROR   :  grib_set_values[1] productDefinitionTemplateNumber (type=long) failed: Value is read only (message 961)
outputfile = /lus/h2resw01/scratch/swe2202/extract97222/work/EA18080223


Postprocessing:
 Format: GRIB2



Grib compression type:
 packingType: grid_simple

ecstorage: 0
 ecfsdir: ectmp:/swe2202/econdemand/

ectrans: 1
 gateway: <gatewayname>
 destination: <username>@genericSftp

Output filelist:
['EA18080100', 'EA18080101', 'EA18080102', 'EA18080103', 'EA18080104', 'EA18080105', 'EA18080106', 'EA18080107', 'EA18080108', 'EA18080109', 'EA18080110', 'EA18080111', 'EA18080112', 'EA18080113', 'EA18080114', 'EA18080115', 'EA18080116', 'EA18080117', 'EA18080118', 'EA18080119', 'EA18080120', 'EA18080121', 'EA18080122', 'EA18080123', 'EA18080200', 'EA18080201', 'EA18080202', 'EA18080203', 'EA18080204', 'EA18080205', 'EA18080206', 'EA18080207', 'EA18080208', 'EA18080209', 'EA18080210', 'EA18080211', 'EA18080212', 'EA18080213', 'EA18080214', 'EA18080215', 'EA18080216', 'EA18080217', 'EA18080218', 'EA18080219', 'EA18080220', 'EA18080221', 'EA18080222', 'EA18080223']
... ERROR CODE: 220
... ERROR MESSAGE:
          Command '['grib_set', '-s', 'edition=2,productDefinitionTemplateNumber=8', '/lus/h2resw01/scratch/swe2202/extract97222/work/EA18080100', '/lus/h2resw01/scratch/swe2202/extract97222/work/EA18080100_2']' returned non-zero exit status 220.
... GRIB2 CONVERSION FAILED!

    Best regards, Vishnu.

    CONTROL

    logfile.txt

    Edited

    Designs

      Child items ...

      2. Activity

      • Michael Blaschek made the issue visible to everyone

        made the issue visible to everyone

      • Michael Blaschek assigned to @blaschm7

        assigned to @blaschm7

      • Michael Blaschek
        Michael Blaschek @blaschm7 ·
        Owner

        Dear Vishnu,

        Maybe this is related to a newer ECCODES version? Since version 2.38.0 there have been some major changes in the code tables. However, you have issues with Large-scale precipitation (142)? From the parameter database it looks ok.

        From the logfile it looks like everything works, except for that last file. Maybe there is something different with that file?

        Maybe this is related to this issue #5 (closed) with specific cloud water content, which does not exist anymore in the ERA table.

        Unfortunately flex_extract is not very well supported anymore.

        Maybe we can come up with a solution together... Best wishes M.

      • Michael Blaschek changed the description

        changed the description

      • S
        GitLab Support Bot @support-bot ·
        Author

        Hi,

        The issue was with the ECCODES version. When I used old python3 (python3/3.11.8-01) and ecmwf-toolbox (ecmwf-toolbox/2024.04.0.0) modules in the ECMWF server, flex_extract worked without error. You may need to load fftw module as well.

        module load python3/old module load ecmwf-toolbox/old module load fftw

        Thanks, Vishnu.

        ...

        From: Michael Blaschek (@blaschm7) gitlab.phaidra@univie.ac.at Sent: Thursday, January 9, 2025 4:35 PM To: Vishnu Thilakan Manaparambil vishnu_thilakan.manaparambil@nateko.lu.se Subject: Re: Flex_extract: Failed with following error - ECCODES ERROR : concept: no match for paramId=142 (#6 (closed))

        Dear Vishnu,

        Maybe this is related to a newer ECCODES version? Since version 2.38.0 there have been some major changes in the code tables. However, you have issues with Large-scale precipitation (142)? From the parameter database it looks ok.

        From the logfile it looks like everything works, except for that last file. Maybe there is something different with that file?

        Maybe this is related to this issue #5 (closed)#5 (closed) with specific cloud water content, which does not exist anymore in the ERA table.

        Unfortunately flex_extract is not very well supported anymore.

        Maybe we can come up with a solution together... Best wishes M.

        — Unsubscribehttps://gitlab.phaidra.org/-/sent_notifications/REDACTED/unsubscribe

      • Michael Blaschek
        Michael Blaschek @blaschm7 ·
        Owner

        Great!

        Just to make sure that I followed all details.

        flex_extract version: 7.1.3 dev branch
eccodes version: 2.38.3 
python version: 3.11.10-01
ecmwf-toolbox version: 2024.09.0.0

        Using these, makes it work again?

        flex_extract version: 7.1.3 dev branch
eccodes version: 2.35.0
python version: 3.11.8-01
ecmwf-toolbox version: 2024.04.0.0

        Please confirm? Thanks

        Edited by Michael Blaschek
      • S
        GitLab Support Bot @support-bot ·
        Author

        Using flex_extract version: 7.1.3 with python version: 3.11.8-01 and ecmwf-toolbox version: 2024.04.0.0 worked for me. I didn't load eccodes separately.

        Best, Vishnu.

        ...

        From: Michael Blaschek (@blaschm7) gitlab.phaidra@univie.ac.at Sent: Thursday, January 9, 2025 5:24 PM To: Vishnu Thilakan Manaparambil vishnu_thilakan.manaparambil@nateko.lu.se Subject: Re: Flex_extract: Failed with following error - ECCODES ERROR : concept: no match for paramId=142 (#6 (closed))

        Great!

        Just to make sure that I followed all details. flex_extract version: 7.1.3 eccodes version: 2.38.3 python version: 3.11.10-01 ecmwf-toolbox version: 2024.09.0.0

        Using these, makes it work again?

        flex_extract version: 7.1.3 eccodes version: 2.35.0 python version: 3.11.8-01 ecmwf-toolbox version: 2024.04.0.0

        Please confirm? Thanks

        — Unsubscribehttps://gitlab.phaidra.org/-/sent_notifications/REDACTED/unsubscribe

      • Michael Blaschek closed

        closed

      • Michael Blaschek reopened

        reopened

      • Michael Blaschek
        Michael Blaschek @blaschm7 ·
        Owner

        I can confirm that using these modules. everything works again. I will commit the changes.

        Slurm job log confirms the modules loaded: flex_extract.62453104.out

        Flex extract log shows success: flex.aa6-201.3228639-prot.txt

        Done.

        Edited by Michael Blaschek
      • Michael Blaschek closed

        closed

      • Michael Blaschek mentioned in issue #5 (closed)

        mentioned in issue #5 (closed)

      • Michael Blaschek mentioned in issue #7 (closed)

        mentioned in issue #7 (closed)

      • Michael Blaschek
        Michael Blaschek @blaschm7 ·
        Owner

        Ok. after being on contact with support, this seems to need some changes too. 142 will be/ is deprecated. We will have to use parameter id 3062 from the WMO table. Which has different units (kg/m2) as comapred to (m).

        This error only arises, because of the command: grib_set -s 'edition=2,productDefinitionTemplateNumber=8 input output which sets the grib format to grib2. Although newer files are already in grib2.

      Please register or sign in to reply