-
Notifications
You must be signed in to change notification settings - Fork 2
Open
Description
The following error occurs in rule fasterq_dump
The control file data associated with this error is: SRR13055334,Treg_S2R2,SE,total
Another dataset with an error similar to this one is: SRR13055335,Treg_S2R3,SE,total
Using restart-times: 3 in ~/.config/snakemake/slurm/config.yml profile fixed the issue. It successfully dumped the SRA data on the subsequent execution
Building DAG of jobs...
Using shell: /usr/bin/bash
Provided cores: 40
Rules claiming more threads will be scaled down.
Select jobs to execute...
[Fri Apr 14 13:40:32 2023]
checkpoint fasterq_dump:
input: results/temp/prefetch/Treg/Treg_S2R3/Treg_S2R3.sra
output: results/data/Treg/raw/Treg_S2R3_S.fastq.gz
jobid: 0
benchmark: benchmarks/Treg/fasterq_dump/Treg_S2R3_S.benchmark
wildcards: tissue_name=Treg, tag=S2R3, PE_SE=S
threads: 40
resources: mem_mb=25600, disk_mb=256000, tmpdir=/tmp, time_min=45
Downstream jobs will be updated after completion.
command='fasterq-dump --force --progress --threads 40 --temp /scratch --outdir /scratch'
# Set the split/concatenate based on paired end or single end data
if [[ "False" == "True" ]]; then
command+=' --split-files'
else
command+=' --concatenate-reads'
fi
# Add the SRA file path to the command
command+=' results/temp/prefetch/Treg/Treg_S2R3/Treg_S2R3.sra'
echo $command
eval $command
# gzip the output
pigz --synchronous --processes 40 /scratch/Treg_S2R3.fastq
mv /scratch/Treg_S2R3.fastq.gz results/data/Treg/raw/Treg_S2R3_S.fastq.gz
Activating conda environment: /lustre/work/helikarlab/saghamiri2/FastqToGeneCounts/.snakemake/conda/ae87d42240ae7094f66a487b198441d3
2023-04-14T18:40:33 fasterq-dump.2.11.0 err: extract_acc2( 'results/temp/prefetch/Treg/Treg_S2R3/Treg_S2R3.sra' ).VFSManagerExtractAccessionOrOID() -> RC(rcVFS,rcPath,rcConstructing,rcParam,rcIncorrect)
lookup :| 0.00%2023-04-14T18:40:35 fasterq-dump.2.11.0 warn: database incorrect while opening manager within database module - can't open NC_012920.1 as a RefSeq or as a WGS
2023-04-14T18:40:35 fasterq-dump.2.11.0 err: cmn_iter.c cmn_read_String( #11294389 ).VCursorCellDataDirect() -> RC(rcDB,rcMgr,rcOpening,rcDatabase,rcIncorrect)
2023-04-14T18:40:35 fasterq-dump.2.11.0 err: sorter.c get_from_raw_read_iter( 11294389 ) -> RC(rcDB,rcMgr,rcOpening,rcDatabase,rcIncorrect)
2023-04-14T18:40:35 fasterq-dump.2.11.0 warn: database incorrect while opening manager within database module - can't open NC_012920.1 as a RefSeq or as a WGS
2023-04-14T18:40:35 fasterq-dump.2.11.0 err: cmn_iter.c cmn_read_String( #11608122 ).VCursorCellDataDirect() -> RC(rcDB,rcMgr,rcOpening,rcDatabase,rcIncorrect)
2023-04-14T18:40:35 fasterq-dump.2.11.0 warn: database incorrect while opening manager within database module - can't open NC_012920.1 as a RefSeq or as a WGS
2023-04-14T18:40:35 fasterq-dump.2.11.0 err: cmn_iter.c cmn_read_String( #12235588 ).VCursorCellDataDirect() -> RC(rcDB,rcMgr,rcOpening,rcDatabase,rcIncorrect)
2023-04-14T18:40:36 fasterq-dump.2.11.0 warn: database incorrect while opening manager within database module - can't open CM000685.1 as a RefSeq or as a WGS
2023-04-14T18:40:36 fasterq-dump.2.11.0 err: cmn_iter.c cmn_read_String( #10980656 ).VCursorCellDataDirect() -> RC(rcDB,rcMgr,rcOpening,rcDatabase,rcIncorrect)
2023-04-14T18:40:37 fasterq-dump.2.11.0 err: sorter.c run_producer_pool().join_and_release_threads -> RC(rcExe,rcProcess,rcExecuting,rcProcess,rcCanceled)
2023-04-14T18:40:37 fasterq-dump.2.11.0 err: sorter.c execute_lookup_production() -> RC(rcExe,rcProcess,rcExecuting,rcProcess,rcCanceled)
merge :
2023-04-14T18:40:37 fasterq-dump.2.11.0 err: fasterq-dump.c produce_lookup_files() -> RC(rcExe,rcProcess,rcExecuting,rcProcess,rcCanceled)
fasterq-dump quit with error code 3
[Fri Apr 14 13:40:37 2023]
Error in rule fasterq_dump:
jobid: 0
output: results/data/Treg/raw/Treg_S2R3_S.fastq.gz
conda-env: /lustre/work/helikarlab/saghamiri2/FastqToGeneCounts/.snakemake/conda/ae87d42240ae7094f66a487b198441d3
shell:
command='fasterq-dump --force --progress --threads 40 --temp /scratch --outdir /scratch'
# Set the split/concatenate based on paired end or single end data
if [[ "False" == "True" ]]; then
command+=' --split-files'
else
command+=' --concatenate-reads'
fi
# Add the SRA file path to the command
command+=' results/temp/prefetch/Treg/Treg_S2R3/Treg_S2R3.sra'
echo $command
eval $command
# gzip the output
pigz --synchronous --processes 40 /scratch/Treg_S2R3.fastq
mv /scratch/Treg_S2R3.fastq.gz results/data/Treg/raw/Treg_S2R3_S.fastq.gz
(one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)
Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
Metadata
Metadata
Assignees
Labels
No labels