-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
rattle correction step giving error #50
Comments
Hi, You can have a look at the memory usage figure in our paper. Otherwise, I need more information like the number of reads or the fastq file size to give you a RAM estimation. Your 'samplefile.out' file should not be empty, because it is a binary file. You need to look at the file size to check whether it is empty. Eileen |
Hi, I checked the output files for some of the processes that did run. IIt created consensi.fq, uncorrected,fq and corrected.fq hbut they are all 0 bytes. I am not sure why this is happening. This was my snakemake command: rule cluster_correction: To add on: the same happened with my rattle cluster_summary step- it created a tsv file but it was also 0 bytes. |
Hi, This problem seems not from the error correction step but from the clustering step. Please provide answers to the following questions to help us identify the issues and provide solutions.
Eileen |
input: "data/.../..../{samle}.fastq.gz" In my log, my sample.out file says "Reads: ...some number..." and my sample.err says: [================================================================================] 67715/67715 (100%)85%)
|
Hi, Your RATTLE error correction step command is incorrect. To specify the outputs, you don't need to list all the output files' names and locations. Only need an output folder location, like Hope this helps. |
Edit: Oh I think I get what you were saying
but I should change it to-
Is this ^ what you meant? Also In my snakefile I had:
Would I need to change the expand command in my snakefile?
Why did this command produce an empty tsv file? |
|
Hi, thanks for the reply. I didn’t understand why I would need to skip the
extract clusters step. Wouldn’t that step be necessary to do the next step
which is cluster correction
…On Sun, Oct 15, 2023 at 7:39 PM Eileen Xue ***@***.***> wrote:
1.
Your new output command is correct.
If you want to use multiple fastq files as input, the format should be -i
input_1.fq,input_2.fq,...,input_n.fq. All files must be separated by
comma, no space or line break is allowed. Don't use Snakenmake expand for
RATTLE input, expand will create new lines.
Also, I don't understand why using corrected.fq, uncorrected.fq,
consensi.fq as input. This will make your input and output the exact same
file.
2.
Your command looks correct. You can skip extract_clusters
Possible issues:
Inputs of the cluster step and cluster_summary step are not the same.
Your input.fastq file and clusters.out file location is incorrect.
—
Reply to this email directly, view it on GitHub
<#50 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/AXXIJCHCL5JD6Z6IIAXESX3X7SF4PAVCNFSM6AAAAAA52V7L2GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONRTGU4TMOJWGU>
.
You are receiving this because you authored the thread.Message ID:
***@***.***>
|
extract_clusters and cluster_summary are designed to make cluster step results readable. Only the cluster step is necessary step before the correction step. |
I ran rattle correct on my input files through snakemake. I get an error message saying this:
Error in rule cluster_correction:
jobid: 13
input: data/.../.../samplefile.fastq
output: data/RATTLE_out/samplefile/corrected.fq, data/RATTLE_out/samplefile/uncorrected.fq, data/RATTLE_out/samplefile/consensi.fq
log: log/RATTLE_log/samplefile_correct.out, log/RATTLE_log/samplefile_correct.err (check log file(s) for error details)
shell:
/storage/.../.../bin/RATTLE/rattle correct -i data/.../.../samplefile.fastq -c data/RATTLE_out/samplefile/clusters.out -o data/RATTLE_out/samplefile/corrected.fq data/RATTLE_out/samplefile/uncorrected.fq data/RATTLE_out/samplefile/consensi.fq -t 48 > log/RATTLE_log/samplefile.out 2> log/RATTLE_log/samplefile.err
(one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)
Error executing rule cluster_correction on cluster (jobid: 13, external: 2761217, jobscript: /storage/.../.../.../.snakemake/tmp.tz0fhacf/snakejob.cluster_correction.13.sh). For error details see the cluster log and the log files of the involved rule(s).
When I open samplefile.err it says: "Reading fasta file... Done" and when I open samplefile.out it is empty.
I also get this message below:
Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
slurmstepd: error: Detected 1 oom-kill event(s) in StepId=2761217.0 cgroup. Some of your processes may have been killed by the cgroup out-of-memory handler.
srun: error: valiant1: task 0: Out Of Memory
slurmstepd: error: Detected 1 oom-kill event(s) in StepId=2761217.batch cgroup. Some of your processes may have been killed by the cgroup out-of-memory handler.
I gave it 100GB ram to begin with but I guess it wasn't enough. Is there a way to know how much ram I need to give it before I run the snakemake command?
The text was updated successfully, but these errors were encountered: