Comments (31)
Changing the below to check against None
rather than an empty string (""
) fixes the issue for me:
Lines 723 to 727 in 71e7025
from gembs.
Does this repo still maintained ? I have the same issue, and I am wondering if this has been addressed.
from gembs.
from gembs.
Hi Simon,
Thanks for the reply. Here is the error log I have ..
:
: Command map started at 2019-01-08 10:18:43.945975
:
: ------------ Mapping Parameters ------------
: Sample barcode : AS-277115-LR-38819
: Data set : AS-277115-LR-38819
: No. threads : 2
: Index : /bigdisk/ref_db/mm10/gemBS/mm10.BS.gem
: Paired : True
: Read non stranded: True
: Type : PAIRED
: Input Files : AS-277115-LR-38819_R1.fastq.gz,AS-277115-LR-38819_R2.fastq.gz
: Output dir : /mapping/AS-277115-LR-38819
:
: Bisulfite Mapping...
Traceback (most recent call last):
File "/usr/local/bin/gemBS", line 11, in <module>
load_entry_point('gemBS==3.2.2', 'console_scripts', 'gemBS')()
File "/usr/local/lib/python3.5/dist-packages/gemBS/commands.py", line 157, in gemBS_main
instances[args.command].run(args)
File "/usr/local/lib/python3.5/dist-packages/gemBS/production.py", line 367, in run
self.do_mapping(fl)
File "/usr/local/lib/python3.5/dist-packages/gemBS/production.py", line 559, in do_mapping
under_conversion=self.underconversion_sequence,over_conversion=self.overconversion_sequence)
File "/usr/local/lib/python3.5/dist-packages/gemBS/__init__.py", line 737, in mapping
process = run_tools(tools, name="bisulfite-mapping", logfile=logfile)
File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 330, in run_tools
p.start()
File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 237, in start
logging.info("Starting:\n\t%s" % (self.to_bash_pipe()))
File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 276, in to_bash_pipe
return " | ".join([p.to_bash() for p in self.processes])
File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 276, in <listcomp>
return " | ".join([p.to_bash() for p in self.processes])
File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 165, in to_bash
return " ".join(self.commands)
TypeError: sequence item 17: expected str instance, NoneType found
from gembs.
from gembs.
Hi Simon,
Thanks for the quick fix. Alignment went smoothly, however I have new error in BScall.. Below is the log..
$ gemBS call
:
: Command call started at 2019-01-08 12:24:02.381098
:
: ----------- Methylation Calling --------
: Reference : /bigdisk/scJens/gem_bs/genome/mm10.fa
: Species : mm10
: Right Trim : 10
: Left Trim : 10
: Chromosomes : ['chr1', 'chr2', 'chrX', 'chr3', 'chr4', 'chr5', 'chr6', 'chr7', 'chr10', 'chr8', 'chr14', 'chr9', 'chr11', 'chr13', 'chr12', 'chr15', 'chr16', 'chr17', 'chrY', 'chr18', 'chr19', '@pool_1']
: Threads : 6
: Sample: AS-277115-LR-38819 Bam: /bigdisk/scJens/gem_bs//mapping/AS-277115-LR-38819/AS-277115-LR-38819.bam
:
: Methylation Calling...
2019-01-08 12:25:06,267 ERROR: Process '/home/epicwl/miniconda3/lib/python3.6/site-packages/gemBS/gemBSbinaries/bs_call' finished with 1
2019-01-08 12:25:06,267 ERROR: Loading reference sequences
2019-01-08 12:25:06,267 ERROR: Completed loading reference sequences
2019-01-08 12:25:06,267 ERROR: Processing chromosome chr2 (OK)
2019-01-08 12:25:06,267 ERROR: > System.Error::Signal raised (no=11)
Exception in thread Thread-2:
Traceback (most recent call last):
ValueError: Error while executing the bscall process.
And the above error just hangs, I had to terminate the process.
from gembs.
from gembs.
Do you need fastq files or the bam file ?
Also this is a single cell library with non-directional protocol. I quickly did map-report and it says 33% overall alignment rate before deduplication (attached). For same sample when I used Bismark it reported ~18% alignment.
While you take a look at the error, could you suggest me if I can use any downstream tools deduplication (is picard fine?) and for methylation extraction ?
from gembs.
from gembs.
Could you please let me know once you download the file so that I can remove it from the Dropbox.
Thank you and hope this helps. Also is it ok to use MethylDackel for extraction ?
from gembs.
from gembs.
Ah! Got it. Thank you.
from gembs.
from gembs.
I followed the instructions as in the docs for installation.
git clone --recursive https://github.com/heathsc/gemBS.git
python3 setup.py install
I do not have experience with docker/singularity but I see there are instructions in the docs. I will try it and let you know.
Thank you for the help.
from gembs.
from gembs.
I am running it on a local system with 128G RAM and 20 threads running on Ubuntu 16.04 LTS.
I just installed it on another system, will let you know if I face the same issuse..
from gembs.
from gembs.
Okay, I will check. Should I start with the alignment ? Or is there a way to use just 1 thread for gemBS call
, since the config file has been set to 6 threads.
from gembs.
from gembs.
Nope, still the same issue. I changed threads valueto 1 in .gemBS/gemBS.json
and ran the command.
gemBS call
:
: Command call started at 2019-01-08 18:00:30.938804
:
: ----------- Methylation Calling --------
: Reference : /bigdisk/scJens/gem_bs/genome/mm10.fa
: Species : mm10
: Right Trim : 10
: Left Trim : 10
: Chromosomes : ['chr1', 'chr2', 'chrX', 'chr3', 'chr4', 'chr5', 'chr6', 'chr7', 'chr10', 'chr8', 'chr14', 'chr9', 'chr11', 'chr13', 'chr12', 'chr15', 'chr16', 'chr17', 'chrY', 'chr18', 'chr19', '@pool_1']
: Threads : 1
: Sample: AS-277115-LR-38819 Bam: /bigdisk/scJens/gem_bs//mapping/AS-277115-LR-38819/AS-277115-LR-38819.bam
:
: Methylation Calling...
2019-01-08 18:01:08,477 ERROR: Process '/home/epicwl/miniconda3/lib/python3.6/site-packages/gemBS/gemBSbinaries/bs_call' finished with 1
2019-01-08 18:01:08,478 ERROR: Loading reference sequences
2019-01-08 18:01:08,478 ERROR: Completed loading reference sequences
2019-01-08 18:01:08,478 ERROR: Processing chromosome chr7 (OK)
2019-01-08 18:01:08,478 ERROR: > System.Error::Signal raised (no=11)
Exception in thread Thread-2:
Traceback (most recent call last):
ValueError: Error while executing the bscall process.
from gembs.
from gembs.
Its weird. Every time I run gemBS call
it stops at the next chromosome.
: Methylation Calling...
2019-01-08 18:10:16,045 ERROR: Process '/home/epicwl/miniconda3/lib/python3.6/site-packages/gemBS/gemBSbinaries/bs_call' finished with 1
2019-01-08 18:10:16,045 ERROR: Loading reference sequences
2019-01-08 18:10:16,045 ERROR: Completed loading reference sequences
2019-01-08 18:10:16,045 ERROR: Processing chromosome chr10 (OK)
2019-01-08 18:10:16,046 ERROR: > System.Error::Signal raised (no=11)
Exception in thread Thread-1:
Traceback (most recent call last):
ValueError: Error while executing the bscall process.
2019-01-08 18:10:16,083 ERROR: Process '/home/epicwl/miniconda3/lib/python3.6/site-packages/gemBS/gemBSbinaries/bs_call' finished with 1
2019-01-08 18:10:16,083 ERROR: Loading reference sequences
2019-01-08 18:10:16,083 ERROR: Completed loading reference sequences
2019-01-08 18:10:16,083 ERROR: Processing chromosome chr8 (OK)
2019-01-08 18:10:16,083 ERROR: > System.Error::Signal raised (no=11)
Exception in thread Thread-2:
Traceback (most recent call last):
ValueError: Error while executing the bscall process.
: Methylation call done, samples performed: AS-277115-LR-38819
I also think its still using more than one thread. How do I force it to use single thread ?
from gembs.
from gembs.
Yes, there are json and bcf files for the ones that are completed. But all the json files are empty.
from gembs.
Okay, on a different system it works fine and calling completed without any error. I guess it was an installation problem on the main system. Thank you for your patient replies and apologies for the mess :|
Should have checked it properly.
from gembs.
from gembs.
Sure. Tomorrow I will check again and update you. Thanks again.
from gembs.
Hi Simon,
I reinstalled everything on the new system and it worked fine. Still dont know how it messed up the first installation.
I have another question to ask. How do I run gemBS map with a custom input json file ?
$gemBS prepare -c ${conf} -t ${csv} --output ${sample_name}.json --no-db
$gemBS map
gemBS.utils.CommandException: gemBS JSON file not found.
How do I pass output json from prepare
command to map command ?
Thanks again.
from gembs.
from gembs.
Ah! Nice. It works. I was using the wrong way then gemBS map -j myfile.json
Thanks again.
from gembs.
Thanks for fixing this @heathsc 👍
from gembs.
Related Issues (20)
- mapped bam files: SM key without value
- Documentation (with SSL) cannot be accessed
- how to set the control sequences?
- PBAT dataset failed in calling step HOT 3
- Can't see colors for ENCODE bigBed on UCSC browser HOT 4
- Scattering gemBS alignment step across a cluster HOT 1
- Conversion rate is N/A in QC HOT 7
- Latest version to Bioconda? HOT 9
- Dealing with overlapping reads HOT 3
- gemBS 3.5.1 issue at map stage of sample data HOT 10
- ValueError: Error while executing the Bisulfite bisulphite-mapping HOT 14
- Alignment Modes HOT 9
- Error when running gemBS map HOT 3
- HowTo enable GPU for read mapping? HOT 7
- mapping merge fails if one of the file_id's is equal to the Barcode
- The .bed file does not match the statistics of the REPORT
- Difference between bin/bs_call and gemBSbinaries/bs_call? HOT 3
- System.Error::Signal raised (no=11) using bs_call HOT 2
- snp extract "Invalid format" HOT 4
- bs_call finished with -6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gembs.