GithubHelp home page GithubHelp logo

Comments (31)

IsmailM avatar IsmailM commented on August 13, 2024

Changing the below to check against None rather than an empty string ("") fixes the issue for me:

gemBS/gemBS/__init__.py

Lines 723 to 727 in 71e7025

#Bisulfite Conversion Values
if under_conversion != "":
mapping.extend(["--underconversion_sequence",under_conversion])
if over_conversion != "":
mapping.extend(["--overconversion_sequence",over_conversion])

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Does this repo still maintained ? I have the same issue, and I am wondering if this has been addressed.

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Hi Simon,
Thanks for the reply. Here is the error log I have ..

: 
: Command map started at 2019-01-08 10:18:43.945975
: 
: ------------ Mapping Parameters ------------
: Sample barcode   : AS-277115-LR-38819
: Data set         : AS-277115-LR-38819
: No. threads      : 2
: Index            : /bigdisk/ref_db/mm10/gemBS/mm10.BS.gem
: Paired           : True
: Read non stranded: True
: Type             : PAIRED
: Input Files      : AS-277115-LR-38819_R1.fastq.gz,AS-277115-LR-38819_R2.fastq.gz
: Output dir       : /mapping/AS-277115-LR-38819
: 
: Bisulfite Mapping...
Traceback (most recent call last):
  File "/usr/local/bin/gemBS", line 11, in <module>
    load_entry_point('gemBS==3.2.2', 'console_scripts', 'gemBS')()
  File "/usr/local/lib/python3.5/dist-packages/gemBS/commands.py", line 157, in gemBS_main
    instances[args.command].run(args)
  File "/usr/local/lib/python3.5/dist-packages/gemBS/production.py", line 367, in run
    self.do_mapping(fl)
  File "/usr/local/lib/python3.5/dist-packages/gemBS/production.py", line 559, in do_mapping
    under_conversion=self.underconversion_sequence,over_conversion=self.overconversion_sequence) 
  File "/usr/local/lib/python3.5/dist-packages/gemBS/__init__.py", line 737, in mapping
    process = run_tools(tools, name="bisulfite-mapping", logfile=logfile)
  File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 330, in run_tools
    p.start()
  File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 237, in start
    logging.info("Starting:\n\t%s" % (self.to_bash_pipe()))
  File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 276, in to_bash_pipe
    return " | ".join([p.to_bash() for p in self.processes])
  File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 276, in <listcomp>
    return " | ".join([p.to_bash() for p in self.processes])
  File "/usr/local/lib/python3.5/dist-packages/gemBS/utils.py", line 165, in to_bash
    return " ".join(self.commands)
TypeError: sequence item 17: expected str instance, NoneType found

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Hi Simon,
Thanks for the quick fix. Alignment went smoothly, however I have new error in BScall.. Below is the log..

$ gemBS call
: 
: Command call started at 2019-01-08 12:24:02.381098
: 
: ----------- Methylation Calling --------
: Reference       : /bigdisk/scJens/gem_bs/genome/mm10.fa
: Species         : mm10
: Right Trim      : 10
: Left Trim       : 10
: Chromosomes     : ['chr1', 'chr2', 'chrX', 'chr3', 'chr4', 'chr5', 'chr6', 'chr7', 'chr10', 'chr8', 'chr14', 'chr9', 'chr11', 'chr13', 'chr12', 'chr15', 'chr16', 'chr17', 'chrY', 'chr18', 'chr19', '@pool_1']
: Threads         : 6
: Sample: AS-277115-LR-38819    Bam: /bigdisk/scJens/gem_bs//mapping/AS-277115-LR-38819/AS-277115-LR-38819.bam
: 
: Methylation Calling...
2019-01-08 12:25:06,267 ERROR: Process '/home/epicwl/miniconda3/lib/python3.6/site-packages/gemBS/gemBSbinaries/bs_call' finished with 1
2019-01-08 12:25:06,267 ERROR: Loading reference sequences
2019-01-08 12:25:06,267 ERROR: Completed loading reference sequences
2019-01-08 12:25:06,267 ERROR: Processing chromosome chr2 (OK)
2019-01-08 12:25:06,267 ERROR: > System.Error::Signal raised (no=11)
Exception in thread Thread-2:
Traceback (most recent call last):
ValueError: Error while executing the bscall process.

And the above error just hangs, I had to terminate the process.

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Do you need fastq files or the bam file ?

Also this is a single cell library with non-directional protocol. I quickly did map-report and it says 33% overall alignment rate before deduplication (attached). For same sample when I used Bismark it reported ~18% alignment.

AS-277115-LR-38819.html.zip

While you take a look at the error, could you suggest me if I can use any downstream tools deduplication (is picard fine?) and for methylation extraction ?

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Here
scbs_samples.conf.zip

Could you please let me know once you download the file so that I can remove it from the Dropbox.
Thank you and hope this helps. Also is it ok to use MethylDackel for extraction ?

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Ah! Got it. Thank you.

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

I followed the instructions as in the docs for installation.

git clone --recursive https://github.com/heathsc/gemBS.git
python3 setup.py install

I do not have experience with docker/singularity but I see there are instructions in the docs. I will try it and let you know.

Thank you for the help.

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

I am running it on a local system with 128G RAM and 20 threads running on Ubuntu 16.04 LTS.
I just installed it on another system, will let you know if I face the same issuse..

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Okay, I will check. Should I start with the alignment ? Or is there a way to use just 1 thread for gemBS call, since the config file has been set to 6 threads.

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Nope, still the same issue. I changed threads valueto 1 in .gemBS/gemBS.json and ran the command.

 gemBS call
: 
: Command call started at 2019-01-08 18:00:30.938804
: 
: ----------- Methylation Calling --------
: Reference       : /bigdisk/scJens/gem_bs/genome/mm10.fa
: Species         : mm10
: Right Trim      : 10
: Left Trim       : 10
: Chromosomes     : ['chr1', 'chr2', 'chrX', 'chr3', 'chr4', 'chr5', 'chr6', 'chr7', 'chr10', 'chr8', 'chr14', 'chr9', 'chr11', 'chr13', 'chr12', 'chr15', 'chr16', 'chr17', 'chrY', 'chr18', 'chr19', '@pool_1']
: Threads         : 1
: Sample: AS-277115-LR-38819    Bam: /bigdisk/scJens/gem_bs//mapping/AS-277115-LR-38819/AS-277115-LR-38819.bam
: 
: Methylation Calling...
2019-01-08 18:01:08,477 ERROR: Process '/home/epicwl/miniconda3/lib/python3.6/site-packages/gemBS/gemBSbinaries/bs_call' finished with 1
2019-01-08 18:01:08,478 ERROR: Loading reference sequences
2019-01-08 18:01:08,478 ERROR: Completed loading reference sequences
2019-01-08 18:01:08,478 ERROR: Processing chromosome chr7 (OK)
2019-01-08 18:01:08,478 ERROR: > System.Error::Signal raised (no=11)
Exception in thread Thread-2:
Traceback (most recent call last):
ValueError: Error while executing the bscall process.

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Its weird. Every time I run gemBS call it stops at the next chromosome.

: Methylation Calling...
2019-01-08 18:10:16,045 ERROR: Process '/home/epicwl/miniconda3/lib/python3.6/site-packages/gemBS/gemBSbinaries/bs_call' finished with 1
2019-01-08 18:10:16,045 ERROR: Loading reference sequences
2019-01-08 18:10:16,045 ERROR: Completed loading reference sequences
2019-01-08 18:10:16,045 ERROR: Processing chromosome chr10 (OK)
2019-01-08 18:10:16,046 ERROR: > System.Error::Signal raised (no=11)
Exception in thread Thread-1:
Traceback (most recent call last):
ValueError: Error while executing the bscall process.

2019-01-08 18:10:16,083 ERROR: Process '/home/epicwl/miniconda3/lib/python3.6/site-packages/gemBS/gemBSbinaries/bs_call' finished with 1
2019-01-08 18:10:16,083 ERROR: Loading reference sequences
2019-01-08 18:10:16,083 ERROR: Completed loading reference sequences
2019-01-08 18:10:16,083 ERROR: Processing chromosome chr8 (OK)
2019-01-08 18:10:16,083 ERROR: > System.Error::Signal raised (no=11)
Exception in thread Thread-2:
Traceback (most recent call last):
ValueError: Error while executing the bscall process.

: Methylation call done, samples performed: AS-277115-LR-38819

I also think its still using more than one thread. How do I force it to use single thread ?

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Yes, there are json and bcf files for the ones that are completed. But all the json files are empty.

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Okay, on a different system it works fine and calling completed without any error. I guess it was an installation problem on the main system. Thank you for your patient replies and apologies for the mess :|
Should have checked it properly.

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Sure. Tomorrow I will check again and update you. Thanks again.

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Hi Simon,
I reinstalled everything on the new system and it worked fine. Still dont know how it messed up the first installation.

I have another question to ask. How do I run gemBS map with a custom input json file ?

$gemBS prepare -c ${conf} -t ${csv} --output ${sample_name}.json --no-db
$gemBS map 
gemBS.utils.CommandException: gemBS JSON file not found.

How do I pass output json from prepare command to map command ?

Thanks again.

from gembs.

heathsc avatar heathsc commented on August 13, 2024

from gembs.

PoisonAlien avatar PoisonAlien commented on August 13, 2024

Ah! Nice. It works. I was using the wrong way then gemBS map -j myfile.json

Thanks again.

from gembs.

IsmailM avatar IsmailM commented on August 13, 2024

Thanks for fixing this @heathsc 👍

from gembs.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.