GithubHelp home page GithubHelp logo

yodeng / hpc-blast Goto Github PK

View Code? Open in Web Editor NEW
4.0 1.0 1.0 51 KB

divide blast query and run all chunks across HPC or localhost in parallelly

License: MIT License

Python 100.00%
hpc-applications hpc-blast hpc-clusters ncbi-blast sge-blast blast bioinformatics parallel-blast

hpc-blast's Introduction

hpcblast

Anaconda-Server Badge PyPI version install with bioconda

hpcblast software provides a simple and efficient method for running the NCBI-BLAST+ suite program in localhost or the HPC environment (Sun Grid Engine). It splits the input sequence file and run all chunked tasks in parallel to accelerate the blast search speed. When there are many sequences in the input file for blast comparison and the running speed is slow, using hpcblast can significantly improve the performance. All of this can be easy done only by adding the hpc-blast command at the head of your blast command line.

Features

  • hpcblast splits the input sequence file into small files and runs all tasks in parallel.
  • hpcblast supports fasta/fastq sequence format file input and gzip compression allowed, there is no need to decompress fastq and convert it to fasta for blast .
  • hpcblast manages and schedules all tasks by runjob.
  • hpcblast is compatible with all NCBI-BLAST+ options, and all results are the same except the order of output aligned segment.
  • the hpc-blast option uses two - flag, while NCBI-BLAST+ options use one - flag.
  • you need to pay attention to the CPU and memory resources used In the parallelized environment.
  • other efficient features ...

Requirements

Installation

from git repo (for recommend)

pip3 install git+https://github.com/yodeng/hpc-blast.git

from pypi:

pip3 install hpcblast -U

Usage

$ hpc-blast --help 
usage: hpc-blast [--split <int> | --size <int>] [--num <int>] [--tempdir <dir>] [--log <file>] [--local]
                 [--version] [-h] [--queue [<str> ...]] [--cpu <int>] [--memory <int>]
                 <blast command>

hpc-blast <OPTIONS> <blast command>

positional arguments:
  <blast command>      blast command, required

optional arguments:
  --split <int>        split query into num of chunks, 10 by default
  --size <int>         split query into multi chunks with N sequences
  --num <int>          max number of chunks run in parallel, all chunks by default
  --tempdir <dir>      hpc blast temp directory
  --log <file>         append hpc-blast log info to file, sys.stdout by default
  --local              run blast in localhost instead of sge
  --version            show program's version number and exit
  -h, --help           show this help message and exit

sge arguments:
  --queue [<str> ...]  sge queue, multi-queue can be sepreated by whitespace, all access queue by default
  --cpu <int>          cpu usage for sge, 1 by default, max(--cpu, -num_threads) will be used
  --memory <int>       memory (GB) usage for sge, 1 by default

Example

in Sun Grid Engine:

hpc-blast blastn -query test.fastq.gz -db /data/refdb -num_threads 4 -outfmt 6 qseqid qlen qstart qend -out test.m6

in localhost:

hpc-blast --local blastn -query test.fastq.gz -db /data/refdb -num_threads 4 -outfmt 6 qseqid qlen qstart qend -out test.m6

hpc-blast's People

Contributors

yodeng avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar

Forkers

uniteomics

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.