GithubHelp home page GithubHelp logo

docly's People

Contributors

dependabot[bot] avatar rcshubhadeep avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

docly's Issues

ERROR: Failed building wheel for tokenizers, even thought setuptools-rust installed

Hi!
while tryoing to

pip install docly, getting this error:

  Building wheel for tokenizers (PEP 517) ... error
  ERROR: Command errored out with exit status 1:
   command: /Users/krisku/opt/miniconda3/envs/auto_doc/bin/python /Users/krisku/opt/miniconda3/envs/auto_doc/lib/python3.9/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /var/folders/mr/5nhwtm3n4dvfdkh3sf2xs41h0000gn/T/tmpb3b95crr
       cwd: /private/var/folders/mr/5nhwtm3n4dvfdkh3sf2xs41h0000gn/T/pip-install-syhlo38v/tokenizers_eb68e965c7654f6bbe50cefd6fff55af
  Complete output (36 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib
  creating build/lib/tokenizers
  copying tokenizers/__init__.py -> build/lib/tokenizers
  creating build/lib/tokenizers/models
  copying tokenizers/models/__init__.py -> build/lib/tokenizers/models
  creating build/lib/tokenizers/decoders
  copying tokenizers/decoders/__init__.py -> build/lib/tokenizers/decoders
  creating build/lib/tokenizers/normalizers
  copying tokenizers/normalizers/__init__.py -> build/lib/tokenizers/normalizers
  creating build/lib/tokenizers/pre_tokenizers
  copying tokenizers/pre_tokenizers/__init__.py -> build/lib/tokenizers/pre_tokenizers
  creating build/lib/tokenizers/processors
  copying tokenizers/processors/__init__.py -> build/lib/tokenizers/processors
  creating build/lib/tokenizers/trainers
  copying tokenizers/trainers/__init__.py -> build/lib/tokenizers/trainers
  creating build/lib/tokenizers/implementations
  copying tokenizers/implementations/byte_level_bpe.py -> build/lib/tokenizers/implementations
  copying tokenizers/implementations/sentencepiece_bpe.py -> build/lib/tokenizers/implementations
  copying tokenizers/implementations/base_tokenizer.py -> build/lib/tokenizers/implementations
  copying tokenizers/implementations/__init__.py -> build/lib/tokenizers/implementations
  copying tokenizers/implementations/char_level_bpe.py -> build/lib/tokenizers/implementations
  copying tokenizers/implementations/bert_wordpiece.py -> build/lib/tokenizers/implementations
  copying tokenizers/__init__.pyi -> build/lib/tokenizers
  copying tokenizers/models/__init__.pyi -> build/lib/tokenizers/models
  copying tokenizers/decoders/__init__.pyi -> build/lib/tokenizers/decoders
  copying tokenizers/normalizers/__init__.pyi -> build/lib/tokenizers/normalizers
  copying tokenizers/pre_tokenizers/__init__.pyi -> build/lib/tokenizers/pre_tokenizers
  copying tokenizers/processors/__init__.pyi -> build/lib/tokenizers/processors
  copying tokenizers/trainers/__init__.pyi -> build/lib/tokenizers/trainers
  running build_ext
  running build_rust
  error: Can not find Rust compiler
  ----------------------------------------
  ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
ERROR: Could not build wheels for tokenizers which use PEP 517 and cannot be installed directly

even though the setuptools-rust installed .

MacOS Catalina 10.15.7
Python 3.9.1
conda 4.9.2 + pip 21.0.1

I'll appreciate your help.

Cryptic "incompatible language" error

Hi,

I am trying to run docly on a WSL instance and I am getting the following error:

Engine Loaded. ✔
Traceback (most recent call last):
  File "/mnt/c/Projects/GANDLF/venv_linux/bin/docly-gen", line 8, in <module>
    sys.exit(main())
  File "/mnt/c/Projects/GANDLF/venv_linux/lib/python3.7/site-packages/docly/cli/docly_gen.py", line 237, in main
    table_rows, docstr_loc, ipynb_files = _process(args, model, tokenizer, ts_lib_path, config)
  File "/mnt/c/Projects/GANDLF/venv_linux/lib/python3.7/site-packages/halo/halo.py", line 132, in wrapped
    return f(*args, **kwargs)
  File "/mnt/c/Projects/GANDLF/venv_linux/lib/python3.7/site-packages/docly/cli/docly_gen.py", line 116, in _process
    for code_tokens, params, start_index, function_name, ds in process_file(f, ts_lib_path, args.use_old_model):
  File "/mnt/c/Projects/GANDLF/venv_linux/lib/python3.7/site-packages/docly/ioutils/__init__.py", line 125, in process_file
    result, parser_obj = py_parser.parse(file_path, ts_lib_path)
  File "/mnt/c/Projects/GANDLF/venv_linux/lib/python3.7/site-packages/docly/parser/parser.py", line 11, in parse
    python_parser = PythonParser(library_loc=tslib_path)
  File "/mnt/c/Projects/GANDLF/venv_linux/lib/python3.7/site-packages/tree_hugger/core/parser/python/python_parser.py", line 35, in __init__
    super(PythonParser, self).__init__('python', 'python_queries', PythonParser.QUERY_FILE_PATH, library_loc)
  File "/mnt/c/Projects/GANDLF/venv_linux/lib/python3.7/site-packages/tree_hugger/core/code_parser.py", line 41, in __init__
    self.parser.set_language(self.language)
ValueError: Incompatible Language version 11. Must be between 13 and 13

I followed the installation process on the website, after creating a virtual environment using conda:

conda create -p ./venv_linux python=3.7 -y

Cheers,
Sarthak

What does Segmentation fault mean?

image

  • It fails on specific file, what does it mean?
  • If some file fails, the whole procedure stop when it's applied on a directory. I think it should run anyway through other files whether if failed on specific file or not

Windows 10 support

I installed the pip packages without any issues.
I then get a message:

There is no model. Downloading (maybe because you chose to use the newer model)
C:\Users\Windows\.docly\model\pytorch_model_new.bin: 707MB [01:22, 8.61MB/s]
Download complete ✔

And then this error:
===== OS version not supported ===== ❌

Environment information:

OS Name:                   Microsoft Windows 10 Pro
OS Version:                10.0.18363 N/A Build 18363
OS Manufacturer:           Microsoft Corporation
OS Configuration:          Standalone Workstation
OS Build Type:             Multiprocessor Free
System Model:              PCX0DX
System Type:               x64-based PC
Processor(s):              1 Processor(s) Installed.
                           [01]: Intel64 Family 6 Model 165 Stepping 2 GenuineIntel ~2304 Mhz
BIOS Version:              INSYDE Corp. 1.07.05LAM, 5/20/2020

Python Version:

Python 3.6.12 :: Anaconda, Inc.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.