GithubHelp home page GithubHelp logo

gp89 / filequeue Goto Github PK

View Code? Open in Web Editor NEW
22.0 22.0 2.0 28 KB

A thread-safe queue which queues items on disk, with an optional in memory buffer. Can put and get any pickle-able object into a buffer of a specified size (optional), any overflow will get put to a gzip file to keep excessive amounts of queued items out of memory

Python 100.00%

filequeue's People

Contributors

gp89 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

filequeue's Issues

Feedback

Hey,

I'm still playing with this but I just wanted to say awesome lib! Particularly that you can swap out the standard.

Thanks, saved me a lot of time :)

Permission issue in filequeue Windows

Hello @GP89,

I am facing some Permission issues in windows with FileQueue Library. Here is the error code:

PS > python .\syborg.py domain.com
Traceback (most recent call last):
  File ".\syborg.py", line 174, in <module>
    q = filequeue.FileQueue(maxsize=1000)
  File "C:\Python36\lib\site-packages\filequeue\filequeue.py", line 53, in __init__
    self._init_fds()
  File "C:\Python36\lib\site-packages\filequeue\filequeue.py", line 56, in _init_fds
    self._file_write = _file_open(self._temp_file.name, "wb")
PermissionError: [Errno 13] Permission denied: 'C:\\Users\\Yash\\AppData\\Local\\Temp\\tmpqnp_lbdw.queue'

Kindly check MilindPurswani/Syborg#6 for more info.

Thanks,

-Milind

FileQueue exploding hard disk in a video streaming application

I'm using this filequeue in a video streaming application that puts frames of a video onto the queue and then process them real-time. The issue is the filequeue is not getting rid of tmp files as they are taken from the queue.

How can I cleanup queue file on disk straight after getting my item from filequeue?

NameError: name 'filequeue' is not defined

Hey,

I am facing this error when I run the following code snippet:

from filequeue import *

q = filequeue.FileQueue(maxsize=10)

Error:

Traceback (most recent call last):
  File "syborg2.py", line 102, in <module>
    q = filequeue.FileQueue(maxsize=1000)
NameError: name 'filequeue' is not defined

Using Python 3.7.4

Installation Error

When I try to install this on Windows using pip , I get the following error , what could be the issue ?

Collecting filequeue==0.3.1 (from -r requirements.txt (line 16))
  Using cached filequeue-0.3.1.tar.gz
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "c:\users\ahmkhan\appdata\local\temp\pip-build-7wbujm\filequeue\setup.py", line 16, in <module>
        long_description = "\n\n".join((read("README.rst"), read("CHANGES.rst"))),
      File "c:\users\ahmkhan\appdata\local\temp\pip-build-7wbujm\filequeue\setup.py", line 6, in read
        return open(os.path.join(os.path.dirname(__file__), fname)).read()
    IOError: [Errno 2] No such file or directory: 'c:\\users\\axxxxan\\appdata\\local\\temp\\pip-build-7wbujm\\filequeue\\CHANGES.rst'

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.