GithubHelp home page GithubHelp logo

poe-stash-indexer's People

Contributors

licoffe avatar saturate avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

poe-stash-indexer's Issues

First search works, but others don't

I am currently running in to a problem where my first search works as long as I don't change any of the parameters, but any search thereafter is only returning 0 results.

Index stops on JSON error

My indexer stopped at the following error:

19-10-2016 6:54:35 > [Indexer] SyntaxError: Unexpected token < in JSON at position 0

I think it would make sense to just continue running the indexer at this point? Or maybe not, I don't why it happens, but would be nice to log some more, or just continue if we can.

more search/filter options needed

will add more to this issue once I find that it is missing
will check them here also once they are implemented

all "findings" are based on experience with poe.trade and the features it has

  • gem/map level/tier
  • quality
  • socket color / link color
  • max buyout
  • required level / stats
  • possibility to combine multiple affix "groups" with search parameters like or/and/count

Insertion issues with MongoDB

As mentionned by @dukenuking:
2-10-2016 12:55:52 > [Indexer] There was an error inserting value: undefined
Loading data into DB: 2377ms
2-10-2016 12:55:52 > [Indexer] Next ID: 6892-7570-6012-10171-3898
2-10-2016 12:55:52 > [Indexer] Cleaning up

MongoDB server - huge RAM usage

Hi!

I'm using the indexer on Windows (with a few minor tweaks) gathering data from the start of the stream to around now, which I estimate will take about 26 days and no more than 4 terabytes. However I have a small problem - RAM usage by MongoDB server goes up straight to 99% after about 10 minutes. Do you know if this is caused by a memory leak somewhere in the code or if this is normal for processing jobs of this size?

Thanks and sorry if this is a stupid question. Paul

Any idea why? (can't find log error)

Looks like a nice tool, I've tried on debian 4.7.5.-1 and I'm getting following(also ctrl+c doesn't kill the proces gotta manualy kill nodejs):
2-10-2016 12:22:26 > [Indexer] Connected to MongoDB.
2-10-2016 12:22:26 > [Indexer] Attempting to create or reuse POE_price collection
2-10-2016 12:22:26 > [Indexer] Last chunk ID found
2-10-2016 12:22:26 > [Indexer] Found 0 entries
2-10-2016 12:22:26 > [Indexer] Starting new indexation
2-10-2016 12:22:26 > [Indexer] Downloading compressed data[]
2-10-2016 12:22:31 > [Indexer] Downloaded
2-10-2016 12:22:31 > [Indexer] Extracting data
2-10-2016 12:22:31 > [Indexer] Error occured, retrying
2-10-2016 12:22:33 > [Indexer] Downloading compressed data[]
2-10-2016 12:22:37 > [Indexer] Downloaded
2-10-2016 12:22:37 > [Indexer] Extracting data
2-10-2016 12:22:37 > [Indexer] Error occured, retrying

using nodejs v4.3.1
It's like he is not getting the id or something?

Problem

when i run the indexer i get this spamming -

29-10-2017 6:10:28 > [Indexer] Insert issue mod: Error: ER_LOCK_DEADLOCK: Deadlock found when trying to get lock; try restarting transaction

Windows support

I just tested it, and it works fine on Windows 10?

So am I missing something, or does this indeed work on Windows?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.