antihax / evedata

EVE Data Website

evedata

EVEData.org website

Contact

See @antihax on #devfleet #tweetfleet Slack.

Contributing

You will need Docker for the mock services

Services

Service	Description
Artifice	Task scheduler
Conservator	Integration (discord, slack, ts3, mumble)
Hammer	Main ESI Consumer
KillmailDump	Dumps killmail stream to json files
Nail	Database store
Squirrel	Not used yet. Pulls static data into DB get updates faster.
TokenServer	CCP OAuth2 Caching service
Vanguard	Web Front End
ZKillboard	ZKillboard API and RedisQ Consumer

Setup your environment

1. Fork this repository and clone the fork into gopath/src/github.com/antihax.
2. go get -u ./... in the repository to install dependencies.
3. Run ./mock.sh
4. Run ./test.sh

Before working on your local copy, please use a seperate branch. If there are tests in the package, please make sure you add tests for your work, unless it will hit a public CCP service.

evedata's Issues

Market buy order data incorrect

Your data: http://easycaptures.com/fs/uploaded/1109/8219929470.png
Evemarketer.com data: http://easycaptures.com/fs/uploaded/1109/6843398176.jpg

Which in turn is making all of the LP/ISK items show incorrect values.

Note: The sell orders were correct.

Specific example:
Federation Navy (store), Neural Boost - Basic (item)
Should have a LP/ISK ratio of 682 but it instead shows 1,087.

double sell orders from same toon marked as outbid in station

Hey, thanks for the tools - love them (let me know how to donate isk).

For station trading, if I have a sell order that is running low in supply and will soon be bought out, like lets say 1 left of EMP S, I go ahead and place a new sell order 0.01 isk higher in sell price than the remaining one.

This way I dont run out while Im offline and my customers can happily keep buying.

The only challenge in the Orders tool is that if I have 2 sell orders of the same item, in the same station it marks them both as red - outbid in same station.

Its an inconvenience, I just work around it right now that I figured it out. Not urgent.

Love your tools, happy to support you guys.
Ashioma (ingame)

Using headless services to better handle nsqlookupd

Hey @antihax,

I was just looking through your kube configs and noticed you could clean up the nsq definitions a bit if you want to. Currently you duplicate the kube definitions for nsqlookupd so that you can have unique DNS entries to point at. A simpler solution is using a headless service in front of a stateful deployment.

Example stateful set:

apiVersion: apps/v1beta1
kind: StatefulSet
metadata:
  labels:
    app: nsq
    component: nsqlookupd
  name: nsqlookupd
spec:
  replicas: 3
  selector:
    matchLabels:
      app: nsq
      component: nsqlookupd
  serviceName: nsqlookupd
  template:
    metadata:
      labels:
        app: nsq
        component: nsqlookupd
    spec:
      containers:
      - command:
        - /nsqlookupd
        image: nsqio/nsq:v1.0.0-compat
        imagePullPolicy: Always
        name: nsqlookupd
        ports:
        - containerPort: 4170
          name: tcp
        - containerPort: 4171
          name: http
      terminationGracePeriodSeconds: 5

Example service:

apiVersion: v1
kind: Service
metadata:
  labels:
    app: nsq
    component: nsqlookupd
  name: nsqlookupd
spec:
  clusterIP: None
  ports:
  - name: tcp
    port: 4160
    targetPort: 4160
  - name: http
    port: 4161
    targetPort: 4161
  selector:
    app: nsq
    component: nsqlookupd

Specifically by specifying clusterIP: None we now get what kube calls a "headless service".

This is useful because you can then reference each instance via a DNS entry:

Example nsq deployment:

apiVersion: apps/v1beta1
kind: StatefulSet
metadata:
  labels:
    app: nsq
    component: nsqd
  name: nsqd
spec:
  replicas: 3
  selector:
    matchLabels:
      app: nsq
      component: nsqd
  serviceName: nsqd
  template:
    metadata:
      labels:
        app: nsq
        component: nsqd
    spec:
      containers:
      - command:
        - /nsqd
        - -max-msg-size=9388608
        - -mem-queue-size=1000
        - -data-path
        - /data
        - -lookupd-tcp-address
        - nsqlookupd-0.nsqlookupd:4160
        - -lookupd-tcp-address
        - nsqlookupd-1.nsqlookupd:4160
        - -lookupd-tcp-address
        - nsqlookupd-2.nsqlookupd:4160
        image: nsqio/nsq:v1.0.0-compat
        imagePullPolicy: Always
        name: nsqd
        ports:
        - containerPort: 4150
          name: tcp
        - containerPort: 4151
          name: http

The result is you don't have to repeat the nsqlookupd declarations, you can drop the broadcast IP command line attribute, and things are just a bit nicer.

I use basically the same config above for a few different applications.

Hope that helps! Sorry I don't have time to submit a PR.

War Sync not working

Hey,

It isn't working :(

evemail proxy remarks mails as unread on iOS mail app

I used the mark all as read feature in the app. Then after I refreshed my inbox after a minute it randomly marks mails as unread again. Everytime I refresh the mailbox more mails are marked as unread.

War Contact Synchronization returns 503

https://www.evedata.org/contactSync returns error 503

Not applying war contact sync to character

Hi,

I have tried linking and unlinking all my characters. I have cleared cache on website I really cannot get this to work.

PLEASE HELP.

Happy to pay isk.

[email protected]

pernicious cheese (ingame)

Please help me.

Error adding new characters

When trying to add new character, after going through Eve Auth, returning to website and getting this error:

Error 1406: Data too long for column 'accessToken' at row 1

evemail proxy cannot send mail

I tried sending a mail to one of my alts. I simply put his name into the recipient field, but it gave this error:

Suggestion for Killmail Attribute Browser

Being able to see statistics for the resist profile for various classes/ships would be very useful

Cannot sync war contacts

I have two chars that I want to link for a neutral war alt. The main doesnt work to link with my alt but it works fine in reverse..... which is useless. Whats the issue please? I mean it works with my main listed an as alt but not vice versa.

War Target Sync Error 504

Seem to be getting errors with war-contact sync.

Error 504: Gateway timeout when trying to request after SSO Sign-in
https://www.evedata.org/U/eveSSOAnswer?code=xxx

Followed by:
state does not match. We likely could not read the session cookie. Please make sure cookies are enabled.

War Target Sync is not updating ingame
Response From Server (JSON)

{"source":XXXX,"sourceName":"XXXX","destination":XXXX,"destinationName":"XXXX","characterID":XXXX,"lastError":null,"nextSync":"**2016-10-21T01:57:40Z**"

If that helps in any way. Been over 24 hours and this date has not changed.

Wartarget synchronization bug

I've used the tool to synchronize the wartargets of my main with my alts so its easy for me to go scout for something to shoot, and in 99% of the time it works perfectly.

But this bug has fooled me a few times:
I assist in a war that i allready ongoing. The agressor in this war keeps prolonging the war for a very long time, After 2 weeks my assist will automatically end, and i am no longer involed in the war. But the war is still on, so the synchronization keep setting standings (on my alt-scout) towards the corp i origianlly assisted agains, even tho i am no longer assiasted in agains them.
On my alt-scout the origianl agressors will keep apearing as wartargets as long as the war is still going, no matter if my main-chars corp is involved in the war or not.

Can this be fixed? Is there allready a way to fix this that i have just missed?

Regards,
Linus

Sell orders prices on clipboard can be 50% lower than market

80% Time I am able to undercut most people fine. But 20% time the values that are copied to clipboard are too low and have to manually re-adjust. It assume prices are puled from another service perhaps having it to be checked against multiple services might be ideal.

war contacts not syncing

War targets are not syncing.........at all. I have added characters as required.

503 server is unavailable continually

hey,

So for the last few weeks - it seems that since you added the ads - the several functions are "503 Service Unavailable
No server is available to handle this request. "

Unable to authenticate from Chrome or Edge to Eve authentication across 2 computers. Unable to view market orders.

Im glad your monetizing your site, you deserve it.

isk2lp HTML incorrect syntax

The HTML on https://www.evedata.org/iskPerLP reads:
<option id="24th" imperial="" crusade="">24th Imperial Crusade</option>
but it should be:
<option id="24th imperial crusade">24th Imperial Crusade</option>

This is true for all of the options.

market orders page is unavailable

503 Service Unavailable
No server is available to handle this request.

I love this tool! Please bring it back.... :)

Contacts not syncing

As title reads there is no syncing happening.

LP/Isk store broken

The LP/isk function is completely broken at the moment because it does not take into the account the isk you must put in while buying many items from the LP store.

Example: Federation Navy Command Mindlink in the Federation Navy (Gallente) LP store is listed as an isk cost of 100mil because of the other command links you must buy first. However, the real price is 200mil because in the LP store it costs 100mil AND 100,000 lp. So the true lp/isk is around half of what it's listed as. Around 600 lp/isk not 1800.