spencerkimball / stargazers Goto Github PK

Stargazers was only getting through 60 (2 pages) of our stargazers ☹️

It appears the format of the Link response header may have changed to now include a rel="prev" on pages 2+ which broke the RegEx pattern seen @ fetch/fecth.go#L62. Adding a .* to the RegEx pattern has resolved the issue for me. Will be submitting a PR shortly!

Value of Link header see with 1st Page:

<https://api.github.com/repositories/<repo>/stargazers?page=2>; rel="next", <https://api.github.com/repositories/<repo>/stargazers?page=999>; rel="last"

Value of Link header see with 2+ Pages:

Link: <https://api.github.com/repositories/<repo>/stargazers?page=1>; rel="prev", <https://api.github.com/repositories/<repo>/stargazers?page=3>; rel="next", <https://api.github.com/repositories/<repo>/stargazers?page=999>; rel="last", <https://api.github.com/repositories/<repo>/stargazers?page=1>; rel="first"

Hi, I've been getting the following error for the past couple of days, I originally thought it was because I was hitting the GitHub API limit for the API key I'm using but I no longer think thats the case (you see an actual message from GitHub telling you you hit the API limit for the day)

Here is what I'm seeing:

This 1st part has taken a couple of days to get past the GitHub API limit and is now cached and appears to work as expected:

I160616 22:28:43.982757 cmd/fetch.go:53  fetching GitHub data for repository repo/repo

I160616 22:28:43.983038 fetch/query.go:258  querying stargazers of repository repo/repo
*** 1,687 stargazers

I160616 22:28:45.206165 fetch/query.go:278  querying user info for each of 1,687 stargazers...
*** user info for 1,687 stargazers

I160616 22:28:45.926333 fetch/query.go:292  querying followers for each of 1,687 stargazers...
*** 68,389 followers (43,406 unique) for 1,687 stargazers

I160616 22:28:48.995858 fetch/query.go:320  querying starred repos for each of 1,687 stargazers...
*** 363,191 starred repos (90,747 unique) for 1,687 stargazers

I160616 22:29:43.917686 fetch/query.go:352  querying subscribed repos for each of 1,687 stargazers...
*** 85,739 subscribed repos (80,406 unique) for 1,687 stargazers

Now, this is what I see everytime I get to the point of retrieving the commits for each stargazer:

I160616 22:29:58.653527 fetch/query.go:384  querying contributions to subscribed repos for each of 1,687 stargazers...
*** 5,432 commits from 360 repos (376 qual, 2,331 total) for 24 stargazers
E160616 22:30:01.925974 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:03.852227 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:05.772839 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:07.251432 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:08.789207 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:11.659565 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:13.708287 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:17.708606 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:20.987420 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry
E160616 22:30:25.068810 fetch/fetch.go:117  202 (Accepted) HTTP response; backoff and retry

Occasionally it will throw the following:

E160616 22:30:26.070563 fetch/fetch.go:127  unable to fetch "https://api.github.com/repos/whatwg/html/stats/contributors"

Apologies, if anything here is n00bish, I installed Go for the 1st time to play with this repo 😄

In the moment of this post, last commit was in 2017. GitHub API changed a little. Is there any alternatives?

./stargazers cockroachdb/cockroach --token=f87456b1112dadb2d831a5792bf2ca9a6afca7bc
Error: unknown command "cockroachdb/cockroach" for "stargazers"
Run 'stargazers --help' for usage.
failed running command ["cockroachdb/cockroach" "--token=f87456b1112dadb2d831a5792bf2ca9a6afca7bc"]: unknown command "cockroachdb/cockroach" for "stargazers"

Awesome project, but curious what you plug this data into to analyze it?

Looking at the source for main.go I see an Apache 2.0 header, but there's no LICENSE actually defined for the project itself.

Please update with a LICENSE file in the root of the repository for clarity (and to make sure any other content outside the main.go file is explicitly licensed, not just that one file itself).

Hi, I'm unable to build stargazers:

$ go get github.com/spencerkimball/stargazers
package github.com/cockroachdb/cockroach/util/log: cannot find package "github.com/cockroachdb/cockroach/util/log" in any of:
	/usr/lib/go-1.7/src/github.com/cockroachdb/cockroach/util/log (from $GOROOT)
	/tmp/src/github.com/cockroachdb/cockroach/util/log (from $GOPATH)
package github.com/cockroachdb/cockroach/util: cannot find package "github.com/cockroachdb/cockroach/util" in any of:
	/usr/lib/go-1.7/src/github.com/cockroachdb/cockroach/util (from $GOROOT)
	/tmp/src/github.com/cockroachdb/cockroach/util (from $GOPATH)

Any idea?

Hi - I don't know anything about Go, so it's entirely possible this is pure noobishness on my part. But I could use a touch of documentation beyond what's in the README.MD.

I'm on Ubuntu Trusty 14.04 LTS. Preparatory steps I took:

• cloned the repository
• generated an API key and saved it in ~/git/stargazers.apikey
• apt-get install gccgo gccgo-go

Error message I got:

me@locutus:~/git/stargazers$ go run main.go --repo=jimsalterjrs/sanoid --token=`cat ../stargazers.apikey`
main.go:26:2: cannot find package "github.com/spencerkimball/stargazers/cmd" in any of:
    /usr/src/pkg/github.com/spencerkimball/stargazers/cmd (from $GOROOT)
    ($GOPATH not set)
main.go:27:2: cannot find package "github.com/spf13/cobra" in any of:
    /usr/src/pkg/github.com/spf13/cobra (from $GOROOT)
    ($GOPATH not set)

Clearly it wants the spf13/cobra package as a dependency, and I suppose I could go fetch that, but it also seems to want the files in these projects installed in a hierarchy that doesn't actually exist anywhere. I have a sneaking feeling that rather than trying to manually create a matching hierarchy and move things around and set GOROOT to match my manually created hierarchy, there's something "simple and obvious" I should be doing...

Help, please?

I'm not a go expert, but I have set up:

imiell@rothko:/space/git/stargazers$ env | grep GO
GOBIN=/space/go/bin
GOPATH=/space/go

but get:

imiell@rothko:/space/git/stargazers$ go get
package .
        imports github.com/spencerkimball/stargazers/cmd
        imports github.com/spencerkimball/stargazers/analyze
        imports github.com/cockroachdb/cockroach/util
        imports github.com/gengo/grpc-gateway/runtime
        imports github.com/grpc-ecosystem/grpc-gateway/runtime/internal: use of internal package not allowed

This is go version 1.6.2