Comments (10)
This all sounds good to me @pbinkley so please send the pull requests. FWIW I've half considered creating a new project (twarc-report?) that is oriented around generating a cohesive static report (using d3, bootstrap, etc). If you want to run in that direction I would be willing to help, and it might give you space to think?
from twarc.
I've put in PR #42 for the first item.
I wondered about a new project as well. For my purposes, I think the changes will manifest themselves as a series of utilities like directed.py, which analyze a given twitter file and build a dict or array of values, and then call a method in d3json.py to serialize the values in a format that can be dropped into a given D3 example. They'll also have an HTML template file for immediate viewing. To create a new project would mean moving some of what is currently in twarc/utils over, but that wouldn't be a big deal.
For myself, I'm happy to work in a new project or within the existing one. I wouldn't want to go too far without getting you to look at what I've done, if you have the time, since I'm still learning Python as I go.
from twarc.
twarc-report 👍
from twarc.
You can see where I'm going in my timebar branch, which is almost ready for a PR: https://github.com/pbinkley/twarc/tree/timebar . I've got utils/profile.py to do line-by-line processing of tweets and gather basic stats about the tweet set. Then you extend that in a specific context, in this case in utils/timebar.py, which adds timezone conversion and aggregation of values. Finally, d3json.py (which needs to be renamed - it does csv as well) produces output in different formats. I'm renaming my two D3 html outputs to d3directed and d3times and moved their descriptions to the bottom of the readme.
If this pattern is ok, where would you draw the line between twarc and twarc-report? Where does profiler belong?
from twarc.
This is all super @pbinkley So it sounds like you are leaning towards creating a new github repository for twarc-report? If you do I think you want to make twarc-report stand alone as long as you have some data you collected with twarc (line oriented json) you can play. Does this make sense?
from twarc.
Yes, I think that makes sense. I'd like to transfer ownership of it to @edsu when my current round is done, though, since your long-term commitment to twarc is likely to be more consistent than mine. Does that sound ok? I intend to finish off the D3 timeline bar graph and the co-tag directed graph, and come up with examples of using the data outputs with other D3 examples out there. I'd like to develop the profiler and the D3 data outputs far enough to support these uses, but I'm sure there will be more that others will want to add eventually.
from twarc.
Well, you could transfer ownership -- but I like the idea of you retaining ownership. I can always help maintain it, and the great thing about github is that if issues don't get addressed and people care they can easily fork it right?
from twarc.
OK, OK - we'll try that and see how she goes. Without the edsu brand,
though, it won't get the same level of trust.
Peter Binkley
Digital Initiatives Technology Librarian
Information Technology Services
[email protected]
2-10K Cameron Library
University of Alberta
Edmonton, Alberta
Canada T6G 2J8
phone 780-492-3743
fax 780-492-9243
On 16 January 2015 at 08:29, Ed Summers [email protected] wrote:
Well, you could transfer ownership -- but I like the idea of you retaining
ownership. I can always help maintain it, and the great thing about github
is that if issues don't get addressed and people care they can easily fork
it right?—
Reply to this email directly or view it on GitHub
#41 (comment).
from twarc.
What if there was a 'twarc' Github org?
from twarc.
I've set up https://github.com/pbinkley/twarc-report and copied the current
D3 examples over. They still need work, but the examples work.
An org would work. Let's see how things go for now.
Peter Binkley
Digital Initiatives Technology Librarian
Information Technology Services
[email protected]
2-10K Cameron Library
University of Alberta
Edmonton, Alberta
Canada T6G 2J8
phone 780-492-3743
fax 780-492-9243
On 17 January 2015 at 05:10, Nick Ruest [email protected] wrote:
What if there was a 'twarc' Github org?
—
Reply to this email directly or view it on GitHub
#41 (comment).
from twarc.
Related Issues (20)
- How to use Academic API to search archives with language filters? HOT 2
- How to extract the author user name of a retweet? HOT 1
- Twarc API V2 function to get conversations HOT 1
- Is it possible to use "next_token"? HOT 3
- Missing `variants` field in `media.fields`
- Add `include_ext_is_blue_verified=True`
- CLI: Allow to differentiate between 404 and connection timeout HOT 4
- Have twarc2 400 error while searching phrases. HOT 1
- CLI Errors fail to show for invalid input file
- CLI Errors fail to show for invalid input file HOT 1
- twarc2 timeline --no-context-annotations not pulling 500 tweets HOT 2
- Adding query parameters to search terms imported via .txt? HOT 1
- Is it possible to convert twarc jsnol files to twarc2 jsonl files? HOT 2
- Impossible to specify No expansions at all in CLI.
- Implement new compliance Streams
- Cannot find user_verified_type in the tweet metadata HOT 18
- twarc2 hydrate HOT 2
- twarc2 hydrate freezes at 20% HOT 3
- Client forbidden HOT 3
- Forbidden error after few tweets hydrated (403) HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from twarc.