docnow / catalog Goto Github PK

Entering a few letters in the search box causes the screen to go blank.

Just a thought: how about a field for number of retrieved tweets after a rehydration job? It could be multi-valued with datestamps, so that as these datasets age we could gauge the mortality rate of tweets in different harvests.

title: iMCD: Twitter Data
creator: Urban Big Data Centre
url: http://ubdc.gla.ac.uk/dataset/imcd-twitter-data
published: 2018 – 10 - 10
added: 2018–10-10T15:59:07Z
tweets: "65,000,000"
dates: 2014-07-01 - 2015-11-30
tags:
iMCD
Glasgow
BetterTogether
CommonWealthGame
GlasgowRoads
Scotnight
Indyref
BBC
VoteYeas
NoThanks
Scotland
Train
Undecided
BBCWestScot
DailyMailUK
OpenGlasgow
MetroUK
description: >
University of Glasgow’s unique Integrated Multimedia City Data (iMCD) Survey is a cross-sectional survey based on a sample of the general population in private residences across eight local authority areas of Glasgow and Clyde Valley. The purpose of the iMCD dataset was to provide a 360° overview of a life in the city, combining various datasets and methods of collection.
The survey fieldwork was run by Ipsos MORI and took place between 15th April 2015 and 21st November 2015. This project was funded by ESRC and it was a result of collaboration across the University of Glasgow, Newcastle and Sheffield. The intention was to provide new innovative datasets with new methods and methodologies that could be used by the policy makers.
iMCD consists of 5 main strands (Survey, GPS, life-logging devices, image analysis, textual media and multimedia data). The core of the iMCD is the Household Survey. Each of the five data strands are built on unique models of data sampling. As a part of the project, we also collected for example a sample of GPS and lifelogging sensors. Lifelogging sensors collected data through GPS devices and wearable cameras. Out of all participants 90 % agreed to carry the sensor device.
Concurrent to the collection of the iMCD Household Survey data UBDC researchers have undertaken a significant information extraction exercise to capture data streams related to Glasgow from a variety of online sources. Twitter data comprises a large part of this collection, and this dataset comprises a selection of tweets during the period 1/12/14 - 30/11/2015 that arose from the greater Glasgow area. This, for example, may give insights into the citizens’ behaviour, reactions and moods in certain contexts or at particular times. The dataset can be queried through a bespoke online tool by specific hashtag or tweet term, in order to return statistical information or specific Tweet IDs. Captured tweets were those geolocated in Glasgow (based on a polygon around the geography), those from certain known Glasgow accounts (e.g. @BBCWestScot; @policescotland) and containing certain terms or hashtags (e.g. glasgow, or #glasgow2014). Please contact us if you wish to receive a step by step guide for 're-hydrating' the tweet ids.
Tweet from Glasgow Users (user object)
BBCWestScot
DailyMailUK
BBCScotWeather
GlasgowCC
Daily_Record
GLA_Airport
WeatherCast_UK
STVGlasgow
glabreakingnews
GreaterGlasgPol
OpenGlasgow
TheEveningTimes
trafficscotland
policescotland
Herald_editor
TheScotsman
scotairquality
GdnScotland
PeopleMakeGLA
EverttHerald
GlasgowSubway
newsundayherlad
EducationScot
TheSunNewspaper
TravelineScot
BBCTravelScot
CBItweets
MetroUK
FristinGlasgow
PeopleMakeGLA
FoEScot gtcs
WhatsOnGlasgow
scdiglobal
edhubSctoland
Heart_Glasgow

Tweet with certain terms or hashtags (entities object)
glasgow
BetterTogether
GlasgowCC
Yougov
glasgow2014
CommonWealthGame
GlasgowRoads
scotnight
indyref
CWG2014
goforitscotland
BBCScotWeather
scotdecides
VoteYes

NoThanks
the45
Scotland
yesScotland
AlexSalmond
CommonWealthGames
NoBecause
VoteNo
Darling
train
undecided
HopeOverFear
PatronisingBTlady

In order to access iMCD: Twitter Data, please get in touch with UBDC
https://www.ubdc.ac.uk/data-services/data-services

Tweet from Glasgow Users (user object)

BBCWestScot
DailyMailUK
BBCScotWeather
GlasgowCC
Daily_Record
GLA_Airport
WeatherCast_UK
STVGlasgow
glabreakingnews
GreaterGlasgPol
OpenGlasgow
TheEveningTimes
trafficscotland
policescotland
Herald_editor
TheScotsman
scotairquality
GdnScotland
PeopleMakeGLA
EverttHerald
GlasgowSubway
newsundayherlad
EducationScot
TheSunNewspaper
TravelineScot
BBCTravelScot
CBItweets
MetroUK
FristinGlasgow
PeopleMakeGLA
FoEScot gtcs
WhatsOnGlasgow
scdiglobal
edhubSctoland
Heart_Glasgow
 
Tweet with certain terms or hashtags  (entities object)
glasgow
BetterTogether
GlasgowCC
Yougov
glasgow2014
CommonWealthGame
GlasgowRoads
scotnight
indyref
CWG2014
goforitscotland
BBCScotWeather
scotdecides
VoteYeas
NoThanks
the45
Scotland
yesScotland
AlexSalmond
CommonWealthGames
NoBecause
VoteNo
Darling
train
undecided
HopeOverFear
PatronisingBTlady

@pbinkley thanks for adding your dataset! I'd be curious to hear how well you thought the process worked.

Also, I noticed that the url for the dataset http://dx.doi.org/10.7939/DVN/10971 sends me to a login page. Is that the intended behavior?

Would appreciate an add to the catalog for these two sets
SaveACA https://dash.ucr.edu/stash/dataset/doi:10.6086/D17P4N
BLMKidnapping https://dash.ucr.edu/stash/dataset/doi:10.6086/D1CC7X

It would be useful to publish an Atom or RSS feed so that people can subscribe for new additions.

In theory the catalog could display download stats from the various repositories where the content is hosted. A plugin system for some popular repositories (Dash, Dataverse, InternetArchive) could be created. This probably presumes that the Catalog is transformed from a Jekyll site to an actual web application.

Should we make a distinction between the two in the metadata?

Should we optionally allow people to add their organization to the metadata for a catalog entry. For example George Washington University?

https://github.com/TScheffler/GermanTwitterApril2013

April 1-30, 2013
German language tweets