no3mc / goodreads-dataflow-book-analytics

Goodreads Datasets

Phase Test(pptx) prep

Weekly Journals: No3's

Week 1 ✅ Week 2 ✅ Week 3 ✅ Week 4 ✅ Week 5 ✅

1.0 INTRODUCTION
2.0 SCENARIO

• Goodreads has a web page for each book e.g. https://www.goodreads.com/book/show/5333265
• or each review e.g., https://www.goodreads.com/review/show/2410025795

A subset of Goodreads data has been selected for this coursework. There is data on books, reviews, authors, and genre. Permission was granted to use the data for this coursework from https://sites.google.com/eng.ucsd.edu/ucsdbookgraph/home on condition that the authors’ research papers are referenced (Mengting W. and Julian J. M 2018), (Mengting W et al. 2019). It is not necessary to read these papers to complete this coursework.

3.0 CONNECT, EXTRACT, TRANSFORM AND LOAD DATA (CETL) [15 marks]

• 3.1 Connecting to DMU MongoDB server.
  
• 3.2 Understanding the data.
  
• 3.3 Getting your personalized data.
  

4.0 CLEANING THE COLLECTIONS [20 marks]
5.0 QUERYING THE COLLECTIONS [20 marks]
6.0 IMPLEMENT AND EXPLAIN INDEX FOR THE DATABASE [15 marks]
7.0 RE-DESIGN THE DATABASE USING AGGREGATE DATA MODELLING [20 marks]
8.0 WEEKLY JOURNALS [10 marks]
9.0 DELIVERABLES
10.0 CLOSING COMMENTS