skylerburger / apis_and_scrapers Goto Github PK

Move the demonstration code for your classes out of an 'if name:' block and into the scraper's associated notebook file. Add the demonstration of the class underneath the initial exploration code for the scraper.

Reorganize the repo so files that interact with the same subject material (Wikipedia, YouTube, AdultSwim, etc.) are within the same directory instead of organized by language and file type. This make navigation and exploration easier from the top of the repo.

Currently you have a builder and class the model a single AdultSwim show. Compose a builder and class that models the AdultSwim Show Collection. This would allow a client to view available shows and then request further information regarding a specific show. Requesting further information about a specific show would trigger the creation of an AdultSwimShow object.

To Create:

• AdultSwimCollectionBuilder
• AdultSwimCollection

The instagram_scraper notebook has a link to the insta_builder module that is broken.

• Direct the link to the associated page on GitHub
• Add similar link to the adulswim_scraper notebook

Instagram has changed how they preview profile pages to users that have not logged in. The page used to automatically scroll and bring up new content, there is now a 'see more' button that needs to be clicked before this automatic loading takes place. Find a way to locate and click the button with Selenium before proceeding with your scrolling algorithm.