city-bureau / city-scrapers-det Goto Github PK

URL: https://www.descmiworks.com/about-us/public-meetings/
Spider Name: det_employment_solutions
Agency Name: Detroit Employment Solutions Corporation

See the contribution guide for information on how to get started

Some information will need to be parsed from PDFs, so it could be useful to look at chi_human_relations for an example of how to handle this

Migrated from City-Bureau/city-scrapers#856

Spider Info:

URL: https://www.glwater.org/events
Spider Name: det_great_lakes_water_authority
Agency Name: Great Lakes Water Authority

Issue/problem:

Spider is using a deprecated events page which has outdated meeting data: https://glwater.legistar.com/Calendar.aspx

^The above link is a Legistar page, whereas the new Great Lakes Water Authority events page uses a Wordpress Tribe Events Calendar.

Intended fix:

The first fix will just move support over to the new events page. A subsequent fix can move the Wordpress Tribe Events Calendar logic to a standalone module/mixin to be shared across spiders/scrapers, even possibly across repos (i.e. moved to city-scrapers_core).

STATUS:

I've already started a fix (@s-j-b), will push a PR and update tests.

affected spiders

• det_brownfield_redevelopment_authority.py
• det_downtown_development_authority.py
• det_economic_development_corporation.py
• det_eight_mile_woodward_corridor_improvement_authority.py
• det_local_development_finance_authority.py
• det_neighborhood_development_corporation.py
• det_next_michigan_development_corporation.py

proposed solution

short term: scrape the embedded yoast schema graph to graph the information
long term: create a new mixin using the wordpress events calendar API as mentioned in #22

status

i created a branch in my fork and updated the scraper to parse the yoast schema graph; however, the tests are failing. I'm unsure if it is imperative to fix the tests since we plan to overhaul the mixin in the near future anyway.

it's also unclear to me the exact purpose of _parse_prev_meetings() but it doesn't seem to be broken so i have not modified it.

URL: https://www.metroairport.com/business/about-wcaa/board
Spider Name: wayne_airport_authority
Agency Name: Wayne County Airport Authority

See the contribution guide for information on how to get started

Migrated from City-Bureau/city-scrapers#849

wayne_local_emergency_planning needs to be fixed

URL: https://bog.wayne.edu/
Spider Name: wayne_state_university
Agency Name: Wayne State University
Meeting Title: Board of Governors

See the contribution guide for information on how to get started

Migrated from City-Bureau/city-scrapers#848

wayne_local_emergency_planning needs to be fixed

URL: http://www.drcfa.org/upcoming-meetings
Spider Name: det_regional_convention
Agency Name: Detroit Regional Convention Facility Authority

See the contribution guide for information on how to get started

Migrated from City-Bureau/city-scrapers#850