unitedstates / images Goto Github PK

View Code? Open in Web Editor NEW

175.0 34.0 50.0 1.72 GB

Public domain photos of Members of the United States Congress

Home Page: https://theunitedstates.io/images/

License: Creative Commons Zero v1.0 Universal

HTML 1.47% Shell 18.39% Python 80.14%

open-data us-congress congress photos public-domain

images's Introduction

Images of Congress

Public domain images of members of the US Congress.

Using the photos

Photos are available at predictable URLs, by size and Bioguide ID. Photos are served using GitHub Pages.

https://theunitedstates.io/images/congress/[size]/[bioguide].jpg

[size] can be one of:

original - As originally downloaded. Typically, 675x825, but it can vary.
450x550
225x275

[bioguide] must be a Bioguide ID. These are unique IDs for members of Congress, as defined by the Congressional Bioguide. They can be found and connected to many other Congressional datasets, including the partner dataset over at unitedstates/congress-legislators.

Note: Our HTTPS permalinks are provided through CloudFlare's Universal SSL, which also uses "Flexible SSL" to talk to GitHub Pages' unencrypted endpoints. So, you should know that it's not an end-to-end encrypted channel, but is encrypted between your client use and CloudFlare's servers (which at least should dissociate your requests from client IP addresses).

Downloading all images of a particular size

If you want to quickly grab all images of a particular size without cloning the entire repo (and have svn installed), you can just do something like this:

svn checkout https://github.com/unitedstates/images/trunk/congress/225x275

Gathering more photos

This project uses a Python script that scrapes the Government Printing Office's Member Guide for official photos of Members of Congress. You can run the script to find and fetch new photos.

Install dependencies with:

pip install -r requirements.txt

Run the script with:

./scripts/gpo_member_photos.py

Contributing other photos

If GPO doesn't have a photo for someone in their member guide, we may be willing to accept a photo from another source.

In this case, open a ticket, and include:

The name and Bioguide ID of the member of Congress.
A link to the image you're suggesting we incorporate, and to a page that displays that image.
Why you believe the image is definitely official and in the public domain.

Public domain

The photos of members of Congress are from the Government Printing Office, which has assured us that all photos are public domain.

All other files in this project are dedicated to the public domain. As spelled out in CONTRIBUTING:

The project is in the public domain within the United States, and copyright and related rights in the work worldwide are waived through the CC0 1.0 Universal public domain dedication.

All contributions to this project will be released under the CC0 dedication. By submitting a pull request, you are agreeing to comply with this waiver of copyright interest.

images's People

Contributors

Stargazers

Watchers

images's Issues

Make tests pass

The current commit is only passing under Python 2.6 and 2.7:

https://travis-ci.org/hugovk/images/builds/22171589

Now that we're under Travis' watchful eye, we should get the tests to all pass.

Is scripts/missing.py a good idea to run on Travis? It does network downloads, for example. It might be better to have a script which can run more quickly and doesn't tax Travis as much.

Mismatched images for two 112th Congress people

P000149 (this is the ID of the father in a father/son pair but the image is of the son; the son P000604 has the correct image)

J000285 (this is the wrong Tim Johnson)

Official portrait for Joni Ernst - E000295

Bioguide: E000295
Name: Joni Ernst
Image from her Senate website here:
http://www.ernst.senate.gov/sites/default/files/Sen.%20Joni%20Ernst%20-%20Official%20Portrait.jpg

Official portrait for Mike Rounds - R000605

Bioguide: R000605
Name: Mike Rounds
Image provided by his press secretary, Katie Douglas, after emailing a request for the government-made, copyright-free image.

Make script work in new repo

Cloning the YAML from git on demand instead of looking for it nearby
Have it output to the congress/originals directory
Bring over any utils functions it was using

Official portrait for Donald Beyer - B001292

Bioguide: B001292
Name: Donald Beyer
Full source link: https://beyer.house.gov/uploadedphotos/highresolution/353eed9b-2899-47a6-b1c0-5efdfbdee33b.jpg

Metadata
name: Official House Website for Donald Beyer
link: https://beyer.house.gov/about/presskit.htm

Official portrait for Daniel Sullivan - S001198

Bioguide: S001198
Name: Daniel Sullivan
Image provided by his press secretary, Mike Anderson, after emailing a request for the government-made, copyright-free image.

Official portrait for Amata Coleman Radewagen - R000600

Bioguide: R000600
Name: Amata Coleman Radewagen
This image was received after contacting the office. Below is the correspondence with the office:

Please see attachment.

Jared Michael P. Christel
Legislative Correspondent
Congresswoman Aumua Amata C. Radewagen
American Samoa At Large District (AQ00)
1339 Longworth HOB
T: (202) 225-8577
F: (202)225-8757

-----Original Message-----
From: [email protected] [mailto:[email protected]]
Sent: Monday, March 30, 2015 5:05 PM
To: WebForms, RadewagenAQ
Subject: Website Problem

WEB PAGE WITH PROBLEM: https://radewagen.house.gov

NATURE OF PROBLEM:
I can't find Rep. Radewagen's official House portrait. I'm looking to add the government made, copyright free image to a repository of images of members of Congress that others can freely use. Please let me know where I can find this.

Thank you!

Official portrait for John Ratcliffe - R000601

Bioguide: R000601
Name: John Ratcliffe

Metadata
name: High resolution photo provided by Rep. John Ratcliffe's House office over email. Copyright-free status confirmed by a member of his staff.
link: https://ratcliffe.house.gov/press-kit

Official portrait for David Perdue - P000612

Bioguide: P000612
Name: David Perdue
Image from his Senate website here:
http://www.perdue.senate.gov/sites/default/files/DavidPerdueOfficialHeadshot2015.jpg

Official portrait for Bruce Westerman - W000821

Bioguide: W000821
Name: Bruce Westerman
Image from his House website here:
https://westerman.house.gov/media-center/photo-galleries/official-photo-rep-bruce-westerman

Official portrait for Rod Blum - B001294

Bioguide: B001294
Name: Rod Blum

Metadata
name: Photo provided by Rep. Rod Blum's House office over email. Copyright-free status confirmed by a member of his staff.
link: Not available

Add instructions on how to grab a single path

Occasionally for https://github.com/efforg/congress-forms-test we have to pull the latest 225x275 images. Instead of pulling the entire repo with the much larger images, I'm able to use github's support of svn to grab just that path:

svn checkout https://github.com/unitedstates/images/trunk/congress/225x275

You may want to add instructions on how to do this in the README.md

Official portrait for Dave Trott - T000475

Bioguide: T000475
Name: Dave Trott
Full source link: https://trott.house.gov/sites/trott.house.gov/files/documents/Rep.Trott_OfficialPhoto.jpg

Metadata
name: Official House Website for Dave Trott
link: https://trott.house.gov/about/full-biography

Eventually: convert URLs to HTTPS

Adding HTTPS support will make these images usable in secure environments, without mixed content warnings.

We have image URLs on a custom domain right now, which is great for portability (we can easily leave Github) but less good for HTTPS. Github supports HTTPS for Github Pages now, but only for *.github.io domains.

However, Cloudflare may change this game if they offer a free SSL-only plan, as they say they will.

When that time comes, it's worth me putting Cloudflare in front of theunitedstates.io so that we can get an SSL terminator in front of everything, and have things encrypted end to end. I'm dropping this here as a reminder.

Github Pages doesn't support HTTPS

The permalinks to these images are unable to be used by an HTTPS website without throwing mixed content warnings. There's no way to address this with Github Pages.

I'll update the README to encourage HTTPS users to mirror the images on their own rather than use the permalinks, and to write Github support if they think they shouldn't have to do that.

Document setup, add requirements.txt

Make a requirements.txt file with any pip requirements, and document the get-up-and-go process.

Travis CI and Coveralls

I've added a Travis CI build. Everything's in the https://github.com/unitedstates/images/blob/gh-pages/.travis.yml file.

It runs on all available Python versions (2.6, 2.7, 3.2, 3.3 and pypy, with 3.4 coming along any day now). It's allowed to fail for all versions but 2.7. It passes on 2.6 and 2.7 as Python 3 isn't supported yet. (Probably just the prints.)

It then runs the tests, with coverage, and checks for missing images. After a successful build it sends coverage to Coveralls and runs some basic static analysis (pep8, pyflakes).

Both Travis CI and Coveralls are free for open source, and you get reports like this (from my fork):
https://travis-ci.org/hugovk/images
https://coveralls.io/r/hugovk/images

Travis is really handy to check nothing gets broken on on other platforms, for each commit. Coverage isn't so useful as coverage is only 33%, but it doesn't hurt to enable.

I don't see any particular need to show the badges in the README.

Please could you enable Travis CI and Coveralls for this repo?

Official portrait for Cory A. Booker - B001288

Bioguide: B001288
Name: Cory A. Booker

Metadata
name: Photo provided by Booker's Senate office over email. Copyright-free status confirmed in email with Director of Scheduling Unjin Lee and Chief of Staff Matt Klapper.
link: Not available

Official portrait for Steve Knight - K000387

Bioguide: K000387
Name: Steve Knight

Metadata
name: Photo provided by Rep. Steve Knight's House office over email. Copyright-free status confirmed by a member of his staff.
link: Not available

Document public URLs

I've moved the repo to use only the gh-pages branch, so the images will have public URLs. Document these in the README.

Official portrait for Norma Torres - T000474

Bioguide: T000474
Name: Norma Torres
Full source link: https://torres.house.gov/sites/torres.house.gov/files/Official%20Photo.jpg

Metadata
name: Official House Website for Norma Torres
link: https://torres.house.gov/about/full-biography

Official portrait for Gwen Graham - G000575

Bioguide: G000575
Name: Gwen Graham
Full source link: https://graham.house.gov/sites/graham.house.gov/files/featured_image/Graham%20Headshot.jpg

Metadata
name: Official House Website for Gwen Graham
link: https://graham.house.gov/about/full-biography

Error

I'm running this:

python scripts/gpo_member_photos.py

Getting this:

Traceback (most recent call last):
  File "scripts/gpo_member_photos.py", line 393, in <module>
    member_links = get_front_page(br, args.congress, args.delay)
  File "scripts/gpo_member_photos.py", line 63, in get_front_page
    br.select_form(nr=0)
  File "/usr/local/lib/python2.7/site-packages/mechanize/_mechanize.py", line 524, in select_form
    raise FormNotFoundError("no form matching "+description)
mechanize._mechanize.FormNotFoundError: no form matching nr 0

I'm on a Mac. I don't speak Python.

Official portrait for Ryan Costello - C001106

Bioguide: C001106
Name: Ryan Costello
Full source link: https://costello.house.gov/sites/costello.house.gov/files/styles/congress_image_medium/public/wysiwyg_uploaded/PA06-Costello-officialphoto.jpg?itok=egcbIqY9

Metadata
name: Official House Website for Ryan Costello
link: https://costello.house.gov/about

Do the initial loading of images from GPO

The congress directory is empty!

New member low-res b&w photos

There's no telling when new Members of Congress will get photos on the memberguide site. It could be soon or it could be far off. In the meanwhile, someone could scrape:

http://www.gpo.gov/fdsys/browse/collection.action?collectionCode=GPO&browsePath=Congressional+Pictorial+Directory%2F114th+Congress&isCollapsed=false&leafLevelBrowse=false&isDocumentResults=true&ycord=0

Which has not-very-high-res black and white photos of new members. I used to scrape these PDFs by hand. It was the WORST thing ever. But it's there.

Official portrait for David Young - Y000066

Bioguide: Y000066
Name: David Young
Full source link: https://davidyoung.house.gov/sites/davidyoung.house.gov/files/documents/DEY%20Headshot.jpg

Metadata
name: Official House Website for David Young
link: https://davidyoung.house.gov/about/full-biography

Official portrait for Will Hurd - H001073

Bioguide: H001073
Name: Will Hurd
Full source link: http://hurd.house.gov/sites/hurd.house.gov/files/official.jpg

Metadata
name: Official House Website for Will Hurd
link: https://hurd.house.gov/about/full-biography

Official portrait for Pete Aguilar - A000371

Bioguide: A000371
Name: Pete Aguilar
Full source link: https://aguilar.house.gov/sites/aguilar.house.gov/files/styles/congress_image_medium/public/wysiwyg_uploaded/Headshot_0.jpg

Metadata
name: Official House Website for Pete Aguilar
link: https://aguilar.house.gov/about/full-biography

Adding credit files to each image

If we want to include images from other sources, we should add metadata to each image with source information. Might be YAML like:

name: GPO Member Guide
link: http://memberguide.gpo.gov

Fill Obama Placeholder

http://www.askthem.io/people/52ec1a78ec8d83e492000003

Update license description to explain status of photos

We're not dedicating those photos to the public domain - they already exist in it, as confirmed by GPO.

Official portrait for Cresent Hardy - H001070

Bioguide: H001070
Name: Cresent Hardy
Image from his House website here:
http://hardyforms.house.gov/uploadedphotos/highresolution/88cea7de-ed95-44e1-9983-958eec980686.jpg

Where can I find a list of members missing images?

I notice a lot of members post full resolution color images on their .gov sites. I'd like to help track down images to fill the gaps in coverage from the GPO source.

Also could be useful to have a list of members whose images are just the black and white versions.

The to do list:

Missing Image: C001102

Curtis Clawson. Looks like he has only been in office for ~ 3 months.

Official portrait for Buddy Carter - C001103

Bioguide: C001103
Name: Buddy Carter

Metadata
name: Photo provided by Rep. Buddy Carter's House office over email. Copyright-free status confirmed by a member of his staff.
link: Not available

Missing images: B001288

It seems that the image for Cory Booker - B001288 is missing.

Official portrait for Bradley Mark Walker - W000819

Bioguide: W000819
Name: Bradley Mark Walker

Metadata
name: Photo provided by Rep. Walker's House office over email. Copyright-free status confirmed by a member of his staff.
link: Not available

Official portrait for Brian Babin - B001291

Bioguide: B001291
Name: Brian Babin

Metadata
name: Photo provided by Rep. Brian Babin's House office over email. Copyright-free status confirmed by a member of his staff.
link: Not available

Official portrait for Donald Norcross - N000188

Bioguide: N000188
Name: Donald Norcross
Full source link: https://norcross.house.gov/sites/norcross.house.gov/files/RepDonaldNorcross-official.jpg

Metadata
name: Official House Website for Donald Norcross
link: http://norcross.house.gov/about/full-biography

Official portrait for Mark DeSaulnier - D000623

Bioguide: D000623
Name: Mark DeSaulnier
Full source link: https://desaulnier.house.gov/sites/desaulnier.house.gov/files/styles/congress_image_medium/public/wysiwyg_uploaded/MD%20Portrait.jpg

Metadata
name: Official House Website for Mark DeSaulnier
link: https://desaulnier.house.gov/about

Update script for 114th congress

By default the script is searching for the 113rd congress. It should be changed to 114 by default in:

    parser.add_argument(
        '-n', '--congress', default='113',
        help="Congress session number, for example: 110, 111, 112, 113")

But when running on the 114, it doesn't find any links:

$ python scripts/gpo_member_photos.py -n 114
Updating the congress-legislators repo...
The system cannot find the path specified.
Submit congress session number: 114
Links: 0
Found a total of 0 member links

---
Didn't resolve Bioguide IDs: 0
Welcome to Git (version 1.9.5-preview20141217)


Run 'git help git' to display the help index.
Run 'git help <command>' to display help for specific commands.
Silently Installing...
mkdir: cannot create directory `congress/225x275': File exists
mkdir: cannot create directory `congress/450x550': File exists

Official portrait for Ken Buck - B001297

Bioguide: B001297
Name: Ken Buck
Full source link: https://buck.house.gov/sites/buck.house.gov/files/wysiwyg_uploaded/2014-11-14_knb_0128.jpg

Metadata
name: Official House Website for Ken Buck
link: https://buck.house.gov/official-photo

To do: find the full-sized color official portraits for these members

This is a list of members currently in /unitedstates/images that have black and white, small or otherwise subpar images that were taken from the GPO's New Member Pictorial Directory: 114th Congress. More background here.

I'd like to improve these images one-by-one. It'll probably take some time, but it's worth having high quality encyclopedic portraits of members trickling down to all the end users of this repo.

A000370 - Alma Adams - http://adams.house.gov - See issue #87

A000371 - Pete Aguilar - https://aguilar.house.gov - See issue #50

A000372 - Rick Allen - https://allen.house.gov - See issue #40

A000373 - Brad Ashford - https://ashford.house.gov - See issue #100

A000374 - Ralph Abraham - https://abraham.house.gov - See issue #89

B001291 - Brian Babin - https://babin.house.gov - See issue #65

B001292 - Donald Beyer - https://beyer.house.gov - See issue #41

B001293 - Mike Bishop - https://mikebishop.house.gov - See issue #104

B001294 - Rod Blum - https://blum.house.gov - See issue #59

B001295 - Mike Bost - https://bost.house.gov - See issue #69

B001296 - Brendan Boyle - https://boyle.house.gov - See issue #70

B001297 - Ken Buck - https://buck.house.gov - See issue #42

C001103 - Buddy Carter - https://buddycarter.house.gov - See issue #64

C001105 - Barbara Comstock - https://comstock.house.gov - See issue #43

C001106 - Ryan Costello - https://costello.house.gov - See issue #44

C001107 - Carlos Curbelo - https://curbelo.house.gov - See issue #77

D000623 - Mark DeSaulnier - https://desaulnier.house.gov - See issue #51

D000624 - Debbie Dingell - https://debbiedingell.house.gov - See issue #91

E000294 - Tom Emmer - https://emmer.house.gov - See issue #45

G000574 - Ruben Gallego - https://rubengallego.house.gov - See issue #72

G000575 - Gwen Graham - https://graham.house.gov - See issue #46

G000576 - Glenn Grothman - https://grothman.house.gov - See issue #76

G000577 - Garret Graves - https://garretgraves.house.gov - See issue #78

H001070 - Cresent Hardy - https://hardy.house.gov - See issue #36

H001071 - Jody Hice - https://hice.house.gov - See issue #88

H001072 - French Hill - https://hill.house.gov - See issue #90

H001073 - Will Hurd - https://hurd.house.gov - See issue #60

J000297 - Evan Jenkins - https://evanjenkins.house.gov - See issue #105

K000386 - John Katko - https://katko.house.gov - See issue #74

K000387 - Steve Knight - https://knight.house.gov - See issue #61

L000581 - Brenda Lawrence - https://lawrence.house.gov - See issue #98

L000582 - Ted Lieu - https://lieu.house.gov - See issue #94

L000583 - Barry Loudermilk - https://loudermilk.house.gov - See issue #63

L000584 - Mia Love - https://love.house.gov - See issue #103

M001193 - Tom MacArthur - https://macarthur.house.gov - See issue #71

M001194 - John Moolenaar - https://moolenaar.house.gov - Waiting on form, press sec, chief of staff, legislative director or scheduler email response. Also called his DC office and they said they would send the photo...

M001195 - Alex Mooney - https://mooney.house.gov - See issue #92

M001196 - Seth Moulton - https://moulton.house.gov - See issue #97

M001197 - Martha McSally - https://mcsally.house.gov - See issue #75

N000188 - Donald Norcross - http://norcross.house.gov - See issue #47

N000189 - Dan Newhouse - https://newhouse.house.gov - See issue #79

P000609 - Gary Palmer - https://palmer.house.gov - See issue #80

P000610 - Stacey Plaskett - https://plaskett.house.gov - See issue #96

P000611 - Bruce Poliquin - https://poliquin.house.gov - See issue #82

R000601 - John Ratcliffe - https://ratcliffe.house.gov - See issue #62

R000602 - Kathleen Rice - https://kathleenrice.house.gov - Waiting on official portrait to be taken.

R000603 - David Rouzer - https://rouzer.house.gov - See issue #84

R000604 - Steve Russell - https://russell.house.gov - See issue #68

S001196 - Elise Stefanik - https://stefanik.house.gov - See issue #56

T000473 - Mark Takai - https://takai.house.gov - See issue #102

T000474 - Norma Torres - https://torres.house.gov - See issue #48

T000475 - Dave Trott - https://trott.house.gov - See issue #49

W000819 - Bradley Mark Walker - https://walker.house.gov - See issue #67

W000820 - Mimi Walters - https://walters.house.gov - See issue #95

W000821 - Bruce Westerman - https://westerman.house.gov - See issue #38

W000822 - Bonnie Watson Coleman - https://watsoncoleman.house.gov - See issue #81

Y000066 - David Young - https://davidyoung.house.gov - See issue #53

Z000017 - Lee Zeldin - https://zeldin.house.gov - See issue #101

Z000018 - Ryan Zinke - https://zinke.house.gov - See issue #83