GithubHelp home page GithubHelp logo

popular-site-subdomains's Introduction

Popular-Site-Subdomains

A list of subdomains for some of the most popular sites on the internet. Made as a result of [this tweet] (https://twitter.com/soaj1664ashar/status/777182478075326464). "Sometimes simple things are ignored".

Why?

There are plenty of reasons why people sometimes want a list of subdomains for a website. Whether you're just curious what type of stuff the company are working on or you want to check for security vulnerabilities, a list of subdomains can really come in handy. Not so long back someone figured out that he could get in to anybody's Facebook account due to a vulnerability that was only there on their very old subdomains.

Contribute

The idea behind this is to let everyone contribute and get a fairly big list of subdomains of all the most popular sites on the internet.

Before opening a pull request, please make sure that:

  • Each domain has its own .txt file, eg. Facebook.com.txt, Facebook.co.uk.txt
  • There are no duplicates in the list
  • The list is in alphabetical order, you could use this site to do that
  • http:// or https:// is not in any of the subdomains (as well as no trailing slashes at the end of the domain)

If you're not sure how you can help out, this site can find subdomains for you but it also includes the IP addresses which we don't really want. What I do is open open the list in Notepad which has subdomains like:

Facebook.com 127.0.0.1

m.Facebook.com 127.0.0.2

Next, to get rid of everything other than just the subdomain do a regex find and replace. Find "[ \t].*" and replace it with "\1"

popular-site-subdomains's People

Contributors

aidanbh avatar drduh avatar jamiefarrelly avatar jimen0 avatar ricardobrg avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

popular-site-subdomains's Issues

Does it make sense to exclude www.?

Unlike http://, www. is not a prefix but a subdomain itself. While it often redirects to the root domain or vice versa, they sometimes do point to different hosts. Also many sites use ww2., ww3., etc. - how does this rule affect them?

Doubt

Which tool did you use to get all these data. Or simply if I may ask, how did you get this much vital information?

Idea: Canocial file names

Hi,
I'd suggest to use a consistent naming scheme. For example domain.tld.txt or so.

Maybe we could even use directories?

$>tree . 
.
├── facebook.com
│   ├── 2015-10-10.txt
│   └── 2016-09-17.txt
└── google.de
    ├── 2013-01-01.txt
    └── 2016-10-01.txt

2 directories, 4 files

That way one could use "git diff" and so on...

Some list items have spaces

for example Uber.com list has

api1.uber.com
api2.uber.com

Not a massive issue but anyone working with the list will parse and clean/trim first before doing any work.

Idea - Have a folder of sites that offer bug bounties

This could be very useful to people looking to find bugs for bug bounties.

Could have a comment at the start of each list with a link to that site's bug bounty page to confirm they actually do offer bug bounties. This would make the repo not just popular site subdomains, but popular site & bug bounty subdomains.

Anyone else think this could improve the repo?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.