Domainia helps to find subdomains, DNS records, IP addresses, SSL Certificates, HTTP info, etc. of domain by doing the passive reconnaissance.
Home Page: https://irsec.eu
License: MIT License
User APIs like https://haveibeenpwned.com/API/v3
fingerprint
city
state
Let API calls go for more than one API key.
'dns_servers': [
'8.8.8.8', '8.8.4.4', # Google
'9.9.9.9', '149.112.112.112', # Quad9
'208.67.222.222', '208.67.220.220', # OpenDNS
'1.1.1.1', '1.0.0.1', # Cloudflare
'185.228.168.9', '185.228.169.9', # CleanBrowsing
'76.76.19.19', '76.223.122.150', # Alternate DNS
'94.140.14.14', '94.140.15.15', # AdGuard DNS
'8.26.56.26', '8.20.247.20', # Comodo
'84.200.69.80', '84.200.70.40', # DNSWatch
'76.76.2.0', '76.76.10.0', # Control-D
],
Currently, the code gets the situation like this (for instance canonical):
<link rel="canonical" href="https://yoast.com/wordpress-seo/" />
While Google has another order.
<link href="https://support.google.com/analytics/answer/9539598?hl=en" rel="canonical">
If the number of domains is increased, scans might be seen malicious, having an option to delay between scans will help
In both of these conditions, the http_header is empty:
[+]──┬── http://xxxxxxxxxxxxxxxx (8/342 - 2%) [2023-11-19 10:18:56]
│
├─── General Info
│ └□ General Site Status function is calling
│ ├─1─■ Could not parse the HTML page.
│ ├─2─■ HTTP Status Code: 403
│ ├─3─■ History: []
│ ├─4─■ HTTP Headers: {'Date': 'Sun, 19 Nov 2023 09:19:00 GMT', 'Server': 'Apache', 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'sameorigin', 'X-XSS-Protection': '1; mode=block', 'Referrer-Policy': 'same-origin', 'Content-Length': '199', 'Keep-Alive': 'timeout=5, max=100', 'Connection': 'Keep-Alive', 'Content-Type': 'text/html; charset=iso-8859-1'}
│ ├─5─■ Request Result: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>403 Forbidden</title>
</head><body>
<h1>Forbidden</h1>
<p>You don't have permission to access this resource.</p>
</body></html>
OR
[+]──┬── http://xxxxxxxxxxxxxxxx (128/342 - 37%) [2023-11-19 10:18:56]
│
├─── General Info
│ └□ General Site Status function is calling
│ ├─1─■ Error in establishing the connection to the General Site Status function URL.
│ ├─3─■ Status Code: 0 - API call URL: http://xxxxxxxxxxxxxxxx
│ ├─5─■ Exception Message: <class 'requests.exceptions.ConnectTimeout'> ➜ url_opener.py:57 == File "\url_opener.py", line 57, in url_opener
request = requests.get(
File "\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\requests\api.py", line 73, in get
return request("get", url, params=params, **kwargs)
File "\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\requests\api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\requests\sessions.py", line 587, in request
resp = self.send(prep, **send_kwargs)
File "\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\requests\sessions.py", line 701, in send
r = adapter.send(request, **kwargs)
File "\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\requests\adapters.py", line 553, in send
raise ConnectTimeout(e, request=request)
⚊ HTTPConnectionPool(host='www.hendrik-ido-ambacht.nl', port=80): Max retries exceeded with url: / (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x000001AE9CB38550>, 'Connection toxxxxxxxxxxxxxxxx timed out. (connect timeout=11)'))
Output:
{'city': 'xxxxxxxxxxxxxxxx',
'state': '',
'country': 'NL',
'scan_date': '2023-11-19 10:18:56',
'urn': 'http://xxxxxxxxxxxxxxxx',
'hostname': None,
'http': {
'meta': {},
'http_headers': [
{'name': 'NON_EXITSTING_CSP', 'value': ''}
],
'redirects': [],
'analytics': {},
'csp_nonces': [],
'csp_hashes': []
},
'elapsed_time': '0:00:11.110998'
},i.e.
https://github.com/1N3/Goohak/blob/master/goohak
https://duckduckgo.com/html/?q=site:%s -site:www.%s
http://www.bing.com/search?q=site:%s
https://github.com/internetarchive/wayback/blob/master/wayback-cdx-server/README.md
http://web.archive.org/cdx/search/cdx?url=*.archive.org/*&output=json&output=json
# data range
&from=2014&to=2014
# read from the list, -N the last N results
&limit=-1
# remove duplications
&collapse=digest
# add a varible to show if the entry is duplicated or not
# 0 is either the first entry or no duplication
# 1 duplicated
&showDupeCount=true
Domain and IP Reports
https://www.virustotal.com/vtapi/v2/domain/report?apikey=<apikey>&domain=<domain>Example
Port 80
HTTP/1.1 301 Moved Permanently
Date: Wed, 14 Sep 2022 05:00:46 GMT
Connection: close
Cache-Control: max-age=3600
Expires: Wed, 14 Sep 2022 06:00:46 GMT
Location: https://irsec.eu/
Report-To: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=VLh3DuwpZHELKsnKcZK7sOuMSTLyIfOmCJpaTp%2B42Q6516EGenPdvFQnpfsOr4NJ%2FrpRNqtKXSBGI3TxSqOWQa2f3RhOhdTzITLxIV4MIblxh2IdjGvyescisw%3D%3D"}],"group":"cf-nel","max_age":604800}
NEL: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
Server: cloudflare
CF-RAY: 74a68f95aa55e8fd-DFW
alt-svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Find a solution to validate DKIM uses CNAME, e.g. gm1._domainkey as a CNAME to gandi.net.
Some other are listed here: https://topdeliverability.com/email-service-providers-handbook/
Google UA, Robots, Twitter, etc.
user frameworks like Crimeflare
requests.get(url=base_url, headers={'User-Agent':'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.1'})check the reputation of the IP and the domain
There are cases that the domain has schema, e.g. https:// or is a URL rather than a domain.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.