USA-RU-CN-IN-IR-SA-LB-QA-BY - Full dataset 2025-03-07
https://www.youpwn.ca/research/pubx/indexof/clown/usa-extracted/
https://www.youpwn.ca/research/pubx/indexof/clown/russia-extracted/
https://www.youpwn.ca/research/pubx/indexof/clown/
update - 2022-08-19
https://www.youpwn.ca/research/pubx/indexof/01Jun2022/
https://www.youpwn.ca/research/pubx/indexof/02Jun2022/
https://www.youpwn.ca/research/pubx/indexof/08Jun2022/
https://www.youpwn.ca/research/pubx/indexof/09Jun2022/
https://www.youpwn.ca/research/pubx/indexof/16Jun2022/
https://www.youpwn.ca/research/pubx/indexof/17Jun2022/
https://www.youpwn.ca/research/pubx/indexof/25Jun2022/
https://www.youpwn.ca/research/pubx/indexof/26Jun2022/
update - 2022-05-30
https://www.youpwn.ca/research/pubx/indexof/
update - 2021-10-11
https://www.youpwn.ca/dataset/2021-09-29/
Public inventory of files available from web site with “directory index/index of” from USA and Canada
Dataset include :
IP, HOST, PORT, file, Organization, ISP, Country, Discover date, SSL-cert-authority, SSL-cert-subject
Only some files extensions and patterns are available.
Exemple :
- file me_json.json is JSON format of all files with extension “.json” discovered
- file me_properties.json is JSON format of all files with extension “.properties” discovered
- file me_sql.json.csv is CSV format of all files with extension “.sql” discovered
Dataset information and link to files : https://www.youpwn.ca/dataset/2021-09-29/
last update : 30 juillet 2021
- Ajout liste d’IP canadien exposant le service RDP
- Inclut : IP, ASN, Organisation, ISP, Certificat (computer name + domain), Nom d’utilisateur (lorsque l’information est disponible)
last update : 21 juillet 2021
- Ajout liste de nom de fichier exposé (Canada)
"Index Of"
identifié par shodan Canada - Ajout liste de nom de fichier exposé (CA - US)
"Index of"
identifié par Rapid7 via le projet opendata - Ajout liste de 2023 nom de domaine associés au Gouvernement du Canada
update : 05 juillet 2021
- Ajout liste de FQDN associée au Gouvernement du Canada
- Ajout liste de FQDN associée à Desjardins
- Ajout liste de 1889 équipements CheckPoint Firewall exposés au canada
Dataset disponibles
1. Données exposées publiquement
1.1 - Liste de nom de fichier accessibles publiquement (indexof) au Canada via shodan
< Lien pour le téléchargement >
Étapes pour générer le dataset :
1. `shodan download --limit -1 canada-indexof-`date +%d%b%Y` 'country:"ca" http.title:"Index of /"'`
2. Extraction du champ http.html
2.1 Pour pouvoir faire des recherches et identifié plus facilement le responsable des données il faut aussi extraire l'addresse IP (ip_str), le port TCP (port), le nom de l'organisation (org), le fournisseur internet (isp), ASN, Hostnames, domains
2.2 Ce dataset public ne contient pas les informations mentionnées au point précédant
3. Conversion du champ http.html et extraction des noms de fichiers avec DAP (https://github.com/rapid7/dap)
4. Recherche dans le champ http.html pour des Nom de fichiers avec une extension qui pourrait contenir des informations sensibles
4.1 extensions : \.sql|\.zip|\.rar|\.7z|\.gz|\.sh|\.tar|\.csv|\.txt|\.tgz|\.ovpn|\.key|\.inc|\.conf|\.xls|\.doc|\.old|\.bz2|\.cfg|\.ini|\.bak|\.pem|\.ps1|\.properties|\.backup|\.ppt|\.xz|\.mdb|\.env|\.inactive|\.db|\.cer|\.p7b|\bkp|\.bash|\.rdp
5. Retrait de certains nom de fichier mal formaté ou contenant des données trop sensibles très facilement identifiables
Il y à un fichier qui semble être à l’intention seulement de certains fan, mais je ne sais pas de quel fanclub il s’agit : OnlyFans (last update - 2021-02-02).rar
1.2 - Liste de nom de fichier accessibles (indexof) Rapid7 Opendata
Liste de nom de domaine
Nom de domaine - Gouvernement du canada
2021-07-21_2023 - 2023 domaines unique - Gouvernement du Canada (partiel)
< Lien pour le téléchargement >
- host.io : (1012) domaine associé au ASN AS2665
- whoxy : (81) reverse whois email = registry@gc.ca
- whosy : (114) reverse whois email = geoffrey.worthing@ssc-spc.gc.ca
- whoxy : (1096) reverse whois company = Shared+Services+Canada
- whoxy : (100) reverse whois name = Shared+Services+Canada
- shodan : (14) domaine associé à 198.103.0.0/16 qui n’était pas identifié avec host.io et whoxy
Nom de domaine - Assurances / banques / finances
- in progress . . .
Nom de domaine - autres
- in progress . . .
Nom de domaine - Partenaires / Fournisseurs du Gouvernement du Québec
- in progress . . .
ASN / Subnet list
- soon . . .
FQDN / HOST list (Subfinder export)
2021-07-05_9 - Gouvernement du Canada (partiel)
< Lien pour le téléchargement >
- 36 965 entrées
- Domaines inclus (9) : gc.ca , canada.ca , cnrc.ca , idrc.ca , rmc.ca , dnd.ca , nrc.ca , bank-banque-canada.ca , cengn.ca
2021-07-05_41 - Desjardins (partiel)
< Lien pour le téléchargement >
- 3 408 entrées
- Domaines inclus (41) : acciranceinsurance.ca , assistanceroutieredesjardins.ca , assurancevoyagedesjardins.ca , avdl.com , caissecentraledesjardins.com , desjardinsagents.com , desjardinsassurancesgenerales.com , desjardinsbank.com , desjardinsbank-mtl.com , desjardinsbank-tor.com , desjardins.com , desjardinsfunds.com , desjardinsinsurance.com , desjardinsroadsideassistance.ca , desjardins-trust.com , dgdom.net , diagents.com , disnat.com , dsf-dfs.ca , dsf-dfs.com , fiduciedesjardins.com , fondsdesjardins.com , gestionpriveedesjardins.com , lapersonnelle.com , mastation-desjardins.com , monetico.ca , mvtcerdesjardins.com , mystation-desjardins.com , rcd-dgp.com , scd-acadie.com , scd-coastcapitalsavings.com , scd-community.com , scd-desjardins.com , scddesjardins.com , sfl.ca , thepersonal.com , visa-desjardins.com , vmd.ca , vmdconseil.ca , votreparcoursmobile.ca , westerndirect.ca
- Le dataset contient plusieurs entrées catchall. Le module qui à détecté l’ensemble de ces entrées est bufferoverrun.
- Ce module permet très rarement d’identifier un FQDN qui ne serait pas déjà connu par un autre module.
Dataset conversion
- soon . . .
Filtered shodan export
2021-07-30_60594 Shodan export - Canada + PORT 3389 (RDP)
< Lien pour le téléchargement >
- 60 594 entrées
- Format : json
- Exemple :
- Une mention spéciale pour “Véhicule 212, incendie” et “DC01.duboisavocats.local”
{
"date": "2021-07-15T00:11:02.347897",
"ip": "173.182.71.83",
"host": [],
"isp": "TELUS Communications Inc.",
"org": "TELUS Communications Inc.",
"ville": "Portage la Prairie",
"domain": [],
"text": "Vehicule 212, Incendie ! JOY eT YAP A R Autre utilisateur",
"issuercn": "VsPorta064.villeShawinigan.net",
"subjectcn": "VsPorta064.villeShawinigan.net",
"data": "Vehicule 212, Incendie ! JOY eT YAP A R Autre utilisateur"
}
{
"date": "2021-07-26T22:26:06.378613",
"ip": "24.37.145.194",
"host": [
"modemcable194.145-37-24.static.videotron.ca"
],
"isp": "Videotron Telecom Ltee",
"org": "Videotron Ltee",
"ville": "Montréal",
"domain": [
"videotron.ca"
],
"text": null,
"issuercn": "DC01.duboisavocats.local",
"subjectcn": "DC01.duboisavocats.local",
"data": "Protocol "
}
{
"date": "2021-07-17T20:53:48.949244",
"ip": "216.113.73.97",
"host": [],
"isp": "Videotron Telecom Ltee",
"org": "Videotron Telecom Ltee",
"ville": "Montréal",
"domain": [],
"text": null,
"issuercn": "STPIERRE.MailletteAvocats.com",
"subjectcn": "STPIERRE.MailletteAvocats.com",
"data": "Protocol "
}
{
"date": "2021-07-13T01:45:31.112070",
"ip": "70.28.88.83",
"host": [
"shbkpq40-1176262739.sdsl.bell.ca"
],
"isp": "Bell Canada",
"org": "Bell Canada",
"ville": "Sherbrooke",
"domain": [
"bell.ca"
],
"text": "Me Guillemett",
"issuercn": "Carole-PC",
"subjectcn": "Carole-PC",
"data": "Me Guillemett"
}
{
"date": "2021-07-21T10:55:47.955035",
"ip": "206.41.95.154",
"host": [
"mail4.letoilebanquenationale.ca"
],
"isp": "Fibrenoire Inc.",
"org": "Fibrenoire Inc.",
"ville": "Montréal",
"domain": [
"letoilebanquenationale.ca"
],
"text": null,
"issuercn": "dns3.lafactrie.com",
"subjectcn": "dns3.lafactrie.com",
"data": "Protocol "
}
2021-07-05_1889 Shodan export - Firewall checkpoint au Canada (après un petit ménage des résultats)
< Lien pour le téléchargement >
- Firewall checkpoint géographiquement au Canada avec le port TCP/264 exposés
- 1 889 entrées
- Fortmat : json
- Exemple :
{
"last_seen": "2021-07-04T04:16:36.415984",
"ip": "207.236.93.34",
"isp": "Bell Canada",
"asn": "AS577",
"org": "Banque Nationale du Canada",
"city": "Montréal",
"firewall_host": "CPFWLAB600",
"smartcenter_host": "bnctresprod-1155-mngnt1",
"reverse_dns": "cccb.ca",
"domains": "cccb.ca"
}
{
"last_seen": "2021-07-03T23:42:34.380731",
"ip": "72.38.233.214",
"isp": "Cogeco Cable",
"asn": "AS7992",
"org": "COGECO COMMUNICATIONS INC.",
"city": "Windsor",
"firewall_host": "wpsfw02",
"smartcenter_host": "secadmin",
"reverse_dns": "ip-214.windsorpolice.ca",
"domains": "windsorpolice.ca"
}
{
"last_seen": "2021-07-03T03:49:44.184116",
"ip": "24.37.80.163",
"isp": "Videotron Telecom Ltee",
"asn": "AS5769",
"org": "Videotron Ltee",
"city": "Châteauguay",
"firewall_host": "GS00FW01",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "modemcable163.80-37-24.static.videotron.ca",
"domains": "videotron.ca"
}
{
"last_seen": "2021-07-02T02:28:52.990300",
"ip": "3.97.39.151",
"isp": "Amazon.com, Inc.",
"asn": "AS16509",
"org": "Amazon Data Services Canada",
"city": "Montréal",
"firewall_host": "GSAWSFW03",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "ec2-3-97-39-151.ca-central-1.compute.amazonaws.com",
"domains": "amazonaws.com"
}
{
"last_seen": "2021-07-01T23:57:57.709643",
"ip": "24.37.80.162",
"isp": "Videotron Telecom Ltee",
"asn": "AS5769",
"org": "Videotron Ltee",
"city": "Châteauguay",
"firewall_host": "GS00FW01",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "modemcable162.80-37-24.static.videotron.ca",
"domains": "videotron.ca"
}
{
"last_seen": "2021-07-01T16:21:45.747327",
"ip": "52.60.236.208",
"isp": "Amazon.com, Inc.",
"asn": "AS16509",
"org": "Amazon Data Services Canada",
"city": "Montréal",
"firewall_host": "GSAWSFW02",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "ec2-52-60-236-208.ca-central-1.compute.amazonaws.com",
"domains": "amazonaws.com"
}
{
"last_seen": "2021-06-30T10:49:49.706471",
"ip": "35.183.190.92",
"isp": "Amazon.com, Inc.",
"asn": "AS16509",
"org": "Amazon Data Services Canada",
"city": "Montréal",
"firewall_host": "GSAWSFW02",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "ec2-35-183-190-92.ca-central-1.compute.amazonaws.com",
"domains": "amazonaws.com"
}
{
"last_seen": "2021-06-23T15:10:21.353957",
"ip": "24.37.80.164",
"isp": "Videotron Telecom Ltee",
"asn": "AS5769",
"org": "Videotron Ltee",
"city": "Châteauguay",
"firewall_host": "GS01FW01",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "modemcable164.80-37-24.static.videotron.ca",
"domains": "videotron.ca"
}
{
"last_seen": "2021-06-23T11:44:20.690175",
"ip": "24.37.108.150",
"isp": "Videotron Telecom Ltee",
"asn": "AS5769",
"org": "Videotron Ltee",
"city": "Montréal",
"firewall_host": "GS03FW01",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "modemcable150.108-37-24.static.videotron.ca",
"domains": "videotron.ca"
}
{
"last_seen": "2021-06-19T06:27:59.817864",
"ip": "35.182.123.154",
"isp": "Amazon.com, Inc.",
"asn": "AS16509",
"org": "Amazon Data Services Canada",
"city": "Montréal",
"firewall_host": "GSAWSFW01",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "ec2-35-182-123-154.ca-central-1.compute.amazonaws.com",
"domains": "amazonaws.com"
}
{
"last_seen": "2021-06-10T18:29:41.631720",
"ip": "173.231.112.242",
"isp": "Fibrenoire Inc.",
"asn": "AS22652",
"org": "Fibrenoire Inc.",
"city": "Montréal",
"firewall_host": "GS00FW02",
"smartcenter_host": "GS00FWM01.gosecure.ca",
"reverse_dns": "IP-173-231-112-242.static.fibrenoire.ca",
"domains": "fibrenoire.ca"
}
{
"last_seen": "2021-07-04T02:45:00.400539",
"ip": "24.212.47.24",
"isp": "Telebec",
"asn": "AS35911",
"org": "Cablevision du Nord de Quebec",
"city": "Val-d'Or",
"firewall_host": "pvldr5-rc000-fw01",
"smartcenter_host": "d00lm01.surete.qc.ca",
"reverse_dns": "cnq47-24.static.cablevision.qc.ca",
"domains": "cablevision.qc.ca"
}
{
"last_seen": "2021-07-04T06:06:04.446098",
"ip": "198.140.134.34",
"isp": "Beanfield Technologies Inc.",
"asn": "AS21548",
"org": "Societe des alcools du Quebec",
"city": "Montréal",
"firewall_host": "ttelfwck02",
"smartcenter_host": "ccdmpsa005.saq.qc.ca",
"reverse_dns": "34-134-140-198.static.cogecodata.net",
"domains": "cogecodata.net"
}
{
"last_seen": "2021-07-03T22:49:16.360529",
"ip": "142.245.84.11",
"isp": "Royal Bank of Canada",
"asn": "AS16730",
"org": "Royal Bank of Canada",
"city": "Toronto",
"firewall_host": "SRBCLEO-P",
"smartcenter_host": "LAB-CMA",
"reverse_dns": "srbcleocp1b.sterbc.com",
"domains": "sterbc.com"
}
{
"last_seen": "2021-07-03T22:37:16.090368",
"ip": "72.139.245.142",
"isp": "Rogers Communications Canada Inc.",
"asn": "AS812",
"org": "Rogers Communications Canada Inc.",
"city": "Toronto",
"firewall_host": "LUMSITEFW01",
"smartcenter_host": "QBCCENFWMGNT.innav.gc.ca",
"reverse_dns": "cpe000c7604dbf6-cm014420100780.cpe.net.cable.rogers.com",
"domains": "rogers.com"
}
{
"last_seen": "2021-07-03T05:27:32.912249",
"ip": "100.42.249.2",
"isp": "EastLink",
"asn": "AS11260",
"org": "Eastlink HSI",
"city": "Dartmouth",
"firewall_host": "FW2200-HFX",
"smartcenter_host": "fwm.corp.crtc.gc.ca",
"reverse_dns": "host-100-42-249-2.public.eastlink.ca",
"domains": "eastlink.ca"
}
{
"last_seen": "2021-07-01T05:48:30.550315",
"ip": "45.33.200.2",
"isp": "SSQ, Societe d'assurance-vie inc.",
"asn": "AS395200",
"org": "SSQ, Societe d'assurance-vie inc.",
"city": "L'Ancienne-Lorette",
"firewall_host": "ssq39",
"smartcenter_host": "ssq36.ssq.local",
"reverse_dns": "ssq39.ssq.ca",
"domains": "ssq.ca"
}
{
"last_seen": "2021-06-27T01:17:22.917517",
"ip": "72.29.227.65",
"isp": "Enmax Envision Inc.",
"asn": "AS25983",
"org": "National Bank",
"city": "Calgary",
"firewall_host": "rupcfcyicor",
"smartcenter_host": "bnctresprod-1155-mngnt1",
"reverse_dns": "a72-29-227-65.sb.shawcable.net",
"domains": "shawcable.net"
}
{
"last_seen": "2021-06-23T10:52:50.121823",
"ip": "24.37.25.6",
"isp": "Videotron Telecom Ltee",
"asn": "AS5769",
"org": "Videotron Ltee",
"city": "Québec",
"firewall_host": "FW2200-MTL",
"smartcenter_host": "fwm.corp.crtc.gc.ca",
"reverse_dns": "modemcable006.25-37-24.static.videotron.ca",
"domains": "videotron.ca"
}
{
"last_seen": "2021-06-20T20:57:43.121012",
"ip": "72.138.180.242",
"isp": "Rogers Communications Canada Inc.",
"asn": "AS812",
"org": "Hewlett-Packard (Canada) Co.",
"city": "Ottawa",
"firewall_host": "cakandfboc003",
"smartcenter_host": "BankOfCanada_Management_Server",
"reverse_dns": "unallocated-static.rogers.com",
"domains": "rogers.com"
}
{
"last_seen": "2021-06-09T21:42:44.143904",
"ip": "45.33.200.1",
"isp": "SSQ, Societe d'assurance-vie inc.",
"asn": "AS395200",
"org": "SSQ, Societe d'assurance-vie inc.",
"city": "Québec",
"firewall_host": "ssq39",
"smartcenter_host": "ssq36.ssq.local",
"reverse_dns": "secure.ssq.ca",
"domains": "ssq.ca"
}
- Untrusted CA
- C2
- CA
- US
- Common misconfiguration - Canada
googler custom search daily public export
- soon …
git* custom search daily public export
- soon …
Spiderfoot public report
- soon …