Breakdown the dataset by country and store them accordingly

Signed-off-by: Sudheesh Singanamalla <[email protected]>

README.md

@@ -7,7 +7,8 @@ Measuring the Long Tail of Government https Adoption"
 The dataset is present in `dataset.csv` and includes the whitelist of the websites
 which were obtained as a part of the whitelist process both manually and crowdsourcing 
 using Mechanical Turk. The countries and their domain country codes are available in
-`country-extensions.csv` file.
+`country-extensions.csv` file. A breakdown of the same dataset split by country is available
+in the `country/` directory.
 
 
 ### Accept the Risk and Continue: Measuring the Long Tail of Government https Adoption
@@ -38,3 +39,13 @@ Accept the Risk and Continue: Measuring the Long Tail of Government https Adopti
 Measurement Conference (IMC ’20), October 27–29, 2020, Virtual Event, USA. ACM, New York, NY, USA, 
 21 pages. https://doi.org/10.1145/3419394.3423645
 ```
+
+Want to help us curate more government websites to the dataset? Please send a pull request.
+
+---
+
+Note: The filters applied in the process of curation of this dataset could include entries which 
+are very intentionally close to official government extensions eg. `abcgov.us` instead of `abc.gov.us` as 
+indicated in the paper. We do our best to filter them (eg. `trivago.ccTLD` which matches `go.ccTLD` extensions)
+in our analysis in the paper but some errors could have crept in. We however leave these entries in this dataset
+as is and do not remove them for any future work on phishing detections.

country/Afghanistan/af.csv

@@ -0,0 +1,186 @@
+hostnames
+afghanpost.gov.af
+old.ara.gov.af
+www.commerce.gov.af
+acaa.gov.af
+gdpa.gov.af
+www.molsa.gov.af
+nrap.gov.af
+customs.gov.af
+www.aop.gov.af
+atra.gov.af
+www.crida.gov.af
+www.rmncah-moph.gov.af
+mail.gov.af
+ago.gov.af
+old.moe.gov.af
+gbcp.gov.af
+www.moew.gov.af
+old.mobta.gov.af
+old.ago.gov.af
+mowa.gov.af
+eforms.ard.gov.af
+mudh.gov.af
+mew.gov.af
+dailies.gov.af
+www.gmic.gov.af
+sto.ard.gov.af
+legacy.npa.gov.af
+molsamd.gov.af
+mcit.gov.af
+moe.gov.af
+transparency.mom.gov.af
+policymof.gov.af
+www.mfa.gov.af
+mis.pcu-mew.gov.af
+aop.gov.af
+iecc.gov.af
+igdk.gov.af
+postalcode.afghanpost.gov.af
+flge.gov.af
+rmncah-moph.gov.af
+webmail.moec.gov.af
+kdrah.gov.af
+momp.gov.af
+ku.gov.af
+old.igdk.gov.af
+www.cbr.gov.af
+dadafghanistan.gov.af
+www.asan.gov.af
+mohe.gov.af
+www.muda.gov.af
+passport.afghanpost.gov.af
+moi.gov.af
+apra.gov.af
+cost.wrd-mew.gov.af
+webmail.moj.gov.af
+sbps.budgetmof.gov.af
+old.molsa.gov.af
+www.mof.gov.af
+old.morr.gov.af
+mrrd.cms.gov.af
+president.gov.af
+old.moi.gov.af
+moj-hrsu.gov.af
+www.mopw.gov.af
+iarcsc.gov.af
+rate.afghanpost.gov.af
+www.ago.gov.af
+mrrd.gov.af
+ldmoe.gov.af
+passport.asan.gov.af
+mfa.gov.af
+ncmis.dgsd.gov.af
+ardes.ard.gov.af
+erecruitment.nsia.gov.af
+asan.gov.af
+amc.gov.af
+mopw.gov.af
+www.npa.gov.af
+www.dab.gov.af
+old.moec.gov.af
+www.molsamd.gov.af
+ceo.gov.af
+data.gov.af
+tveta.gov.af
+old.dab.gov.af
+old.mof.gov.af
+nsia.gov.af
+old.iecc.gov.af
+ard.mof.gov.af
+webmail.igdk.gov.af
+webmail.mot.gov.af
+ppp.mof.gov.af
+moci.gov.af
+ara.gov.af
+dab.gov.af
+dewae.mcit.gov.af
+andc.gov.af
+old.mowa.gov.af
+sao.gov.af
+neis.nepa.gov.af
+online.dab.gov.af
+www.red-mew.gov.af
+mod.gov.af
+moec.gov.af
+www.mcit.gov.af
+gmic.gov.af
+molsa.gov.af
+pmis.mopw.gov.af
+bec.mof.gov.af
+old.gdpes.gov.af
+cp.km.gov.af
+www.budgetmof.gov.af
+ibtikaar.mcit.gov.af
+www.moi.gov.af
+ngo.gov.af
+www.asanwazifa.gov.af
+old.mot.gov.af
+npa.gov.af
+track.afghanpost.gov.af
+www.mrrd.gov.af
+www.econsulate.gov.af
+morr.gov.af
+mot.gov.af
+old.mohia.gov.af
+mail.mcit.gov.af
+ansa.gov.af
+www.president.gov.af
+old.moic.gov.af
+cso.gov.af
+www.dcda.crida.gov.af
+fintraca.gov.af
+letters.ard.gov.af
+moj.gov.af
+training.mcit.gov.af
+old.mod.gov.af
+webmail.mew.gov.af
+old.mrrd.gov.af
+onlineapp.momp.gov.af
+old.mew.gov.af
+www.thekabultimes.gov.af
+passport.moi.gov.af
+moic.gov.af
+www.aglibrary.gov.af
+projects.mrrd.gov.af
+arbm-mew.gov.af
+idlg.gov.af
+jobs.supremecourt.gov.af
+www.nsia.gov.af
+www.afghanexperts.gov.af
+mudl.gov.af
+andma.gov.af
+ard.gov.af
+budgetmof.gov.af
+old.mail.gov.af
+mmd.gov.af
+old.supremecourt.gov.af
+firstlady.gov.af
+treasury.gov.af
+moph-dw.gov.af
+webmail.afghanpost.gov.af
+www.mew.gov.af
+lta.mot.gov.af
+aris.morr.gov.af
+kandahar.gov.af
+mof.gov.af
+www.dari.moe.gov.af
+www.geneva.mof.gov.af
+jobs.mcit.gov.af
+wrd-mew.gov.af
+old.moph.gov.af
+rmis.ard.gov.af
+mcn.gov.af
+old.moj.gov.af
+customs.mof.gov.af
+old.afghanpost.gov.af
+pmis.mot.gov.af
+old.mcit.gov.af
+www.prd.gov.af
+www.hoa.gov.af
+mohia.gov.af
+moph.gov.af
+www.mohe.gov.af
+www.moj.gov.af
+ocs.gov.af
+www.superemecourt.gov.af

country/Albania/al.csv

@@ -0,0 +1,107 @@
+hostnames
+gjk.gov.al
+mfa.gov.al
+instat.gov.al
+webgis.atp.gov.al
+arsimi.gov.al
+financa.gov.al
+ipsis.gov.al
+www.dppm.gov.al
+drejtesia.gov.al
+opendata.gov.al
+nasri.gov.al
+mb.gov.al
+e-inspektimi.gov.al
+www.arsimi.gov.al
+mod.gov.al
+geoportal.asig.gov.al
+www.gcaa.aero/portal
+www.tatime.gov.al
+www.gjykatafier.gov.al
+rnsh.drejtesia.gov.al
+mail.dogana.gov.al
+www.avokatipopullit.gov.al
+ata.gov.al
+gjykatavlore.gov.al
+www.tirana.gov.al
+www.sara.qkev.gov.al
+kpp.gov.al
+www.avokaturashtetit.gov.al
+qbd.gov.al
+arkiva.gov.al
+pp.gov.al
+kkk.gov.al
+www.gjk.gov.al
+qkr.gov.al
+gjykataelarte.gov.al
+samiti.diaspora.gov.al
+www.gjykatashkoder.gov.al
+fr.ata.gov.al
+aluizni.gov.al
+www.mfa.gov.al
+aida.gov.al
+www.justice.gov.al
+app.gov.al
+ualbania.arsimi.gov.al
+www.diaspora.gov.al
+shcba.gov.al
+instatgis.gov.al
+konsultimipublik.gov.al
+www.moi.gov.al
+e-albania.gov.al
+www.aspa.gov.al
+qsha.gov.al
+tirana.gov.al
+dogana.gov.al
+www.pp.gov.al
+www.zabgj.gov.al
+qbz.gov.al
+diaspora.gov.al
+www.kpp.gov.al
+khmgj.durres.gov.al
+www.akp.gov.al
+efiling.tatime.gov.al
+www.ata.gov.al
+pronashteterore.gov.al
+gjykatatirana.gov.al
+qkb.gov.al
+vd.ashk.gov.al
+www.zhvillimiurban.gov.al
+akshi.gov.al
+zrpp.gov.al
+en.ata.gov.al
+www.asp.gov.al
+www.ekonomia.gov.al
+tatime.gov.al
+icd10.shendetesia.gov.al
+www.punetejashtme.gov.al
+mis.amf.gov.al
+www.isuv.gov.al
+ips.gov.al
+crm.amf.gov.al
+aku.gov.al
+www.dpa.gov.al
+www.ashk.gov.al
+www.qbz.gov.al
+www.app.gov.al
+www.gjykataelarte.gov.al
+www.qpz.gov.al
+dap.gov.al
+www.moh.gov.al
+atp.gov.al
+amf.gov.al
+www.hidaa.gov.al
+www.shendetesia.gov.al
+durres.gov.al
+shendetesia.gov.al
+www.instat.gov.al
+www.km.gov.al
+praktika.arsimi.gov.al
+ambasadat.gov.al
+akd.gov.al
+www.garda.gov.al
+issh.gov.al
+abp.gov.al
+www.akshi.gov.al
+punetejashtme.gov.al
+www.kqk.gov.al

country/Algeria/dz.csv

@@ -0,0 +1,68 @@
+hostnames
+mfep.gov.dz
+www.mcc.gov.dz
+www.andru.gov.dz
+mfdgi.gov.dz
+www.mdccne.gov.dz
+msnfcf.gov.dz
+webmail.interieur.gov.dz
+www.mfp.gov.dz
+www.mre.gov.dz
+www.mincommerce.gov.dz
+sante.gov.dz
+www.wdjelfa.gov.dz
+wilaya-elbayadh.gov.dz
+nifenligne.mfdgi.gov.dz
+ministerecommunication.gov.dz
+www.sante.gov.dz
+education.gov.dz
+capacitepc.interieur.gov.dz
+m-culture.gov.dz
+www.angcm.gov.dz
+www.wtiaret.gov.dz
+www2.mfep.gov.dz
+www.interieur.gov.dz
+prestations.interieur.gov.dz
+dge.gov.dz
+mae.gov.dz
+www.anam.gov.dz
+mpttn.gov.dz
+www.mcrp.gov.dz
+www.massn.gov.dz
+douane.gov.dz
+www.premier-ministre.gov.dz
+www.anpm.gov.dz
+mtpt.gov.dz
+passeport.interieur.gov.dz
+demande12s.interieur.gov.dz
+cnl.gov.dz
+www.mtss.gov.dz
+interieur.gov.dz
+wilaya-batna.gov.dz
+premier-ministre.gov.dz
+webmail.mem.gov.dz
+www.mfep.gov.dz
+tap.dge.gov.dz
+www.bba.gov.dz
+www.mfdgi.gov.dz
+www.mae.gov.dz
+commerce.gov.dz
+www.wmascara.gov.dz
+cntsid.douane.gov.dz
+www.ministerecommunication.gov.dz
+mhuv.gov.dz
+mtp.gov.dz
+industrie.gov.dz
+www.mhu.gov.dz
+www.mpttn.gov.dz
+concours-fonction-publique.gov.dz
+mdipi.gov.dz
+arh.gov.dz
+www.m-culture.gov.dz
+anam.gov.dz
+mfp.gov.dz
+mjs.gov.dz
+intranefp.mfp.gov.dz
+www.wbouira.gov.dz
+intramail.mfp.gov.dz
+www.arh.gov.dz