We are pleased to announce a new release of host-level and domain-level web graphs based on the crawls of November, December 2019 and January 2020. Additional information about the data formats, the processing pipeline, our objectives, and credits can be found in the announcements of prior webgraph releases (e.g., Nov/Dec/Jan 2017-2018 Webgraphs). You may also visit the projects cc-webgraph and cc-pyspark which host all scripts and tools required to construct the graphs.

Host-level graph

The graph consists of 1.24 billion nodes and 4.54 billion edges and includes dangling nodes i.e. hosts that have not been crawled yet are pointed to from a link on a crawled page. There are 1.17 billion dangling nodes (95%) and the largest strongly connected component contains 45 million (3.6%) nodes.

You can download the graph and the ranks of all 1.24 billion hosts from AWS S3 on the path s3://commoncrawl/projects/hyperlinkgraph/cc-main-2019-20-nov-dec-jan/host/. Alternatively, you can use https://commoncrawl.s3.amazonaws.com/projects/hyperlinkgraph/cc-main-2019-20-nov-dec-jan/host/ as prefix to access the files from everywhere.

Download files of the Common Crawl Nov/Dec/Jan 2019-20 domain-level webgraph

SizeFileDescription
7.23 GBcc-main-2019-20-nov-dec-jan-host-vertices.paths.gznodes ⟨id, rev host⟩, paths of 12 vertices files
20.16 GBcc-main-2019-20-nov-dec-jan-host-edges.paths.gzedges ⟨from_id, to_id⟩, paths of 24 edges files
8.42 GBcc-main-2019-20-nov-dec-jan-host.graphgraph in BVGraph format
2 kBcc-main-2019-20-nov-dec-jan-host.properties
10.80 GBcc-main-2019-20-nov-dec-jan-host-t.graphtranspose of the graph (outlinks inverted to inlinks)
2 kBcc-main-2019-20-nov-dec-jan-host-t.properties
1 kBcc-main-2019-20-nov-dec-jan-host.statsWebGraph statistics
16.32 GBcc-main-2019-20-nov-dec-jan-host-ranks.txt.gzharmonic centrality and pagerank

Note that the host names are reversed and a leading www. is stripped: www.subdomain.example.com becomes com.example.subdomain.

Domain-level graph

The domain graph was built by aggregating the host graph on the level of pay-level domains (PLDs) based on the public suffix list maintained on publicsuffix.org.

The domain-level graph has 85.8 million nodes and 1.9 billion edges. 51% or 44 million nodes are dangling nodes, the largest strongly connected component covers 34 million or 39% of the nodes.

All files related to the domain graph are available on AWS S3 under s3://commoncrawl/projects/hyperlinkgraph/cc-main-2019-20-nov-dec-jan/domain/ resp. https://commoncrawl.s3.amazonaws.com/projects/hyperlinkgraph/cc-main-2019-20-nov-dec-jan/domain/.

Download files of the Common Crawl Nov/Dec/Jan 2019-20 domain-level webgraph

SizeFileDescription
0.59 GBcc-main-2019-20-nov-dec-jan-domain-vertices.txt.gznodes ⟨id, rev domain, num hosts⟩
7.65 GBcc-main-2019-20-nov-dec-jan-domain-edges.txt.gzedges ⟨from_id, to_id⟩
4.10 GBcc-main-2019-20-nov-dec-jan-domain.graphgraph in BVGraph format
2 kBcc-main-2019-20-nov-dec-jan-domain.properties
4.13 GBcc-main-2019-20-nov-dec-jan-domain-t.graphtranspose of the graph
2 kBcc-main-2019-20-nov-dec-jan-domain-t.properties
1 kBcc-main-2019-20-nov-dec-jan-domain.statsWebGraph statistics
1.86 GBcc-main-2019-20-nov-dec-jan-domain-ranks.txt.gzharmonic centrality and pagerank

Below you’ll find the top 1000 domains ranked by Harmonic Centrality or PageRank. The full list of all 86 million domain ranks is available for download.

Top 1000 domains ranked by harmonic centrality (Nov/Dec/Jan 2019-2020)

harmonic
centrality
rank
hc valuepage rankpage rank
value
reversed hostname
13059839810.019072com.googleapis
22911313630.012214com.facebook
32747513820.013236com.google
42561048040.007452com.twitter
52494712650.007174org.w
62490471260.006611com.youtube
72328150490.004269com.instagram
82244629670.005561org.gmpg
92215475080.005033com.googletagmanager
1022107784130.003001com.linkedin
1121307220100.003433org.wordpress
1221290688200.001717com.gravatar
1321096944110.003266com.cloudflare
1421086168230.001516com.pinterest
1520869868160.002242com.gstatic
1620855286150.002366com.wordpress
1720713268250.001234org.wikipedia
1820641712170.002130com.apple
1920584368140.002460com.bootstrapcdn
2020371046330.001102com.vimeo
2120336732420.000833com.blogspot
2220237058180.001787com.jquery
2320220572500.000732be.youtu
2420218806320.001130com.microsoft
2520119820490.000737com.wp
2620059828190.001764com.adobe
2720029544520.000709com.amazon
2820013346440.000784gl.goo
2919972608350.001020com.amazonaws
3019941934670.000471com.tumblr
3119937390640.000518ly.bit
3219862906290.001164com.macromedia
3319817494300.001151com.baidu
3419816382380.000958com.google-analytics
3519808066310.001142com.googlesyndication
3619781460340.001092net.cloudfront
3719770754240.001254ru.yandex
3819749302530.000693com.flickr
3919700112220.001568com.github
4019698814800.000368com.yahoo
4119676534580.000644eu.europa
42196325061150.000287com.reddit
4319603190410.000918com.addthis
4419561006720.000403com.weebly
4519559908430.000823org.w3
4619550116630.000524me.wp
47195466141080.000313com.googleusercontent
4819531876450.000777io.github
49195232241820.000140org.wikimedia
5019521602700.000422com.medium
5119516098470.000743org.schema
5219496222460.000754net.jsdelivr
5319495662760.000374org.creativecommons
54194726101730.000153com.imgur
5519459848360.000989net.doubleclick
5619451512510.000711com.wix
57194160541860.000138uk.co.bbc
58194083121490.000181com.forbes
5919405426930.000332com.weibo
6019404990600.000601co.t
6119398622280.001192com.fontawesome
6219382484480.000741com.paypal
63193759142100.000114com.cnn
64193722921440.000190org.archive
6519368680610.000583org.mozilla
66193481821890.000137net.sourceforge
67193047743150.000079edu.mit
68193029361740.000152com.theguardian
69192937822780.000089edu.harvard
70192833721790.000144com.bing
71192713901170.000286com.jimdo
72192703681400.000202com.nytimes
7319260752270.001195com.qq
74192594062370.000103com.wsj
7519257754210.001581org.apache
7619256254560.000658com.googleadservices
77192411102150.000111com.washingtonpost
78192378162690.000092com.bloomberg
79192371642590.000094com.techcrunch
80192105625440.000049com.deviantart
81192059461620.000162org.ietf
82191983462470.000098com.oracle
83191946962790.000089com.android
8419193448690.000430com.list-manage
85191749683970.000065com.ted
86191678203210.000078com.reuters
87191619643120.000080com.wired
88191587681540.000173com.wixsite
89191548743410.000073com.ft
90191520683300.000076uk.co.telegraph
91191516664270.000060com.theverge
92191450781550.000172gov.nih
93191438862720.000091com.myspace
94191421723770.000068gov.nasa
95191360222910.000085com.bbc
96191261383390.000074com.example
97191199162390.000103org.python
9819117868820.000361com.whatsapp
99191115501220.000267com.unpkg
100191103461880.000138uk.co.google
101190895047070.000041com.economist
102190887662550.000095com.appspot
103190823003840.000067uk.co.dailymail
104190819042090.000115org.gnu
105190817082620.000093com.githubusercontent
106190801821310.000232com.ytimg
107190771563200.000078org.un
108190758061630.000162com.giphy
109190688603980.000065com.latimes
110190676061690.000157com.twimg
111190664044310.000060com.googleblog
112190561621760.000148com.blogger
113190543102320.000104com.dribbble
114190528242070.000115com.npmjs
115190505245640.000047org.arxiv
116190451946660.000042edu.upenn
117190427701710.000154com.eventbrite
118190366123790.000068com.springer
119190324222770.000090org.ampproject
120190313545570.000047com.gitlab
121190256165960.000045com.vice
122190252362060.000116com.disqus
1231902397810360.000031com.hatenablog
124190234068350.000039edu.columbia
125190186708180.000040io.readthedocs
126190082802050.000116me.t
127190058423900.000066com.w3schools
128190040309410.000034org.chromium
129190039004180.000062com.nature
130190014527160.000041com.slate
131190008621570.000171jp.co.yahoo
132189975663250.000077com.time
133189971644300.000060com.statista
134189903367440.000040com.ubuntu
135189854661580.000167com.yelp
136189825506320.000043org.worldbank
137189824281430.000191com.spotify
138189810783470.000072com.skype
139189786609350.000034com.playstation
140189765243060.000082com.fc2
1411897331213040.000024org.coursera
142189694381210.000281com.stripe
143189685628160.000040com.qz
144189681686170.000044com.git-scm
145189664484860.000053uk.co.independent
146189658101990.000126com.eepurl
147189644449610.000034com.500px
148189643424050.000063net.researchgate
149189626542410.000101com.bandcamp
15018959274550.000669net.facebook
151189564783890.000066com.outlook
152189554902290.000105com.unsplash
153189504606310.000043com.mysql
154189493304190.000062com.theatlantic
155189484561160.000286com.soundcloud
156189483641800.000143com.amazon-adsystem
157189476701230.000259org.networkadvertising
158189407685710.000046org.bitbucket
1591894029811630.000027com.jetbrains
160189364744080.000063com.mozilla
161189361044980.000052com.nationalgeographic
162189329063160.000079com.usatoday
163189308904390.000059com.criteo
164189273428370.000039uk.ac.ox
165189255604680.000054com.fortune
166189249564660.000055com.pixabay
1671892222412780.000024uk.co.thesun
168189214762300.000104net.behance
1691891670015470.000019com.amd
170189155748220.000039com.evernote
17118909918400.000932com.vk
172189093187990.000040com.about
173189079105050.000051uk.co.blogspot
1741890400011930.000026se.haxx
175189036862510.000097gle.forms
176189001327190.000041com.docker
177189000209670.000033uk.co.guardian
178188995763030.000082org.doi
179188983304970.000052me.about
180188968625250.000050gg.discord
1811889443213830.000022com.instructables
182188915821470.000189com.dropbox
1831888843210000.000032com.scientificamerican
184188852283320.000076jp.co.rakuten
185188815489030.000036google.blog
186188757041940.000130com.feedburner
1871887075810810.000030org.altervista
188188690686340.000043org.unesco
1891886896610820.000030org.eclipse
190188684882750.000090gov.ca
191188665528750.000037jp.livedoor
1921886516414900.000020org.phys
193188646742920.000085com.sciencedirect
194188606742120.000113jp.ameblo
195188557005720.000046gov.loc
196188548929930.000033org.cambridge
197188455124030.000064ca.google
198188425586630.000042edu.washington
19918836168710.000408net.slideshare
200188328085430.000049com.cisco
2011882983813640.000023edu.rutgers
202188288083040.000082com.nbcnews
203188272942430.000099ru.rambler
204188265948230.000039au.net.abc
205188260349980.000032uk.co.thetimes
2061882555414720.000021com.bankofamerica
20718821912620.000549com.fb
208188216708630.000037org.sciencemag
209188138448870.000036com.speakerdeck
210188109864120.000063jp.ne.sakura
211188067482200.000109org.iana
2121880211212580.000025com.wikidot
2131879970616500.000018pt.sapo
214187928809050.000036uk.co.mirror
215187906202180.000110edu.stanford
2161878773411430.000028org.kernel
217187865264500.000057com.elsevier
2181878442014520.000021edu.osu
2191878344616220.000019com.googlesource
2201878242613950.000022com.vogue
22118781902740.000401net.akamaihd
222187812588420.000038gov.fcc
2231878092612400.000025ms.1drv
2241877910613770.000022edu.asu
225187788282540.000095com.businessinsider
226187785348440.000038co.ibb
2271877838618430.000016com.wolfram
228187710907210.000041com.trello
229187691481060.000323com.paypalobjects
230187662983010.000083net.windows
2311876223812160.000026jp.geocities
232187621505870.000045com.box
233187618408760.000037com.sciencedaily
234187588022270.000106com.wpengine
235187529864930.000052com.herokuapp
2361875202610300.000032edu.princeton
237187488149150.000035edu.academia
238187482322840.000087com.googlecode
2391874614611770.000027com.asahi
2401874004413750.000022com.newscientist
2411873371814280.000021blog.home
242187324583140.000080com.tinyurl
243187320105160.000051com.udacity
2441873174021030.000014com.wizards
245187299063860.000067com.cnet
2461872964414210.000022com.ndtv
247187293703350.000075com.getpocket
2481872927613490.000023com.fandom
2491872641212410.000025net.seesaa
250187233761670.000158com.imdb
251187184403330.000076org.debian
252187155526990.000041site.business
253187136382610.000093com.live
2541871149810590.000031jp.ne.goo
2551871077815040.000020io.itch
2561870401611550.000027org.greenpeace
2571870225410470.000031com.netlify
2581870156818080.000017net.pixnet
259187005524020.000064com.squareup
2601869985211450.000028co.elastic
261186997563100.000081com.ibm
262186987842030.000118com.stackoverflow
263186981464940.000052com.indiatimes
2641869631234200.000010com.armorgames
265186931482650.000092com.aliyuncs
266186923782260.000106com.optimizely
2671868594417770.000017uk.co.timesonline
268186795709750.000033com.mixcloud
2691867753016180.000019com.itv
270186744601980.000128org.bbb
27118674340570.000648net.fbcdn
2721867414822360.000014com.opendns
2731867268233020.000010tw.com.gamer
274186726464060.000063com.go
275186724864370.000059com.msn
27618672432370.000966com.wixstatic
2771866760614850.000021org.archlinux
278186665464480.000058org.pewresearch
27918664590870.000345com.shopify
280186629148380.000039jp.shinobi
281186625509950.000032com.bmj
2821866051615790.000019com.diigo
283186596881600.000167com.opera
2841865933218220.000017com.youdao
2851865768612590.000025com.angelfire
286186573769060.000036jp.naver
2871865693410380.000031com.thelancet
2881865361015850.000019uk.bl
289186521868640.000037br.com.google
290186499144900.000053com.bigcartel
2911864879610070.000032com.sky
2921864759614080.000022net.daringfireball
2931864259217790.000017uk.ac.kcl
2941864116817520.000017org.maven
295186395445340.000049me.m
2961863929811070.000029com.reverbnation
2971863729016650.000018net.cnki
2981863410210890.000030com.theconversation
299186305044600.000056it.placehold
3001862906411170.000029com.podbean
301186286608810.000036org.fao
3021862695611440.000028co.g
3031862626413700.000023com.dw
304186236461190.000283com.mailchimp
3051862126016310.000019jp.ne.so-net
3061862026413460.000023com.livescience
3071862011020710.000015edu.kit
3081861190013080.000024ca.utoronto
3091861061813100.000024com.webnode
310186083889570.000034au.gov.nsw
3111860696414110.000022com.citrix
3121860370410310.000032jp.jugem
3131860237411150.000029gov.wa
314186000024580.000056com.quora
31518598840990.000326com.godaddy
3161859774013340.000023com.bloglovin
3171859683411940.000026com.serving-sys
318185959769000.000036gov.dhs
3191859512016300.000019org.edx
320185926962440.000099me.wa
3211859258218300.000017com.pearltrees
3221859202215760.000019com.twitpic
3231859174417760.000017cn.people
3241859035011710.000027com.britannica
3251858938018930.000016sg.edu.nus
3261858813017910.000017com.kinja
3271858740422960.000013com.authorstream
3281858592215660.000019ca.mcgill
329185851323800.000068com.kickstarter
3301858163612370.000025com.lulu
3311857694825910.000012com.colourlovers
3321857506419190.000016com.hm
333185742423370.000075com.rackcdn
3341856799422610.000013uk.ac.sussex
3351856395419450.000016org.vim
3361856294610630.000031com.healthline
3371856286019110.000016org.wikibooks
3381856265018670.000016io.soup
3391856005217040.000018nl.blogspot
340185557405090.000051com.mashable
341185537302640.000093com.typepad
3421855348610710.000031com.adjust
343185514563960.000065com.photobucket
3441854452817410.000017org.bitcoin
3451854295222270.000014tw.edu.ntu
3461854107211000.000030com.ecwid
3471854079818200.000017com.indianexpress
3481854028818890.000016co.ello
349185388705750.000046edu.berkeley
3501853737220260.000015com.upi
351185372641320.000232com.squarespace
352185356822800.000089uk.org.ico
3531853492411360.000028com.ssrn
3541853438221520.000014com.viki
3551853381812190.000025it.scoop
356185326062700.000092com.surveymonkey
3571853201616010.000019com.fastcodesign
3581853062017820.000017org.unep
3591852958810570.000031uk.parliament
3601852735619660.000016org.haskell
361185271402240.000107com.etsy
3621852706414420.000021com.shutterfly
3631852538815690.000019uk.org.tate
3641852453028620.000011co.electrek
3651852313426930.000011jp.doorblog
366185228381560.000171com.issuu
3671851914820180.000015com.dezeen
3681851791024300.000013sh.now
3691851753011570.000027com.tradedoubler
3701851502811730.000027gov.weather
3711851361611090.000029com.imageshack
3721851268216930.000018com.channel4
3731851213411160.000029gov.dot
3741851101827030.000011cn.edu.sdu
3751851055411640.000027com.wikia
376185092442820.000088com.huffingtonpost
377185091249530.000034uk.co.pinterest
378185086769240.000035com.arstechnica
379185071562710.000091com.rawgit
380185058124840.000053tv.twitch
3811850572219170.000016th.co.google
3821850313423900.000013uk.ac.nhm
3831850236017640.000017com.netvibes
3841850115618710.000016edu.emory
385185009649180.000035in.amazon
386185002529630.000034com.strikingly
3871849922417730.000017net.bplaced
3881849778633560.000010tw.edu.ntnu
3891849569218110.000017edu.iu
390184945428330.000039com.brightcove
391184916242250.000107com.hubspot
3921849136614700.000021com.wattpad
3931849091414760.000021gov.michigan
3941848922219160.000016nl.tudelft
3951848806414360.000021org.c-span
396184877083940.000065com.meetup
3971848341221100.000014com.kaggle
3981848166212990.000024edu.brookings
39918478490860.000345net.jsfiddle
4001847842026210.000012sh.surge
4011847553022480.000014com.rsa
4021847522017810.000017gov.ahrq
403184741288250.000039org.mediawiki
404184739223460.000072edu.yale
405184726648260.000039com.intel
4061847228815120.000020gov.faa
4071847192619750.000015io.material
4081847173210730.000031com.thenextweb
4091847170618470.000016net.earthlink
4101846961019080.000016jp.blog
411184690928310.000039com.pexels
4121846476010290.000032uk.gov.nationalarchives
4131846091619730.000016com.smashwords
414184590889390.000034org.ieee
4151845742021850.000014com.smore
416184567243450.000072com.livejournal
4171845636033660.000010hk.edu.hkbu
418184535424140.000063com.nypost
4191845346417850.000017com.business-standard
4201845344029070.000011com.yam
4211845124812330.000025org.aarp
4221845040819990.000015com.oprah
4231844994220530.000015org.jpn
4241844988015030.000020org.amnesty
4251844979016510.000018com.avvo
4261844964825400.000012com.cleantechnica
427184495045220.000050edu.cornell
4281844812425860.000012com.mysanantonio
429184475944730.000054io.shields
4301844754414440.000021org.hrw
4311844424024870.000012org.neocities
4321844281019430.000016com.care2
4331844070217140.000018com.snopes
4341844019411480.000027com.gizmodo
4351844005824740.000012com.googledrive
4361843927225940.000012com.iflscience
4371843752415940.000019org.pypi
438184372662680.000092net.php
4391843690219270.000016org.rsc
4401843628813890.000022com.pbworks
4411843597827350.000011com.itsnicethat
4421843536220920.000015ae.thenational
4431843532624610.000012com.hsbc
444184346423380.000074com.hp
4451843263613540.000023uk.co.standard
4461843176418070.000017com.instapaper
447184315964650.000055io.codepen
448184313905530.000047com.buzzfeed
4491843102019100.000016com.secondlife
4501843025824250.000013jp.go.ndl
4511842975621060.000014io.gitlab
452184284323730.000069int.who
4531842712823000.000013org.lds
4541842697624710.000012uk.mod
4551842695417110.000018google.ai
45618426290960.000330de.google
4571842389814270.000021com.thehindu
4581842372417490.000017com.curbed
4591842290216380.000019no.google
460184217383400.000074com.cnbc
4611842068610610.000031com.thedrum
462184197801650.000160com.ebay
463184187906270.000043com.zdnet
4641841845423300.000013pl.cba
4651841639224410.000013com.minds
466184134882010.000125com.salesforce
4671841325215740.000019com.moonfruit
4681841235811560.000027com.mixpanel
4691841167028180.000011tl.page
4701840919619820.000015com.name
4711840908022820.000013jp.hateblo
4721840783025070.000012org.tvtropes
4731840731825800.000012jp.hatenadiary
4741840634825100.000012de.dw
4751840563418540.000016com.googlegroups
4761840550818760.000016mx.com.google
4771840513421980.000014org.aiga
4781840340428830.000011uk.co.birminghammail
479184033403670.000069com.booking
4801840160223140.000013vn.com.google
4811840155017290.000018gov.pa
4821839997216660.000018org.hrc
483183996188820.000036gov.nist
4841839847227420.000011com.exxonmobil
4851839737618410.000016ar.com.google
486183963569890.000033net.clickbank
487183956609760.000033com.matterport
4881839240224290.000013ua.at
4891839052220110.000015uk.ac.leeds
490183874443090.000081gov.cdc
4911838652815580.000019int.unfccc
4921838640823420.000013com.eklablog
493183857004590.000056com.gmail
494183855984010.000064org.npr
4951838483216720.000018gov.maryland
496183843903570.000070com.office
4971838395022400.000014se.liu
4981838381020670.000015com.discovermagazine
4991838340022040.000014com.ipage
5001838162611100.000029com.stackexchange
5011838159424180.000013it.justpaste
502183809744490.000058fr.free
5031838068217180.000018sg.com.google
5041837967210600.000031com.engadget
5051837823824210.000013my.com.thestar
5061837728212730.000024dk.google
5071837713622100.000014org.biorxiv
5081837706218610.000016com.weheartit
5091837419415980.000019uk.gov.tfl
510183712745080.000051gov.whitehouse
5111836933017230.000018ly.snip
5121836900618090.000017com.yourstory
5131836635631540.000011com.bonanza
5141836565028330.000011com.scienceblogs
5151836548414310.000021com.ebayimg
5161836543617740.000017gov.ky
517183635008580.000038com.venturebeat
5181836292411600.000027se.google
5191836245413500.000023com.firebaseapp
520183620261780.000147com.zendesk
5211836015020040.000015uk.gov.metoffice
522183599909280.000035com.windowsphone
5231835975023360.000013com.rediff
524183583885180.000051com.alibaba
5251835525622250.000014com.blogfa
526183552324150.000063com.fastcompany
5271835321214260.000021com.surveygizmo
5281835235220210.000015au.com.telstra
5291835145411340.000028org.sphinx-doc
5301835050220480.000015ro.google
5311835012619040.000016org.tigris
5321834952428350.000011be.lesoir
5331834943026980.000011cz.centrum
5341834937220470.000015link.page
535183492604790.000054org.nodejs
5361834902819600.000016com.marketwire
5371834767222420.000014com.mystrikingly
5381834701822600.000013ch.unige
5391834685027530.000011cat.uab
5401834681828890.000011com.zynga
5411834516415100.000020us.mn.state
5421834162222750.000013com.articulate
543183400129910.000033edu.psu
5441833942221410.000014com.thecvf
5451833902021500.000014es.csic
5461833892228800.000011co.carrd
5471833738016110.000019gov.mo
5481833736022970.000013com.newatlas
5491833569039080.000009jp.rdy
5501833463019900.000015org.iea
5511833359825650.000012com.db
5521833271623100.000013com.webstarts
5531833258424880.000012jp.hatenablog
5541833197623310.000013ly.rebrand
555183313443700.000069com.mapbox
556183312284850.000053com.livechatinc
5571832535219980.000015org.mozillazine
5581832494422710.000013de.uni-freiburg
5591832447213720.000023com.tinypic
560183242528830.000036com.steampowered
5611832384220720.000015uk.ac.york
5621832218610970.000030com.thinkwithgoogle
5631832058225890.000012ru.msu
5641832015624580.000012org.kotlinlang
5651831954016290.000019gov.oregon
5661831891435070.000010com.ingress
5671831812018060.000017gov.wi
568183180565410.000049com.aol
5691831804019690.000016gr.google
5701831782427410.000011lv.draugiem
5711831672023050.000013org.iucnredlist
5721831582220350.000015com.broadwayworld
573183140761340.000221com.youtube-nocookie
5741831395415110.000020net.openid
575183137041680.000158com.tripadvisor
576183135164350.000059com.dailymotion
5771831339815480.000019net.leadpages
5781831336033890.000010com.brother
5791831318627550.000011com.webcindario
5801831311631610.000011es.usal
5811831296223380.000013bg.google
582183127289070.000036com.xiti
5831831233822730.000013us.oh.state
584183107607200.000041fm.last
5851831070016620.000018net.ucoz
586183069363530.000071org.acm
5871830407439310.000009com.worldlingo
5881830325433790.000010com.embarcadero
5891830311017890.000017com.eiseverywhere
5901830283822300.000014org.wri
591183027463950.000065com.pubmatic
592183025164700.000054com.goodreads
5931830082622120.000014com.thehindubusinessline
5941830019622890.000013com.mihanblog
5951829998820370.000015com.intensedebate
5961829818432300.000011com.hellomagazine
5971829729834740.000010net.hypermart
598182949902350.000103uk.co.amazon
5991829442827110.000011nf.co
60018294164730.000401me.fb
601182940885420.000049com.entrepreneur
6021829306225430.000012com.futurelearn
6031829264423890.000013com.iconarchive
6041829230612750.000024com.cognitoforms
6051829213817300.000018org.khanacademy
6061829107220410.000015com.financialpost
6071829100017440.000017us.pa.state
6081828869826530.000012com.fatcow
609182885643720.000069com.staticflickr
6101828827218510.000016io.bower
6111828787836570.000010nz.govt.tepapa
6121828500021990.000014org.prlog
6131828498027430.000011ca.shaw
6141828473621040.000014com.bravesites
6151828303026750.000012de.uni-erlangen
6161828256824460.000012org.lacity
6171828202415340.000020fi.google
6181828201822670.000013de.uni-koeln
6191828051024640.000012uk.co.spectator
620182793263340.000076com.typeform
6211827932427250.000011is.good
6221827929033990.000010com.114la
6231827884232770.000010net.freeforums
624182783849200.000035com.zoho
6251827389824650.000012uk.ac.jisc
6261827340424890.000012com.mnn
6271827335223930.000013ca.dal
628182727401140.000290com.statcounter
629182727224800.000054com.netflix
6301827231815670.000019com.flashtalking
6311827221219030.000016com.prweek
6321827080631150.000011site.negocio
6331827079420800.000015org.lung
6341827050627270.000011com.mouser
6351827034025690.000012uk.co.profilebusiness
6361826984036160.000010uk.gov.number10
6371826814638060.000009net.dead
6381826773433750.000010jp.ac.kobe-u
6391826762819250.000016uk.org.nice
64018267512880.000343com.oculus
6411826719831960.000011build.bazel
6421826654618780.000016org.gentoo
6431826616621810.000014ie.thejournal
644182661481090.000310com.sharethis
6451826597619060.000016org.gnupg
646182647281480.000186ru.mail
6471826337618600.000016com.doodlekit
6481826223819480.000016com.crashlytics
6491826215618310.000017org.alz
6501826195425490.000012us.ms.state
6511826116224590.000012com.instructure
652182605408200.000040com.cbsnews
6531825984428770.000011ee.ut
6541825982612110.000026com.msdn
655182596107770.000040com.samsung
6561825700413380.000023com.emailmeform
657182549345490.000048edu.cmu
6581825482224960.000012uk.co.osoo
65918254762830.000354com.livestream
6601825465622260.000014com.atavist
6611825287622080.000014fr.archives-ouvertes
6621825228227920.000011com.cnsnews
6631825201823480.000013io.pantheon
664182511488980.000036com.createjs
6651825102617550.000017us.fl.state
6661825073023210.000013com.rabbitmq
6671825062827120.000011uk.co.newmedianow
6681824857614220.000022com.123formbuilder
6691824703220860.000015gov.nh
6701824350422330.000014org.crossref
6711824231422290.000014us.nm.state
672182422542960.000084com.scribd
6731824136632540.000010ca.qc.montreal
6741824090832850.000010uk.co.lrb
675182408281350.000215com.youku
676182397505170.000051com.slack
6771823965826770.000012com.hatenadiary
6781823965622920.000013com.itsmyurls
6791823763626710.000012uk.org.oxonaa
680182369022460.000099com.constantcontact
6811823686233480.000010com.outlookindia
6821823585438930.000009in.ac.nptel
6831823554026810.000012uk.org.oxfam
6841823523623440.000013com.yext
685182338122560.000094com.getbootstrap
6861823332421070.000014org.jenkins-ci
6871823058420550.000015com.broadcastingcable
6881823047816860.000018uk.gov.direct
6891823041626630.000012com.wmtransfer
6901823037419770.000015gov.mt
6911823016428210.000011uk.ac.stir
6921822854010520.000031com.marketwatch
6931822774422660.000013com.tmcnet
6941822744031360.000011uk.co.hsbc
6951822708617980.000017org.nfpa
6961822679229390.000011com.batchgeo
6971822584432750.000010com.weightwatchers
698182256362340.000103to.amzn
6991822463235740.000010com.orgfree
7001822377813550.000023org.whatbrowser
7011822181428430.000011com.adn
7021822127611900.000026org.weforum
703182205064810.000054org.hbr
7041821988028200.000011au.edu.deakin
7051821973414550.000021org.js
7061821911824450.000013in.ernet
7071821796228540.000011hu.elte
7081821751630250.000011pl.edu.uw
7091821727423670.000013uk.org.rspb
7101821652822200.000014com.healthgrades
7111821626427790.000011org.carbonbrief
712182142143660.000069com.prnewswire
7131821395620880.000015com.tapatalk
7141821318024310.000013org.grist
7151821275034230.000010id.co.kaskus
716182106384560.000057com.oreilly
7171821010635870.000010com.skepticalscience
718182099505390.000049gov.sec
7191820992230810.000011com.deccanherald
7201820966819050.000016tl.we
7211820877023110.000013us.ma.state
7221820686011010.000030uk.ac.cam
7231820599436300.000010ua.meta
7241820573835260.000010app.web
7251820446223980.000013uk.co.zoopla
7261820196632100.000011org.oceanconservancy
7271819963034210.000010org.atsjournals
7281819896235320.000010ru.my1
7291819844431620.000011com.mozello
7301819560015620.000019com.pastebin
7311819458028670.000011de.freenet
7321819341411370.000028edu.ucla
7331819310030520.000011com.telegraphindia
7341819302628570.000011com.chagasi
735181927589370.000034br.com.uol
7361818899426300.000012com.atwebpages
7371818862630360.000011com.remind
7381818792211320.000028com.redhat
739181877486080.000044com.wikihow
7401818765833770.000010edu.utep
7411818726434550.000010ru.nnov
7421818683418810.000016uk.gov.defra
7431818656823590.000013net.portfoliobox
7441818562426100.000012com.blogsky
7451818543438560.000009uk.co.mailonsunday
7461818543227230.000011jp.xxxxxxxx
7471818412214250.000021edu.ucsd
7481818396214490.000021com.digitaltrends
749181837381960.000130jp.ne.hatena
7501818246425630.000012uk.co.inews
7511818172823130.000013gov.la
7521818165612660.000024ly.ow
7531818036034410.000010gr.sch
7541817980230550.000011com.sc
7551817862833730.000010com.cummins
7561817756623630.000013com.activerain
7571817602638010.000009com.kazeo
7581817600229010.000011net.onlinewebshop
7591817542236890.000010com.galvanize
7601817490234730.000010ru.pr-cy
761181748265030.000052com.dmca
7621817352833280.000010com.kaywa
763181733488210.000040com.psychologytoday
7641817211828530.000011uk.co.heatall
76518171416840.000350me.ogp
7661816812826010.000012gov.ks
7671816778215160.000020ca.blogspot
7681816755821700.000014com.cityam
7691816728436040.000010gov.cabq
7701816643618130.000017org.reactjs
7711816605232830.000010org.escardio
7721816573410640.000031com.foxnews
7731816568018970.000016com.fifa
774181648602040.000117com.naver
7751816440437610.000009com.carscoops
7761816268029280.000011com.ecowatch
7771816239015070.000020com.literatumonline
778181619985350.000049net.2mdn
779181618004760.000054com.force
780181605781590.000167gov.privacyshield
7811816027018960.000016com.pcworld
7821816019229860.000011com.theyworkforyou
78318159730810.000365com.messenger
7841815970039390.000009com.anghami
785181594264240.000061edu.nyu
7861815799012940.000024com.indiegogo
7871815782818690.000016kr.or.kisa
788181578163640.000070com.discordapp
7891815701431860.000011uk.org.38degrees
7901815685036280.000010com.insideevs
7911815549614880.000020com.placeholder
7921815507232500.000010google.design
7931815504437640.000009gle.goo
794181544624540.000057com.walmart
795181533604280.000060com.flipboard
7961815204429020.000011pl.lublin
797181519524220.000062com.wufoo
7981815119811230.000029com.shutterstock
7991815068425370.000012org.iihs
8001814944627880.000011in.businessworld
801181486369810.000033com.pinimg
8021814776024070.000013jp.e-shops
8031814773422500.000014com.codecademy
8041814634026420.000012com.zx2c4
805181463281290.000243info.aboutads
8061814594421380.000014ca.ubc
8071814553828740.000011com.bnef
8081814435432400.000011uk.ac.rcplondon
8091814425437180.000009com.wsoctv
8101814390239500.000009com.monbiot
8111814334234630.000010com.droppages
8121814314823660.000013gov.arts
8131814245426440.000012us.wi.state
8141814204634770.000010org.usatf
8151814087816240.000019com.nvidia
8161813886636360.000010com.elmercurio
8171813883815380.000020com.businessweek
8181813846221760.000014com.tutsplus
819181383825540.000047com.atlassian
8201813735611840.000026com.searchengineland
8211813727835940.000010com.glu
8221813712436450.000010es.consumer
823181359742400.000102cn.com.sina
8241813559639480.000009com.allmyfaves
8251813534234460.000010com.businessgreen
826181336423500.000072com.163
8271813326832920.000010org.jython
828181332304710.000054com.smugmug
8291813281638640.000009org.thechicagocouncil
8301813212635760.000010gov.azdot
8311813047011760.000027com.ycombinator
8321812983833390.000010org.transportenvironment
8331812853829930.000011gov.ferc
834181279109360.000034com.aliexpress
835181261543560.000070com.wiley
836181257906960.000042com.moz
8371812499627560.000011uk.gov.environment-agency
8381812488630120.000011org.zsl
8391812413637040.000009org.ssireview
8401812352023780.000013uk.gov.scotland
8411812297815950.000019tv.ustream
8421812252230960.000011org.dailystrength
843181220385980.000045com.caniuse
8441812099624850.000012net.privacypolicytemplate
845181208667680.000040gov.noaa
8461812081815730.000019jp.makeshop
8471812051830400.000011org.rspo
8481811994623030.000013com.seetickets
8491811945421830.000014com.ign
850181188964040.000064mp.mailchi
851181180003110.000081com.digg
8521811800028550.000011gov.txdot
8531811736634120.000010uk.ac.ceh
8541811716414790.000021com.crunchbase
8551811707411270.000029com.highcharts
8561811587026450.000012com.9to5mac
8571811464810900.000030com.withgoogle
858181143148890.000036com.webs
8591811407224810.000012uk.co.streetmap
8601811250838650.000009com.pushwoosh
8611811170832040.000011ca.uwaterloo
862181111308170.000040com.shinystat
863181110783050.000082fr.google
8641811105034670.000010com.baomoi
8651811097439160.000009uk.ac.tyndall
8661811039617660.000017com.webmasterplan
8671811018036860.000010dk.bloggersdelight
8681810990834010.000010uk.gov.hm-treasury
8691810926217930.000017uk.org.cqc
8701810894812480.000025com.smashingmagazine
871181081383310.000076com.automattic
8721810757215300.000020com.ning
8731810698428290.000011com.linkwithin
8741810652230020.000011uk.org.greenpeace
875181037689560.000034com.libsyn
8761810353812390.000025com.sap
8771810295620910.000015edu.uci
878181025646280.000043com.patreon
8791810202035030.000010com.climatechangenews
880181017584090.000063com.xinhuanet
8811810133634640.000010com.kapook
882181006188850.000036com.newyorker
8831810047436400.000010com.spruz
884181001964780.000054com.inc
8851810006226760.000012jp.aikotoba
886180992689140.000035org.eff
8871809879436620.000010com.platts
8881809855635350.000010org.c2es
8891809855027470.000011com.mykaratestore
8901809678617700.000017com.ikea
8911809639414230.000022com.billboard
8921809509210700.000031com.hootsuite
8931809494835250.000010com.jkp
8941809349628240.000011org.mcsuk
8951809262212540.000025es.agpd
8961809243833490.000010net.edie
897180923585330.000050com.ea
898180921123760.000068org.opensource
8991809156829030.000011ru.drom
9001809016226390.000012com.yelloyello
9011808996825440.000012uk.co.intersol
902180897401390.000202com.alicdn
9031808942240510.000009com.mforos
9041808699014730.000021com.fiverr
905180863529340.000035com.foursquare
9061808591817370.000017org.freecsstemplates
9071808481041420.000009uk.org.indymedia
9081808467420490.000015uk.gov.education
9091808369438430.000009com.thinkbroadband
910180821642310.000104jp.co.amazon
9111808011438680.000009org.sciencenewsforstudents
912180800342210.000108org.drupal
9131807972610960.000030com.variety
914180786662900.000086com.stumbleupon
9151807803832690.000010net.scienceontheweb
9161807758217560.000017com.nba
9171807745225610.000012org.webring
9181807650210330.000031com.visualstudio
9191807595840050.000009io.raindrop
9201807454427440.000011jp.zouri
9211807376639040.000009org.corporateeurope
9221807247014020.000022com.storify
923180714363750.000069gov.ftc
9241807137216030.000019net.with2
9251807092614480.000021com.nike
9261807022240480.000009io.dataquest
9271807006612550.000025org.unicef
9281806967235670.000010bnpparibas.group
9291806917236850.000010com.thestatesman
9301806886634270.000010uk.org.rya
931180675083830.000068com.airbnb
9321806720416350.000019de.zeit
9331806719025550.000012com.hackernoon
9341806627434510.000010ca.pe.gov
9351806526640310.000009com.raamdev
9361806438824380.000013io.postach
9371806412614870.000020edu.purdue
938180635084070.000063com.tripod
9391806322812280.000025gov.fbi
9401806315413690.000023com.lifehacker
9411806313010690.000031com.uk
9421806187834320.000010in.gov.mhrd
9431806113035270.000010org.gmplib
9441806010038790.000009com.gitimmersion
9451805957828070.000011jp.at-ninja
9461805900430100.000011com.shichihuku
9471805882636290.000010com.h2database
9481805773634820.000010uk.org.rcn
9491805764037370.000009com.writetothem
9501805659213660.000023com.parsiblog
951180565869840.000033com.dropboxusercontent
9521805595013060.000024com.prweb
9531805562836950.000009com.websiteseguro
9541805510411180.000029com.vox
9551805427213970.000022us.imageshack
9561805396420320.000015com.howstuffworks
9571805292015310.000020com.yoast
9581805228012980.000024com.pcmag
9591805139830080.000011uk.org.woodlandtrust
9601805093635230.000010gle.posts
9611805080038380.000009org.priceofoil
9621804958016140.000019com.ccbill
9631804906637500.000009com.fourfour
964180472149450.000034gov.census
9651804648613280.000023edu.wisc
966180458761510.000179jp.co.google
9671804571012200.000025com.blackberry
9681804541411030.000030edu.umich
9691804539019520.000016com.w3layouts
970180438941460.000190me.line
9711804381615930.000019edu.usc
9721804235628420.000011com.zatunen
973180422405000.000052com.nasdaq
974180421305670.000046net.daum
9751804157031180.000011vn.tuoitre
9761804055625730.000012com.hisupplier
9771803944420230.000015com.nfl
978180393709270.000035com.ggpht
9791803932415490.000019com.vmware
9801803902038270.000009com.realtytimes
9811803836232610.000010net.batcave
9821803811633410.000010org.mygamesonline
983180378667340.000040com.mckinsey
9841803767439830.000009org.eia-international
985180376042580.000094com.sohu
9861803759437000.000009io.dropwizard
9871803739410260.000032gov.nps
9881803724421310.000014au.com.news
9891803660836520.000010de.epubli
9901803419813810.000022com.unity3d
9911803407229920.000011net.nend
9921803304840980.000009com.easyhits4u
9931803189011620.000027com.steamcommunity
9941803162214510.000021edu.uchicago
9951803157010860.000030com.uber
9961803147053060.000007com.plurk
997180304905970.000045com.adweek
9981803018236350.000010com.jal
9991802967017860.000017com.techradar
10001802924412710.000024com.ifttt

Credits

Thanks to the authors of the WebGraph framework, whose software made the computation of graph properties and ranks possible.

We hope the data will be useful for you to do any kind of research on ranking, graph analysis, link spam detection, etc. Let us know about your results via Common Crawl’s Google Group!