Host- and Domain-Level Web Graphs June, July/August and September 2021
We are pleased to announce a new release of host-level and domain-level web graphs based on the crawls of June, July/August and September 2021. Additional information about the data formats, the processing pipeline, our objectives, and credits can be found in the announcements of prior webgraph releases. You may also visit the projects cc-webgraph and cc-pyspark which include all scripts and tools required to construct the graphs. Instructions to explore the graphs in the webgraph format are given in our collection of webgraph notebooks.
Host-level graph
The graph consists of 766 million nodes and 4.95 billion edges. Both hyperlinks and HTTP redirects and link headers are used as edges to span up the graph. All types of links are included, including pure “technical” ones pointing to images, JavaScript libraries, web fonts, etc. However, only host names with a valid IANA TLD are used. Consequently, URLs with an IP address as host component are not taken into account for building the host-level graph.
There are 701 million dangling nodes (91.6%) and the largest strongly connected component contains 47.0 million (6.1%) nodes. Dangling nodes stem from
- hosts that have not been crawled, yet are pointed to from a link on a crawled page
- hosts without any links pointing to a different host name
- or hosts which did only return an error page (eg. HTTP 404)
Host names in the graph are in reverse domain name notation and a leading www.
is stripped: www.subdomain.example.com
becomes com.example.subdomain
.
You can download the graph and the ranks of all 766 million hosts from AWS S3 on the path s3://commoncrawl/projects/hyperlinkgraph/cc-main-2021-jun-jul-sep/host/
. Alternatively, you can use https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2021-jun-jul-sep/host/
as prefix to access the files from everywhere.
Please note that the text representation of the host-level graph is shipped in 40 gzip-compressed files listed in two path listings – one for the nodes (vertices), one for the edges (arcs). First, download the paths listing and decompress it using “gzip”. By adding the prefix s3://commoncrawl/
or https://data.commoncrawl.org/
to each line in the path listing you get the list of URLs to download the entire graph.
Size | File | Description |
---|---|---|
4.50 GB | cc-main-2021-jun-jul-sep-host-vertices.paths.gz | nodes 〈id, rev host〉, paths of 16 vertices files |
20.76 GB | cc-main-2021-jun-jul-sep-host-edges.paths.gz | edges 〈from_id, to_id〉, paths of 24 edges files |
8.43 GB | cc-main-2021-jun-jul-sep-host.graph | graph in BVGraph format |
2 kB | cc-main-2021-jun-jul-sep-host.properties | |
9.83 GB | cc-main-2021-jun-jul-sep-host-t.graph | transpose of the graph (outlinks inverted to inlinks) |
2 kB | cc-main-2021-jun-jul-sep-host-t.properties | |
1 kB | cc-main-2021-jun-jul-sep-host.stats | WebGraph statistics |
11.06 GB | cc-main-2021-jun-jul-sep-host-ranks.txt.gz | harmonic centrality and pagerank |
Domain-level graph
The domain graph is built by aggregating the host graph on the level of pay-level domains (PLDs) based on the public suffix list maintained on publicsuffix.org. Version (commit) a5b046d of the public suffix list was used (commit date 2021-10-06).
The domain-level graph has 88 million nodes and 1.56 billion edges. 49% or 43 million nodes are dangling nodes, the largest strongly connected component covers 35 million or 40% of the nodes.
All files related to the domain graph are available on AWS S3 under s3://commoncrawl/projects/hyperlinkgraph/cc-main-2021-jun-jul-sep/domain/
resp. https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2021-jun-jul-sep/domain/
.
Download files of the Common Crawl Jun/Jul/Sep 2021 domain-level webgraph
Size | File | Description |
---|---|---|
0.61 GB | cc-main-2021-jun-jul-sep-domain-vertices.txt.gz | nodes 〈id, rev domain, num hosts〉 |
6.34 GB | cc-main-2021-jun-jul-sep-domain-edges.txt.gz | edges 〈from_id, to_id〉 |
3.59 GB | cc-main-2021-jun-jul-sep-domain.graph | graph in BVGraph format |
2 kB | cc-main-2021-jun-jul-sep-domain.properties | |
3.44 GB | cc-main-2021-jun-jul-sep-domain-t.graph | transpose of the graph |
2 kB | cc-main-2021-jun-jul-sep-domain-t.properties | |
1 kB | cc-main-2021-jun-jul-sep-domain.stats | WebGraph statistics |
1.89 GB | cc-main-2021-jun-jul-sep-domain-ranks.txt.gz | harmonic centrality and pagerank |
Below you’ll find the top 1000 domains ranked by Harmonic Centrality or PageRank. The full list of all 88 million domain ranks is available for download.
Top 1000 domains ranked by harmonic centrality (Jun/Jul/Sep 2021)
harmonic centrality rank | hc value | page rank | page rank value | reversed domain name |
---|---|---|---|---|
1 | 31634524 | 1 | 0.018526 | com.googleapis |
2 | 30590448 | 3 | 0.013879 | com.facebook |
3 | 29344102 | 2 | 0.015082 | com.google |
4 | 26579208 | 5 | 0.007506 | org.w |
5 | 26490886 | 4 | 0.008344 | com.twitter |
6 | 26194504 | 6 | 0.007270 | com.youtube |
7 | 25598364 | 8 | 0.006802 | com.instagram |
8 | 24808618 | 7 | 0.006829 | com.googletagmanager |
9 | 24314334 | 9 | 0.004946 | org.gmpg |
10 | 23501518 | 14 | 0.003442 | com.linkedin |
11 | 23191984 | 11 | 0.003661 | com.gstatic |
12 | 22552330 | 10 | 0.004093 | com.cloudflare |
13 | 22306348 | 17 | 0.001939 | com.gravatar |
14 | 22254410 | 12 | 0.003556 | org.wordpress |
15 | 22159662 | 22 | 0.001575 | com.pinterest |
16 | 21706482 | 23 | 0.001396 | org.wikipedia |
17 | 21593592 | 16 | 0.001952 | com.apple |
18 | 21537622 | 37 | 0.001024 | com.wordpress |
19 | 21459498 | 27 | 0.001176 | com.vimeo |
20 | 21360146 | 41 | 0.000898 | be.youtu |
21 | 21289640 | 15 | 0.002252 | com.bootstrapcdn |
22 | 21211768 | 20 | 0.001717 | com.jquery |
23 | 21069122 | 28 | 0.001166 | com.microsoft |
24 | 21014760 | 54 | 0.000699 | com.blogspot |
25 | 20975968 | 46 | 0.000793 | com.amazon |
26 | 20916000 | 45 | 0.000798 | gl.goo |
27 | 20909476 | 50 | 0.000720 | com.wp |
28 | 20878568 | 62 | 0.000580 | ly.bit |
29 | 20832704 | 35 | 0.001053 | com.google-analytics |
30 | 20815940 | 33 | 0.001068 | com.amazonaws |
31 | 20731242 | 77 | 0.000417 | com.tumblr |
32 | 20705584 | 42 | 0.000841 | org.mozilla |
33 | 20703870 | 31 | 0.001080 | net.cloudfront |
34 | 20700046 | 18 | 0.001797 | com.adobe |
35 | 20687574 | 49 | 0.000720 | eu.europa |
36 | 20682862 | 19 | 0.001772 | com.github |
37 | 20663412 | 34 | 0.001054 | net.jsdelivr |
38 | 20641588 | 29 | 0.001134 | com.wixstatic |
39 | 20534372 | 75 | 0.000442 | com.googleusercontent |
40 | 20518204 | 21 | 0.001630 | com.fontawesome |
41 | 20499484 | 96 | 0.000366 | com.yahoo |
42 | 20489920 | 51 | 0.000711 | com.paypal |
43 | 20470068 | 57 | 0.000645 | co.t |
44 | 20460526 | 47 | 0.000784 | com.whatsapp |
45 | 20453542 | 53 | 0.000704 | com.flickr |
46 | 20429610 | 106 | 0.000315 | com.reddit |
47 | 20405542 | 72 | 0.000449 | com.medium |
48 | 20396096 | 38 | 0.000956 | com.googlesyndication |
49 | 20388958 | 48 | 0.000748 | io.github |
50 | 20364584 | 125 | 0.000241 | com.nytimes |
51 | 20363658 | 59 | 0.000616 | org.w3 |
52 | 20350454 | 98 | 0.000358 | com.weebly |
53 | 20330952 | 97 | 0.000363 | org.creativecommons |
54 | 20324280 | 65 | 0.000510 | com.shopify |
55 | 20315624 | 110 | 0.000281 | com.soundcloud |
56 | 20308274 | 85 | 0.000402 | me.wp |
57 | 20300136 | 60 | 0.000610 | org.schema |
58 | 20300004 | 32 | 0.001072 | ru.yandex |
59 | 20272874 | 132 | 0.000215 | com.forbes |
60 | 20266896 | 64 | 0.000527 | com.vk |
61 | 20216640 | 114 | 0.000268 | com.spotify |
62 | 20214818 | 175 | 0.000146 | com.cnn |
63 | 20172836 | 52 | 0.000708 | net.doubleclick |
64 | 20156654 | 56 | 0.000653 | com.addthis |
65 | 20153642 | 190 | 0.000132 | uk.co.bbc |
66 | 20151882 | 230 | 0.000113 | com.wsj |
67 | 20149822 | 135 | 0.000208 | gov.nih |
68 | 20146194 | 40 | 0.000924 | com.baidu |
69 | 20144952 | 161 | 0.000166 | com.theguardian |
70 | 20127172 | 151 | 0.000179 | int.who |
71 | 20121134 | 240 | 0.000108 | com.bloomberg |
72 | 20115270 | 130 | 0.000217 | org.archive |
73 | 20111568 | 163 | 0.000163 | com.giphy |
74 | 20107092 | 94 | 0.000388 | com.list-manage |
75 | 20100830 | 192 | 0.000130 | org.wikimedia |
76 | 20095176 | 55 | 0.000682 | com.macromedia |
77 | 20091806 | 229 | 0.000113 | com.oracle |
78 | 20081572 | 145 | 0.000193 | com.imdb |
79 | 20074580 | 187 | 0.000134 | com.businessinsider |
80 | 20066912 | 297 | 0.000091 | edu.mit |
81 | 20066436 | 300 | 0.000090 | edu.stanford |
82 | 20061314 | 115 | 0.000267 | com.mailchimp |
83 | 20059906 | 44 | 0.000800 | net.facebook |
84 | 20058050 | 140 | 0.000204 | us.zoom |
85 | 20056682 | 426 | 0.000065 | com.googleblog |
86 | 20053210 | 171 | 0.000153 | com.unsplash |
87 | 20047020 | 284 | 0.000095 | com.reuters |
88 | 20043722 | 185 | 0.000137 | com.imgur |
89 | 20035754 | 142 | 0.000199 | com.wixsite |
90 | 20025300 | 191 | 0.000131 | com.stackoverflow |
91 | 20022100 | 128 | 0.000223 | com.weibo |
92 | 20016560 | 162 | 0.000163 | com.issuu |
93 | 20016026 | 423 | 0.000065 | gov.nasa |
94 | 20014282 | 36 | 0.001043 | net.fbcdn |
95 | 20013910 | 273 | 0.000098 | com.android |
96 | 20012778 | 119 | 0.000259 | me.t |
97 | 20012366 | 169 | 0.000160 | org.ietf |
98 | 20004530 | 139 | 0.000206 | com.ytimg |
99 | 20001182 | 148 | 0.000183 | org.apache |
100 | 19999464 | 318 | 0.000086 | com.theverge |
101 | 19993026 | 325 | 0.000084 | com.slack |
102 | 19992850 | 258 | 0.000103 | edu.harvard |
103 | 19989870 | 224 | 0.000116 | com.washingtonpost |
104 | 19988302 | 268 | 0.000099 | com.bbc |
105 | 19986642 | 460 | 0.000060 | edu.cornell |
106 | 19984712 | 155 | 0.000174 | com.ft |
107 | 19979856 | 117 | 0.000261 | com.npmjs |
108 | 19978744 | 416 | 0.000066 | com.ted |
109 | 19962738 | 424 | 0.000065 | com.myspace |
110 | 19957322 | 352 | 0.000078 | com.wired |
111 | 19956296 | 526 | 0.000052 | com.livejournal |
112 | 19945484 | 355 | 0.000078 | com.appspot |
113 | 19944274 | 263 | 0.000101 | org.un |
114 | 19943458 | 215 | 0.000119 | org.gnu |
115 | 19933112 | 390 | 0.000070 | com.goodreads |
116 | 19932600 | 69 | 0.000476 | com.godaddy |
117 | 19931522 | 387 | 0.000071 | org.hbr |
118 | 19917440 | 309 | 0.000087 | org.npr |
119 | 19916612 | 322 | 0.000085 | com.prnewswire |
120 | 19911628 | 332 | 0.000083 | net.researchgate |
121 | 19910122 | 307 | 0.000088 | com.githubusercontent |
122 | 19909276 | 24 | 0.001390 | io.polyfill |
123 | 19908276 | 286 | 0.000095 | com.wiley |
124 | 19905960 | 247 | 0.000106 | com.tiktok |
125 | 19894990 | 193 | 0.000130 | com.blogger |
126 | 19892346 | 71 | 0.000466 | com.unpkg |
127 | 19884978 | 102 | 0.000322 | de.google |
128 | 19869556 | 432 | 0.000064 | com.gmail |
129 | 19869236 | 565 | 0.000049 | com.vice |
130 | 19868406 | 627 | 0.000045 | org.chromium |
131 | 19867146 | 146 | 0.000186 | gle.forms |
132 | 19866916 | 113 | 0.000269 | com.youtube-nocookie |
133 | 19866834 | 179 | 0.000142 | org.ampproject |
134 | 19856608 | 354 | 0.000078 | com.time |
135 | 19856272 | 668 | 0.000043 | edu.upenn |
136 | 19856040 | 370 | 0.000074 | com.example |
137 | 19854818 | 633 | 0.000045 | com.economist |
138 | 19850884 | 727 | 0.000040 | com.evernote |
139 | 19842434 | 500 | 0.000055 | com.steampowered |
140 | 19841380 | 692 | 0.000042 | google.blog |
141 | 19841354 | 462 | 0.000060 | com.theatlantic |
142 | 19840036 | 586 | 0.000047 | org.weforum |
143 | 19837596 | 628 | 0.000045 | com.deviantart |
144 | 19837072 | 239 | 0.000109 | uk.co.google |
145 | 19833470 | 357 | 0.000077 | org.arxiv |
146 | 19833402 | 395 | 0.000070 | com.scribd |
147 | 19831882 | 407 | 0.000067 | uk.co.telegraph |
148 | 19829878 | 368 | 0.000074 | com.huffingtonpost |
149 | 19829876 | 642 | 0.000045 | com.mysql |
150 | 19821800 | 555 | 0.000050 | org.worldbank |
151 | 19818100 | 242 | 0.000107 | com.sciencedirect |
152 | 19816676 | 347 | 0.000080 | com.nature |
153 | 19814992 | 228 | 0.000113 | com.twimg |
154 | 19812336 | 120 | 0.000259 | com.statcounter |
155 | 19810098 | 246 | 0.000106 | org.acm |
156 | 19805214 | 554 | 0.000050 | org.ieee |
157 | 19799686 | 381 | 0.000071 | com.fastcompany |
158 | 19796892 | 255 | 0.000104 | org.python |
159 | 19794906 | 701 | 0.000041 | com.apnews |
160 | 19790820 | 431 | 0.000064 | com.meetup |
161 | 19790276 | 738 | 0.000040 | com.qz |
162 | 19789858 | 581 | 0.000047 | com.globenewswire |
163 | 19788416 | 365 | 0.000074 | com.docker |
164 | 19788402 | 444 | 0.000062 | com.pixabay |
165 | 19788038 | 453 | 0.000061 | uk.co.dailymail |
166 | 19784442 | 321 | 0.000085 | com.springer |
167 | 19783552 | 251 | 0.000105 | com.bandcamp |
168 | 19779288 | 256 | 0.000103 | net.behance |
169 | 19778076 | 361 | 0.000075 | com.gitlab |
170 | 19768948 | 603 | 0.000046 | com.git-scm |
171 | 19764224 | 540 | 0.000051 | io.readthedocs |
172 | 19763982 | 715 | 0.000041 | com.engadget |
173 | 19763034 | 647 | 0.000044 | com.trello |
174 | 19761140 | 183 | 0.000138 | com.bing |
175 | 19758120 | 346 | 0.000080 | com.usatoday |
176 | 19757326 | 220 | 0.000117 | com.squarespace |
177 | 19752428 | 158 | 0.000169 | com.yelp |
178 | 19747884 | 353 | 0.000078 | com.dribbble |
179 | 19747756 | 417 | 0.000066 | com.digg |
180 | 19747532 | 143 | 0.000199 | com.dropbox |
181 | 19744818 | 276 | 0.000097 | com.ibm |
182 | 19734092 | 464 | 0.000060 | uk.co.independent |
183 | 19733310 | 398 | 0.000069 | com.w3schools |
184 | 19723800 | 544 | 0.000051 | ee.linktr |
185 | 19723334 | 674 | 0.000043 | uk.co.blogspot |
186 | 19723200 | 412 | 0.000067 | com.staticflickr |
187 | 19721228 | 551 | 0.000050 | com.pexels |
188 | 19721224 | 144 | 0.000194 | gov.cdc |
189 | 19718802 | 539 | 0.000051 | org.pbs |
190 | 19718388 | 775 | 0.000038 | com.stackexchange |
191 | 19718222 | 703 | 0.000041 | org.cambridge |
192 | 19717352 | 1103 | 0.000029 | org.eclipse |
193 | 19716696 | 43 | 0.000819 | com.fb |
194 | 19712516 | 678 | 0.000042 | edu.columbia |
195 | 19710308 | 100 | 0.000351 | com.wix |
196 | 19706256 | 730 | 0.000040 | edu.washington |
197 | 19705612 | 290 | 0.000094 | com.tinyurl |
198 | 19705126 | 367 | 0.000074 | com.sagepub |
199 | 19704258 | 673 | 0.000043 | me.about |
200 | 19699044 | 219 | 0.000117 | net.slideshare |
201 | 19694818 | 653 | 0.000044 | org.sciencemag |
202 | 19689094 | 294 | 0.000091 | org.pewresearch |
203 | 19685770 | 601 | 0.000046 | com.withgoogle |
204 | 19684956 | 458 | 0.000061 | com.herokuapp |
205 | 19675188 | 440 | 0.000063 | com.quora |
206 | 19673070 | 123 | 0.000246 | com.sharethis |
207 | 19672408 | 39 | 0.000941 | com.qq |
208 | 19671982 | 176 | 0.000145 | org.doi |
209 | 19670088 | 438 | 0.000063 | co.ibb |
210 | 19667674 | 614 | 0.000046 | com.newyorker |
211 | 19664724 | 1183 | 0.000027 | com.nike |
212 | 19664240 | 316 | 0.000087 | com.typeform |
213 | 19658254 | 248 | 0.000106 | com.outlook |
214 | 19654436 | 736 | 0.000040 | com.hp |
215 | 19654104 | 791 | 0.000037 | com.foxnews |
216 | 19651026 | 234 | 0.000112 | com.cloudinary |
217 | 19648214 | 933 | 0.000035 | edu.princeton |
218 | 19646574 | 572 | 0.000048 | com.moz |
219 | 19642260 | 437 | 0.000063 | com.getpocket |
220 | 19639898 | 485 | 0.000057 | com.nbcnews |
221 | 19638836 | 645 | 0.000044 | org.bitbucket |
222 | 19635872 | 202 | 0.000124 | page.g |
223 | 19635142 | 154 | 0.000176 | gov.privacyshield |
224 | 19634924 | 277 | 0.000096 | com.disqus |
225 | 19624936 | 141 | 0.000203 | com.opera |
226 | 19623614 | 463 | 0.000060 | com.airbnb |
227 | 19620318 | 960 | 0.000034 | com.dropboxusercontent |
228 | 19618624 | 372 | 0.000073 | com.force |
229 | 19617796 | 923 | 0.000035 | co.elastic |
230 | 19614006 | 214 | 0.000119 | com.wpengine |
231 | 19613164 | 679 | 0.000042 | org.semver |
232 | 19613160 | 305 | 0.000089 | com.typepad |
233 | 19611254 | 972 | 0.000033 | com.nypost |
234 | 19610798 | 726 | 0.000040 | com.ubuntu |
235 | 19610070 | 1263 | 0.000025 | se.haxx |
236 | 19605234 | 303 | 0.000089 | com.live |
237 | 19603428 | 683 | 0.000042 | au.net.abc |
238 | 19603360 | 465 | 0.000060 | com.mozilla |
239 | 19599764 | 382 | 0.000071 | com.criteo |
240 | 19593184 | 1232 | 0.000026 | uk.co.thesun |
241 | 19581354 | 1434 | 0.000023 | edu.rutgers |
242 | 19581020 | 278 | 0.000096 | com.feedburner |
243 | 19577288 | 969 | 0.000033 | com.politico |
244 | 19572414 | 1054 | 0.000030 | co.g |
245 | 19572372 | 1849 | 0.000019 | com.instructables |
246 | 19570874 | 778 | 0.000038 | com.sap |
247 | 19568694 | 1123 | 0.000028 | org.greenpeace |
248 | 19564134 | 1127 | 0.000028 | org.kernel |
249 | 19562280 | 1650 | 0.000022 | com.googlesource |
250 | 19561484 | 124 | 0.000245 | com.filesusr |
251 | 19559444 | 1150 | 0.000028 | com.unity3d |
252 | 19558056 | 682 | 0.000042 | com.freepik |
253 | 19557106 | 542 | 0.000051 | com.fortune |
254 | 19553954 | 638 | 0.000045 | uk.ac.ox |
255 | 19553634 | 209 | 0.000121 | org.iana |
256 | 19551872 | 241 | 0.000108 | com.eepurl |
257 | 19551398 | 958 | 0.000034 | com.ssrn |
258 | 19551010 | 866 | 0.000035 | com.nvidia |
259 | 19549544 | 1569 | 0.000022 | com.storify |
260 | 19549036 | 1000 | 0.000032 | com.sun |
261 | 19548514 | 624 | 0.000045 | uk.co.eventbrite |
262 | 19544466 | 829 | 0.000036 | edu.jhu |
263 | 19541150 | 607 | 0.000046 | net.azurewebsites |
264 | 19539076 | 1291 | 0.000025 | com.reverbnation |
265 | 19538660 | 439 | 0.000063 | gov.fda |
266 | 19538044 | 99 | 0.000351 | com.stripe |
267 | 19534860 | 927 | 0.000035 | com.podbean |
268 | 19532612 | 341 | 0.000082 | net.windows |
269 | 19530966 | 1256 | 0.000025 | uk.co.ebay |
270 | 19530706 | 260 | 0.000102 | com.calendly |
271 | 19526632 | 804 | 0.000037 | com.chrome |
272 | 19525016 | 1804 | 0.000020 | com.martinfowler |
273 | 19524922 | 926 | 0.000035 | edu.academia |
274 | 19523484 | 568 | 0.000049 | site.business |
275 | 19521568 | 231 | 0.000113 | com.office |
276 | 19521106 | 328 | 0.000084 | com.netdna-ssl |
277 | 19518874 | 253 | 0.000105 | com.newsweek |
278 | 19516880 | 210 | 0.000120 | tv.twitch |
279 | 19515182 | 1220 | 0.000026 | com.vogue |
280 | 19514726 | 2307 | 0.000017 | com.diigo |
281 | 19514662 | 1214 | 0.000026 | org.postgresql |
282 | 19513292 | 691 | 0.000042 | com.xinhuanet |
283 | 19508378 | 1368 | 0.000024 | de.mpg |
284 | 19508326 | 525 | 0.000052 | com.squareup |
285 | 19507892 | 408 | 0.000067 | org.debian |
286 | 19502082 | 121 | 0.000252 | com.paypalobjects |
287 | 19501986 | 716 | 0.000041 | gov.senate |
288 | 19501788 | 2392 | 0.000016 | com.pearltrees |
289 | 19500240 | 1147 | 0.000028 | com.500px |
290 | 19499046 | 343 | 0.000081 | com.googlecode |
291 | 19497980 | 712 | 0.000041 | org.change |
292 | 19497516 | 491 | 0.000056 | com.tandfonline |
293 | 19496848 | 67 | 0.000505 | net.akamaihd |
294 | 19492076 | 1265 | 0.000025 | com.aljazeera |
295 | 19492054 | 706 | 0.000041 | com.qualtrics |
296 | 19490750 | 783 | 0.000037 | com.theconversation |
297 | 19490388 | 1078 | 0.000029 | com.theglobeandmail |
298 | 19486228 | 134 | 0.000211 | de.bund |
299 | 19485788 | 1299 | 0.000025 | edu.illinois |
300 | 19485786 | 327 | 0.000084 | com.cnbc |
301 | 19484140 | 858 | 0.000036 | uk.co.guardian |
302 | 19483768 | 483 | 0.000057 | com.msn |
303 | 19475416 | 129 | 0.000219 | com.rawgit |
304 | 19472372 | 474 | 0.000059 | com.stumbleupon |
305 | 19469278 | 198 | 0.000125 | net.sourceforge |
306 | 19468982 | 356 | 0.000077 | com.optimizely |
307 | 19468656 | 470 | 0.000059 | org.openstreetmap |
308 | 19467526 | 335 | 0.000083 | com.techcrunch |
309 | 19465998 | 434 | 0.000064 | com.ssl-images-amazon |
310 | 19464188 | 1405 | 0.000023 | edu.ufl |
311 | 19462912 | 1395 | 0.000023 | edu.gatech |
312 | 19462816 | 165 | 0.000162 | com.hubspot |
313 | 19462736 | 310 | 0.000087 | com.mapbox |
314 | 19462404 | 441 | 0.000063 | com.go |
315 | 19459072 | 608 | 0.000046 | gov.noaa |
316 | 19458846 | 1470 | 0.000023 | com.channel4 |
317 | 19458794 | 1237 | 0.000026 | ca.sfu |
318 | 19457698 | 592 | 0.000047 | com.healthline |
319 | 19457660 | 794 | 0.000037 | org.fao |
320 | 19457528 | 507 | 0.000054 | ca.google |
321 | 19457170 | 2431 | 0.000016 | com.wattpad |
322 | 19454268 | 1280 | 0.000025 | uk.co.standard |
323 | 19452678 | 667 | 0.000043 | gov.house |
324 | 19451936 | 1309 | 0.000025 | uk.co.wired |
325 | 19450294 | 1862 | 0.000019 | com.invisionapp |
326 | 19449754 | 743 | 0.000039 | com.pinimg |
327 | 19449738 | 184 | 0.000138 | com.amazon-adsystem |
328 | 19449480 | 1836 | 0.000019 | org.maven |
329 | 19446242 | 2507 | 0.000015 | com.openai |
330 | 19443698 | 803 | 0.000037 | org.pypi |
331 | 19442142 | 262 | 0.000101 | net.azureedge |
332 | 19441000 | 490 | 0.000056 | com.kickstarter |
333 | 19439570 | 1962 | 0.000019 | uk.bl |
334 | 19439402 | 1236 | 0.000026 | au.com.smh |
335 | 19436904 | 1339 | 0.000024 | com.vanityfair |
336 | 19435504 | 261 | 0.000102 | uk.org.ico |
337 | 19434368 | 153 | 0.000176 | com.addtoany |
338 | 19427034 | 986 | 0.000032 | com.uk |
339 | 19426114 | 1097 | 0.000029 | com.scmp |
340 | 19424036 | 981 | 0.000033 | org.pnas |
341 | 19422474 | 433 | 0.000064 | com.cnet |
342 | 19422174 | 348 | 0.000080 | com.statista |
343 | 19421360 | 149 | 0.000180 | org.nodejs |
344 | 19418836 | 793 | 0.000037 | us.icio |
345 | 19416290 | 2916 | 0.000013 | com.instapaper |
346 | 19415752 | 489 | 0.000056 | gov.epa |
347 | 19405682 | 1003 | 0.000032 | com.mixcloud |
348 | 19404500 | 677 | 0.000042 | org.d3js |
349 | 19401872 | 851 | 0.000036 | com.britannica |
350 | 19400204 | 593 | 0.000047 | uk.gov.service |
351 | 19399466 | 177 | 0.000143 | org.allaboutcookies |
352 | 19396954 | 546 | 0.000050 | edu.berkeley |
353 | 19395162 | 296 | 0.000091 | me.telegram |
354 | 19393670 | 1436 | 0.000023 | com.irishtimes |
355 | 19392716 | 944 | 0.000034 | int.coe |
356 | 19388874 | 157 | 0.000170 | com.zendesk |
357 | 19388222 | 1507 | 0.000022 | org.hrc |
358 | 19387040 | 1251 | 0.000025 | com.history |
359 | 19386872 | 152 | 0.000178 | io.shields |
360 | 19386294 | 1686 | 0.000021 | ms.1drv |
361 | 19384766 | 548 | 0.000050 | com.biomedcentral |
362 | 19384760 | 473 | 0.000059 | com.latimes |
363 | 19381234 | 1062 | 0.000030 | org.jstor |
364 | 19381206 | 1124 | 0.000028 | com.jetbrains |
365 | 19376152 | 1084 | 0.000029 | org.ilo |
366 | 19376036 | 777 | 0.000038 | edu.psu |
367 | 19375334 | 137 | 0.000207 | com.youronlinechoices |
368 | 19374986 | 895 | 0.000035 | com.ecwid |
369 | 19371930 | 1067 | 0.000030 | com.brightcove |
370 | 19371460 | 748 | 0.000039 | it.scoop |
371 | 19369410 | 329 | 0.000084 | ru.ok |
372 | 19364910 | 1226 | 0.000026 | com.digitaltrends |
373 | 19362788 | 1004 | 0.000032 | uk.co.thetimes |
374 | 19359762 | 1404 | 0.000023 | com.thedailybeast |
375 | 19359122 | 1604 | 0.000022 | edu.osu |
376 | 19354290 | 513 | 0.000054 | edu.yale |
377 | 19351764 | 116 | 0.000262 | com.jimdo |
378 | 19349800 | 2354 | 0.000016 | com.fastcodesign |
379 | 19349466 | 988 | 0.000032 | uk.parliament |
380 | 19348128 | 456 | 0.000061 | org.freecodecamp |
381 | 19343488 | 2209 | 0.000018 | com.us |
382 | 19340214 | 573 | 0.000048 | com.deloitte |
383 | 19339976 | 1010 | 0.000031 | uk.co.huffingtonpost |
384 | 19339738 | 605 | 0.000046 | com.zdnet |
385 | 19339098 | 181 | 0.000139 | ru.mail |
386 | 19337572 | 415 | 0.000066 | com.elsevier |
387 | 19335810 | 1185 | 0.000027 | org.nejm |
388 | 19335572 | 2422 | 0.000016 | com.instructure |
389 | 19335456 | 427 | 0.000065 | net.imgix |
390 | 19334596 | 1714 | 0.000021 | com.citrix |
391 | 19330958 | 2590 | 0.000014 | org.aclweb |
392 | 19330886 | 1964 | 0.000018 | org.haskell |
393 | 19326754 | 649 | 0.000044 | gov.state |
394 | 19326634 | 1350 | 0.000024 | app.netlify |
395 | 19326068 | 801 | 0.000037 | com.venturebeat |
396 | 19323896 | 217 | 0.000118 | com.eventbrite |
397 | 19323876 | 622 | 0.000045 | com.seattletimes |
398 | 19323284 | 1868 | 0.000019 | jp.ac.u-tokyo |
399 | 19322408 | 3048 | 0.000012 | org.uxplanet |
400 | 19319794 | 1186 | 0.000027 | com.dw |
401 | 19318404 | 1248 | 0.000026 | org.undp |
402 | 19317950 | 211 | 0.000120 | com.etsy |
403 | 19317948 | 1763 | 0.000020 | com.itv |
404 | 19317548 | 233 | 0.000112 | net.php |
405 | 19314522 | 58 | 0.000638 | com.googleadservices |
406 | 19314004 | 271 | 0.000098 | com.surveymonkey |
407 | 19310004 | 245 | 0.000107 | org.aboutcookies |
408 | 19309574 | 1900 | 0.000019 | edu.vt |
409 | 19307434 | 2477 | 0.000015 | org.wikibooks |
410 | 19305780 | 687 | 0.000042 | gov.nist |
411 | 19297658 | 1423 | 0.000023 | com.thehindu |
412 | 19297142 | 1120 | 0.000028 | org.hrw |
413 | 19295118 | 600 | 0.000046 | com.thinkwithgoogle |
414 | 19294574 | 1682 | 0.000021 | gov.usembassy |
415 | 19294274 | 656 | 0.000044 | com.intel |
416 | 19292884 | 1725 | 0.000021 | int.unfccc |
417 | 19291806 | 394 | 0.000070 | com.ebay |
418 | 19289908 | 2419 | 0.000016 | google.ai |
419 | 19286562 | 2270 | 0.000017 | com.netvibes |
420 | 19285156 | 2562 | 0.000015 | io.material |
421 | 19283106 | 2235 | 0.000017 | ly.rebrand |
422 | 19280870 | 1954 | 0.000019 | org.archlinux |
423 | 19280114 | 878 | 0.000035 | uk.co.pinterest |
424 | 19279216 | 2833 | 0.000013 | org.doctorswithoutborders |
425 | 19277590 | 2069 | 0.000018 | org.accessnow |
426 | 19272506 | 1482 | 0.000023 | com.findlaw |
427 | 19271938 | 800 | 0.000037 | net.clickbank |
428 | 19270876 | 3536 | 0.000010 | com.viki |
429 | 19269508 | 980 | 0.000033 | edu.brookings |
430 | 19265638 | 2363 | 0.000016 | co.carrd |
431 | 19265518 | 2950 | 0.000012 | org.neocities |
432 | 19261700 | 1294 | 0.000025 | com.wikia |
433 | 19260608 | 657 | 0.000044 | com.mashable |
434 | 19260346 | 798 | 0.000037 | com.thelancet |
435 | 19259074 | 974 | 0.000033 | uk.ac.cam |
436 | 19258964 | 2416 | 0.000016 | org.rsf |
437 | 19258786 | 1841 | 0.000019 | net.daringfireball |
438 | 19255684 | 708 | 0.000041 | com.canva |
439 | 19255674 | 495 | 0.000056 | gov.whitehouse |
440 | 19253374 | 204 | 0.000122 | com.salesforce |
441 | 19252328 | 1191 | 0.000027 | com.thenextweb |
442 | 19251934 | 2076 | 0.000018 | com.france24 |
443 | 19251914 | 534 | 0.000052 | io.codepen |
444 | 19250670 | 2896 | 0.000013 | com.laweekly |
445 | 19250196 | 1218 | 0.000026 | com.licdn |
446 | 19248894 | 2839 | 0.000013 | cc.uxdesign |
447 | 19245136 | 2368 | 0.000016 | edu.kit |
448 | 19240312 | 1071 | 0.000030 | watch.fb |
449 | 19239224 | 2583 | 0.000014 | org.scala-lang |
450 | 19238926 | 2513 | 0.000015 | au.com.theage |
451 | 19234622 | 2644 | 0.000014 | com.hubpages |
452 | 19232860 | 1533 | 0.000022 | ch.ipcc |
453 | 19232358 | 1092 | 0.000029 | com.digitaloceanspaces |
454 | 19231078 | 2435 | 0.000015 | org.vim |
455 | 19227408 | 1721 | 0.000021 | com.refinery29 |
456 | 19227102 | 292 | 0.000093 | net.secureservercdn |
457 | 19225996 | 769 | 0.000038 | com.marketwatch |
458 | 19224690 | 2608 | 0.000014 | app.web |
459 | 19224666 | 1681 | 0.000022 | org.unwomen |
460 | 19223622 | 2447 | 0.000015 | com.fineartamerica |
461 | 19222710 | 2566 | 0.000015 | nl.blogspot |
462 | 19219678 | 537 | 0.000051 | edu.cmu |
463 | 19219662 | 505 | 0.000054 | fr.free |
464 | 19217122 | 831 | 0.000036 | com.box |
465 | 19216944 | 1159 | 0.000027 | com.imageshack |
466 | 19215358 | 2409 | 0.000016 | edu.usf |
467 | 19214138 | 2396 | 0.000016 | nz.co.nzherald |
468 | 19212598 | 2758 | 0.000013 | com.smashwords |
469 | 19208544 | 364 | 0.000074 | net.datatables |
470 | 19207930 | 419 | 0.000066 | com.nationalgeographic |
471 | 19207832 | 287 | 0.000095 | com.iubenda |
472 | 19206220 | 2470 | 0.000015 | re.appsto |
473 | 19205746 | 235 | 0.000112 | com.adnxs |
474 | 19203826 | 2509 | 0.000015 | org.gentoo |
475 | 19203684 | 1982 | 0.000018 | com.voanews |
476 | 19203064 | 2498 | 0.000015 | com.superuser |
477 | 19201090 | 379 | 0.000072 | com.businesswire |
478 | 19200162 | 643 | 0.000045 | int.wipo |
479 | 19199426 | 2201 | 0.000018 | org.biorxiv |
480 | 19198874 | 1451 | 0.000023 | org.amnesty |
481 | 19198454 | 2436 | 0.000015 | com.oregonlive |
482 | 19198448 | 2033 | 0.000018 | org.nobelprize |
483 | 19197824 | 81 | 0.000414 | net.jsfiddle |
484 | 19197384 | 1963 | 0.000019 | com.ew |
485 | 19195648 | 1008 | 0.000031 | com.arstechnica |
486 | 19194700 | 1826 | 0.000020 | org.ocks |
487 | 19194656 | 265 | 0.000101 | com.aliyuncs |
488 | 19192314 | 2649 | 0.000014 | com.dezeen |
489 | 19191524 | 2678 | 0.000014 | org.transparency |
490 | 19191474 | 925 | 0.000035 | org.mediawiki |
491 | 19191020 | 2853 | 0.000013 | com.scribblelive |
492 | 19190866 | 1357 | 0.000024 | io.gitlab |
493 | 19190776 | 1683 | 0.000021 | org.aiga |
494 | 19188994 | 1985 | 0.000018 | uk.gov.tfl |
495 | 19186250 | 428 | 0.000064 | com.adweek |
496 | 19185528 | 1941 | 0.000019 | org.unep |
497 | 19185444 | 430 | 0.000064 | org.js |
498 | 19184030 | 371 | 0.000073 | com.atlassian |
499 | 19183274 | 2282 | 0.000017 | com.foreignpolicy |
500 | 19181288 | 2696 | 0.000014 | org.democracynow |
501 | 19181160 | 985 | 0.000032 | com.webs |
502 | 19181124 | 1198 | 0.000026 | com.wetransfer |
503 | 19179532 | 1369 | 0.000024 | org.altervista |
504 | 19177814 | 2501 | 0.000015 | google.research |
505 | 19177102 | 2959 | 0.000012 | za.co.iol |
506 | 19175572 | 1028 | 0.000031 | com.slate |
507 | 19175528 | 2713 | 0.000014 | org.cpj |
508 | 19174456 | 2016 | 0.000018 | org.example |
509 | 19173782 | 2390 | 0.000016 | com.googlegroups |
510 | 19167902 | 243 | 0.000107 | com.naver |
511 | 19164304 | 2266 | 0.000017 | net.openid |
512 | 19164154 | 3058 | 0.000012 | com.deepmind |
513 | 19164022 | 269 | 0.000099 | org.drupal |
514 | 19163716 | 264 | 0.000101 | gov.ca |
515 | 19163714 | 414 | 0.000067 | com.livechatinc |
516 | 19155586 | 2328 | 0.000016 | com.washingtontimes |
517 | 19153082 | 637 | 0.000045 | com.cbsnews |
518 | 19151824 | 759 | 0.000038 | com.oreilly |
519 | 19150012 | 3034 | 0.000012 | com.podomatic |
520 | 19149538 | 664 | 0.000043 | gov.loc |
521 | 19147634 | 136 | 0.000208 | org.networkadvertising |
522 | 19146702 | 718 | 0.000041 | com.buzzfeed |
523 | 19144896 | 1333 | 0.000024 | link.page |
524 | 19143440 | 838 | 0.000036 | com.pcmag |
525 | 19142224 | 956 | 0.000034 | com.verisign |
526 | 19133476 | 2892 | 0.000013 | com.thoughtworks |
527 | 19132758 | 2669 | 0.000014 | uk.co.timesonline |
528 | 19131302 | 274 | 0.000097 | com.getbootstrap |
529 | 19130872 | 3082 | 0.000012 | com.mariadb |
530 | 19129650 | 1116 | 0.000028 | com.jekyllrb |
531 | 19128992 | 938 | 0.000034 | com.vox |
532 | 19127508 | 127 | 0.000234 | info.aboutads |
533 | 19122362 | 492 | 0.000056 | com.patreon |
534 | 19122034 | 2488 | 0.000015 | com.curbed |
535 | 19121736 | 514 | 0.000054 | it.placehold |
536 | 19121622 | 1807 | 0.000020 | com.ascentlawfirm |
537 | 19118802 | 227 | 0.000114 | to.amzn |
538 | 19117462 | 580 | 0.000047 | com.visualstudio |
539 | 19117426 | 1281 | 0.000025 | com.smashingmagazine |
540 | 19116926 | 499 | 0.000055 | com.sxsw |
541 | 19116922 | 978 | 0.000033 | com.hootsuite |
542 | 19116384 | 282 | 0.000095 | gov.ftc |
543 | 19113570 | 2336 | 0.000016 | com.snopes |
544 | 19110698 | 1392 | 0.000023 | com.upwork |
545 | 19109920 | 1388 | 0.000024 | com.haaretz |
546 | 19108142 | 1701 | 0.000021 | com.firebaseapp |
547 | 19104686 | 920 | 0.000035 | com.zoho |
548 | 19103768 | 3023 | 0.000012 | org.peta |
549 | 19100220 | 1174 | 0.000027 | com.att |
550 | 19097502 | 1687 | 0.000021 | com.techrepublic |
551 | 19097348 | 1776 | 0.000020 | com.surveygizmo |
552 | 19097050 | 2394 | 0.000016 | com.treehugger |
553 | 19095294 | 3359 | 0.000011 | com.letterboxd |
554 | 19094856 | 3025 | 0.000012 | gov.anl |
555 | 19094436 | 2568 | 0.000015 | com.kaggle |
556 | 19091430 | 2479 | 0.000015 | fm.omny |
557 | 19091422 | 2999 | 0.000012 | com.bangkokpost |
558 | 19089542 | 478 | 0.000058 | gov.irs |
559 | 19086962 | 1790 | 0.000020 | ca.bc.gov |
560 | 19086880 | 823 | 0.000036 | com.emarketer |
561 | 19086854 | 1173 | 0.000027 | com.mediaplex |
562 | 19086370 | 259 | 0.000103 | uk.co.amazon |
563 | 19084140 | 2737 | 0.000014 | int.au |
564 | 19083740 | 2514 | 0.000015 | no.google |
565 | 19083612 | 3618 | 0.000010 | com.newgrounds |
566 | 19083596 | 186 | 0.000134 | jp.co.yahoo |
567 | 19082852 | 3108 | 0.000012 | org.hypotheses |
568 | 19082332 | 337 | 0.000082 | mp.mailchi |
569 | 19082228 | 2808 | 0.000013 | com.usmagazine |
570 | 19080648 | 1674 | 0.000022 | com.routledge |
571 | 19078904 | 2881 | 0.000013 | org.polymer-project |
572 | 19077732 | 2446 | 0.000015 | org.unctad |
573 | 19077060 | 180 | 0.000140 | com.caniuse |
574 | 19076142 | 344 | 0.000080 | com.onesignal |
575 | 19073714 | 2714 | 0.000014 | int.interpol |
576 | 19072522 | 3248 | 0.000011 | org.elasticsearch |
577 | 19072218 | 620 | 0.000045 | com.entrepreneur |
578 | 19072108 | 2550 | 0.000015 | uk.gov.metoffice |
579 | 19071016 | 2921 | 0.000013 | org.jenkins-ci |
580 | 19070052 | 632 | 0.000045 | com.samsung |
581 | 19070008 | 1367 | 0.000024 | org.unicode |
582 | 19069412 | 3381 | 0.000011 | uk.mod |
583 | 19069358 | 2715 | 0.000014 | org.mozillazine |
584 | 19067032 | 3148 | 0.000011 | edu.ucpress |
585 | 19066706 | 1156 | 0.000027 | com.gizmodo |
586 | 19064356 | 1901 | 0.000019 | org.americanbar |
587 | 19063358 | 3593 | 0.000010 | org.scala-sbt |
588 | 19062892 | 330 | 0.000084 | ai.shortpixel |
589 | 19059914 | 2912 | 0.000013 | in.indiatoday |
590 | 19058702 | 301 | 0.000090 | gg.discord |
591 | 19058544 | 3687 | 0.000010 | jp.riken |
592 | 19056820 | 2440 | 0.000015 | com.timesofisrael |
593 | 19056518 | 3064 | 0.000012 | com.manta |
594 | 19056166 | 785 | 0.000037 | com.fandom |
595 | 19056052 | 1274 | 0.000025 | com.sfgate |
596 | 19054812 | 1994 | 0.000018 | com.knightlab |
597 | 19053684 | 2042 | 0.000018 | org.donorbox |
598 | 19053668 | 2251 | 0.000017 | eu.politico |
599 | 19051874 | 2494 | 0.000015 | org.gnupg |
600 | 19051168 | 84 | 0.000402 | me.ogp |
601 | 19050784 | 575 | 0.000048 | com.cisco |
602 | 19050146 | 2757 | 0.000013 | uk.ac.york |
603 | 19048588 | 1189 | 0.000027 | com.buffer |
604 | 19048534 | 3065 | 0.000012 | uk.org.wwf |
605 | 19047192 | 929 | 0.000035 | com.variety |
606 | 19045218 | 3517 | 0.000010 | com.flightradar24 |
607 | 19044416 | 3387 | 0.000011 | com.flock |
608 | 19044368 | 579 | 0.000048 | com.sedo |
609 | 19044084 | 871 | 0.000035 | com.libsyn |
610 | 19043162 | 2561 | 0.000015 | com.thenation |
611 | 19042992 | 2569 | 0.000015 | com.monday |
612 | 19042226 | 482 | 0.000057 | com.arcgis |
613 | 19042098 | 3223 | 0.000011 | net.inquirer |
614 | 19038824 | 2699 | 0.000014 | com.real |
615 | 19036762 | 2195 | 0.000018 | com.secondlife |
616 | 19035414 | 732 | 0.000040 | org.unesco |
617 | 19035292 | 932 | 0.000035 | com.wikihow |
618 | 19034196 | 2609 | 0.000014 | uk.ac.leeds |
619 | 19033676 | 80 | 0.000415 | com.livestream |
620 | 19031566 | 3100 | 0.000012 | org.cato |
621 | 19029288 | 2716 | 0.000014 | org.sonatype |
622 | 19028098 | 3169 | 0.000011 | com.intensedebate |
623 | 19028006 | 1089 | 0.000029 | com.symantec |
624 | 19027462 | 4048 | 0.000009 | org.jw |
625 | 19027208 | 2793 | 0.000013 | com.wayfair |
626 | 19026864 | 1922 | 0.000019 | com.scene7 |
627 | 19026030 | 76 | 0.000421 | com.messenger |
628 | 19025656 | 1689 | 0.000021 | org.coursera |
629 | 19024592 | 1196 | 0.000026 | edu.umn |
630 | 19024030 | 3093 | 0.000012 | org.rferl |
631 | 19023590 | 2512 | 0.000015 | org.wikidata |
632 | 19022464 | 644 | 0.000045 | com.psychologytoday |
633 | 19021606 | 3091 | 0.000012 | com.vancouversun |
634 | 19021016 | 2496 | 0.000015 | uk.org.nationaltrust |
635 | 19020356 | 1553 | 0.000022 | ly.ow |
636 | 19020300 | 1264 | 0.000025 | edu.ucsd |
637 | 19020198 | 2905 | 0.000013 | tr.com.aa |
638 | 19018958 | 3767 | 0.000010 | it.polito |
639 | 19017674 | 3389 | 0.000011 | org.sourcewatch |
640 | 19017264 | 3207 | 0.000011 | ch.qos |
641 | 19017144 | 3785 | 0.000010 | jp.ac.kobe-u |
642 | 19016500 | 1659 | 0.000022 | com.speakerdeck |
643 | 19015604 | 2974 | 0.000012 | com.sciencealert |
644 | 19015034 | 636 | 0.000045 | com.photobucket |
645 | 19015026 | 3087 | 0.000012 | com.hsbc |
646 | 19014412 | 3852 | 0.000009 | edu.uah |
647 | 19013454 | 188 | 0.000133 | com.jimcdn |
648 | 19012700 | 1195 | 0.000027 | com.rollingstone |
649 | 19012558 | 2897 | 0.000013 | org.osce |
650 | 19012150 | 4205 | 0.000009 | com.gust |
651 | 19009874 | 1684 | 0.000021 | org.webkit |
652 | 19009396 | 945 | 0.000034 | com.shutterstock |
653 | 19008674 | 2945 | 0.000012 | com.townnews |
654 | 19008318 | 2650 | 0.000014 | org.wri |
655 | 19006196 | 520 | 0.000053 | com.inc |
656 | 19004672 | 648 | 0.000044 | com.gartner |
657 | 19004226 | 2502 | 0.000015 | ru.rg |
658 | 19003942 | 2648 | 0.000014 | io.bower |
659 | 19003780 | 3371 | 0.000011 | net.thedailystar |
660 | 19003722 | 2564 | 0.000015 | net.dwcdn |
661 | 19003574 | 2770 | 0.000013 | com.articulate |
662 | 19003510 | 221 | 0.000117 | com.myshopify |
663 | 19002868 | 172 | 0.000151 | jp.co.google |
664 | 19002548 | 1354 | 0.000024 | gov.uspto |
665 | 19000824 | 998 | 0.000032 | edu.ucla |
666 | 18998632 | 685 | 0.000042 | com.investopedia |
667 | 18998502 | 3161 | 0.000011 | com.mongabay |
668 | 18997700 | 532 | 0.000052 | com.aol |
669 | 18994210 | 2352 | 0.000016 | ca.citizenlab |
670 | 18993878 | 1284 | 0.000025 | com.today |
671 | 18992626 | 160 | 0.000167 | org.whatwg |
672 | 18992320 | 1048 | 0.000030 | com.smartadserver |
673 | 18992054 | 2995 | 0.000012 | org.pewforum |
674 | 18991266 | 2997 | 0.000012 | org.sierraclub |
675 | 18991062 | 2964 | 0.000012 | net.vnexpress |
676 | 18990848 | 1069 | 0.000030 | com.about |
677 | 18989274 | 3081 | 0.000012 | uk.co.spectator |
678 | 18988482 | 480 | 0.000058 | com.dmca |
679 | 18987042 | 1462 | 0.000023 | ly.cutt |
680 | 18986890 | 3224 | 0.000011 | ru.interfax |
681 | 18986546 | 3670 | 0.000010 | uk.co.zoopla |
682 | 18985004 | 2843 | 0.000013 | org.iucnredlist |
683 | 18984682 | 194 | 0.000130 | com.tripadvisor |
684 | 18984256 | 3473 | 0.000010 | fm.audioboo |
685 | 18983654 | 2762 | 0.000013 | uk.co.bbci |
686 | 18983098 | 3416 | 0.000011 | edu.sjsu |
687 | 18982290 | 1444 | 0.000023 | edu.northwestern |
688 | 18982040 | 543 | 0.000051 | com.googleoptimize |
689 | 18980160 | 2817 | 0.000013 | int.iom |
690 | 18979598 | 1386 | 0.000024 | edu.umd |
691 | 18978832 | 629 | 0.000045 | org.eff |
692 | 18978224 | 2297 | 0.000017 | uk.org.ofcom |
693 | 18978038 | 2450 | 0.000015 | int.reliefweb |
694 | 18977708 | 3502 | 0.000010 | com.torontosun |
695 | 18975348 | 493 | 0.000056 | com.indeed |
696 | 18973238 | 1657 | 0.000022 | com.nngroup |
697 | 18972898 | 351 | 0.000078 | com.constantcontact |
698 | 18972774 | 1780 | 0.000020 | co.lpages |
699 | 18972434 | 1329 | 0.000024 | edu.utexas |
700 | 18971302 | 3386 | 0.000011 | com.iconarchive |
701 | 18971240 | 312 | 0.000087 | com.pubmatic |
702 | 18971078 | 1043 | 0.000030 | org.reactjs |
703 | 18969428 | 975 | 0.000033 | edu.umich |
704 | 18968428 | 1219 | 0.000026 | com.tableau |
705 | 18968208 | 1914 | 0.000019 | com.hatenablog |
706 | 18967574 | 1138 | 0.000028 | com.chicagotribune |
707 | 18967196 | 3999 | 0.000009 | info.spain |
708 | 18965740 | 547 | 0.000050 | gov.copyright |
709 | 18965442 | 4171 | 0.000009 | org.gwtproject |
710 | 18964656 | 650 | 0.000044 | com.netflix |
711 | 18963714 | 753 | 0.000039 | net.adform |
712 | 18961462 | 2847 | 0.000013 | uk.ac.jisc |
713 | 18961172 | 2865 | 0.000013 | com.ringcentral |
714 | 18960292 | 976 | 0.000033 | com.redhat |
715 | 18960280 | 3237 | 0.000011 | com.city-data |
716 | 18959938 | 2982 | 0.000012 | uk.org.stonewall |
717 | 18958764 | 3646 | 0.000010 | za.co.timeslive |
718 | 18957560 | 3989 | 0.000009 | com.programmableweb |
719 | 18957204 | 403 | 0.000068 | com.bigcommerce |
720 | 18957166 | 3053 | 0.000012 | com.flippa |
721 | 18955710 | 3293 | 0.000011 | com.multiscreensite |
722 | 18955294 | 2719 | 0.000014 | com.bloglines |
723 | 18954560 | 2629 | 0.000014 | mp.j |
724 | 18952520 | 2807 | 0.000013 | uk.org.rspb |
725 | 18952358 | 2949 | 0.000012 | com.foreignaffairs |
726 | 18952314 | 2206 | 0.000018 | co.pcdn |
727 | 18951462 | 3549 | 0.000010 | in.theprint |
728 | 18951006 | 4227 | 0.000009 | com.symbaloo |
729 | 18950992 | 4478 | 0.000008 | com.algorithmia |
730 | 18950356 | 1733 | 0.000021 | com.billboard |
731 | 18949998 | 742 | 0.000039 | com.splashthat |
732 | 18948332 | 3255 | 0.000011 | com.cleantechnica |
733 | 18947926 | 3604 | 0.000010 | com.businessdailyafrica |
734 | 18947204 | 1108 | 0.000028 | com.dell |
735 | 18947190 | 2825 | 0.000013 | com.yell |
736 | 18947008 | 443 | 0.000062 | net.hubspot |
737 | 18946944 | 3838 | 0.000010 | org.rfa |
738 | 18946618 | 3495 | 0.000010 | za.co.mg |
739 | 18945038 | 4346 | 0.000008 | com.apsense |
740 | 18944960 | 1772 | 0.000020 | com.alibabagroup |
741 | 18944660 | 2267 | 0.000017 | to.dev |
742 | 18944558 | 3471 | 0.000010 | ru.mid |
743 | 18944274 | 3498 | 0.000010 | com.itsnicethat |
744 | 18942634 | 527 | 0.000052 | org.unicef |
745 | 18942358 | 2364 | 0.000016 | net.noscript |
746 | 18940606 | 1390 | 0.000024 | com.techradar |
747 | 18938348 | 1857 | 0.000019 | edu.uci |
748 | 18937064 | 1118 | 0.000028 | com.windowsphone |
749 | 18936626 | 2734 | 0.000014 | com.doubleclickbygoogle |
750 | 18936326 | 3524 | 0.000010 | org.350 |
751 | 18935080 | 3076 | 0.000012 | org.aei |
752 | 18934558 | 3075 | 0.000012 | gov.arts |
753 | 18934248 | 671 | 0.000043 | gov.sec |
754 | 18933682 | 2298 | 0.000017 | com.urbandictionary |
755 | 18933596 | 3925 | 0.000009 | com.forbesimg |
756 | 18933310 | 487 | 0.000056 | com.fc2 |
757 | 18931436 | 3352 | 0.000011 | com.brill |
758 | 18931406 | 2491 | 0.000015 | com.infoworld |
759 | 18930782 | 1352 | 0.000024 | com.bazaarvoice |
760 | 18930350 | 3600 | 0.000010 | de.uni-konstanz |
761 | 18930232 | 1187 | 0.000027 | com.alexa |
762 | 18929982 | 2240 | 0.000017 | org.linuxfoundation |
763 | 18929738 | 3580 | 0.000010 | edu.dukeupress |
764 | 18929218 | 4038 | 0.000009 | com.hotfrog |
765 | 18928884 | 512 | 0.000054 | com.mckinsey |
766 | 18928710 | 2539 | 0.000015 | org.crossref |
767 | 18928328 | 3893 | 0.000009 | com.environmentalleader |
768 | 18927900 | 2236 | 0.000017 | tv.ustream |
769 | 18927290 | 1101 | 0.000029 | fm.last |
770 | 18926906 | 1951 | 0.000019 | com.businessweek |
771 | 18926816 | 413 | 0.000067 | org.opensource |
772 | 18925308 | 750 | 0.000039 | org.whatbrowser |
773 | 18925012 | 1296 | 0.000025 | com.merriam-webster |
774 | 18924400 | 425 | 0.000065 | com.proofpoint |
775 | 18923302 | 3196 | 0.000011 | com.alchemer |
776 | 18922680 | 3684 | 0.000010 | com.arfadia |
777 | 18922120 | 1692 | 0.000021 | com.kinstacdn |
778 | 18921334 | 3619 | 0.000010 | com.ecowatch |
779 | 18921302 | 2215 | 0.000018 | net.leadpages |
780 | 18920188 | 3448 | 0.000010 | com.total |
781 | 18920112 | 3878 | 0.000009 | uk.org.npg |
782 | 18919836 | 3054 | 0.000012 | io.crates |
783 | 18919320 | 2517 | 0.000015 | com.lego |
784 | 18919150 | 503 | 0.000055 | com.wufoo |
785 | 18915478 | 2742 | 0.000014 | io.redis |
786 | 18914956 | 2289 | 0.000017 | uk.co.metro |
787 | 18914016 | 4161 | 0.000009 | uk.co.theweek |
788 | 18913930 | 2204 | 0.000018 | gd.is |
789 | 18913640 | 4196 | 0.000009 | io.coda |
790 | 18913482 | 196 | 0.000128 | com.hackerone |
791 | 18912094 | 1483 | 0.000023 | com.msdn |
792 | 18911500 | 156 | 0.000170 | org.nginx |
793 | 18911390 | 3197 | 0.000011 | com.klokantech |
794 | 18911286 | 1668 | 0.000022 | com.sky |
795 | 18910142 | 4272 | 0.000009 | de.fernuni-hagen |
796 | 18909064 | 1832 | 0.000020 | de.hessen |
797 | 18908834 | 953 | 0.000034 | com.adroll |
798 | 18907960 | 1986 | 0.000018 | com.windows |
799 | 18906254 | 4316 | 0.000008 | com.tupalo |
800 | 18904242 | 218 | 0.000118 | org.icann |
801 | 18904004 | 1148 | 0.000028 | net.atlassian |
802 | 18903442 | 4234 | 0.000009 | net.ccm |
803 | 18903372 | 3808 | 0.000010 | com.oilprice |
804 | 18903128 | 1956 | 0.000019 | org.khanacademy |
805 | 18902896 | 4072 | 0.000009 | net.iwpr |
806 | 18902418 | 324 | 0.000084 | eu.youronlinechoices |
807 | 18902318 | 3890 | 0.000009 | uk.ac.mmu |
808 | 18901968 | 1700 | 0.000021 | edu.usc |
809 | 18901674 | 1146 | 0.000028 | com.playstation |
810 | 18900854 | 4268 | 0.000009 | uk.ac.ceh |
811 | 18900236 | 1060 | 0.000030 | com.akamai |
812 | 18897754 | 2851 | 0.000013 | com.hindustantimes |
813 | 18896694 | 979 | 0.000033 | gov.fcc |
814 | 18896368 | 990 | 0.000032 | com.gumroad |
815 | 18896128 | 4383 | 0.000008 | et.com.google |
816 | 18894652 | 3952 | 0.000009 | com.theoutline |
817 | 18894586 | 4348 | 0.000008 | org.cgsociety |
818 | 18892502 | 4093 | 0.000009 | edu.mtsu |
819 | 18892446 | 2636 | 0.000014 | com.html5rocks |
820 | 18892222 | 4578 | 0.000008 | com.blockchair |
821 | 18891572 | 3603 | 0.000010 | org.spie |
822 | 18891278 | 1208 | 0.000026 | at.gv.bka |
823 | 18890814 | 3768 | 0.000010 | uk.co.lrb |
824 | 18888196 | 410 | 0.000067 | com.heroku |
825 | 18888062 | 815 | 0.000036 | edu.wisc |
826 | 18887938 | 1009 | 0.000031 | com.yoast |
827 | 18887842 | 3807 | 0.000010 | za.co.dailymaverick |
828 | 18885614 | 1864 | 0.000019 | org.json |
829 | 18885194 | 2969 | 0.000012 | org.thinkprogress |
830 | 18884928 | 700 | 0.000041 | com.feedly |
831 | 18883562 | 4278 | 0.000009 | com.ingress |
832 | 18883012 | 3706 | 0.000010 | google.design |
833 | 18882952 | 4666 | 0.000008 | com.bmwblog |
834 | 18881526 | 3862 | 0.000009 | com.thepetitionsite |
835 | 18881312 | 3993 | 0.000009 | in.bbc |
836 | 18880860 | 2237 | 0.000017 | com.w3techs |
837 | 18880532 | 3257 | 0.000011 | org.carbonbrief |
838 | 18880428 | 272 | 0.000098 | jp.ne.hatena |
839 | 18880124 | 2614 | 0.000014 | ru.mk |
840 | 18880064 | 1924 | 0.000019 | edu.hbs |
841 | 18879486 | 935 | 0.000034 | com.pingdom |
842 | 18878780 | 1199 | 0.000026 | com.ycombinator |
843 | 18876422 | 4065 | 0.000009 | com.gifer |
844 | 18876050 | 3709 | 0.000010 | uk.org.amnesty |
845 | 18875700 | 3961 | 0.000009 | com.africanews |
846 | 18875478 | 4535 | 0.000008 | com.the-dots |
847 | 18875350 | 992 | 0.000032 | so.notion |
848 | 18869944 | 3375 | 0.000011 | org.commondreams |
849 | 18869250 | 4236 | 0.000009 | com.flutterwave |
850 | 18868302 | 3731 | 0.000010 | org.refworld |
851 | 18866446 | 3285 | 0.000011 | uk.gov.charitycommission |
852 | 18866244 | 4396 | 0.000008 | com.newsru |
853 | 18865810 | 3507 | 0.000010 | uk.org.oxfam |
854 | 18865786 | 4206 | 0.000009 | uk.org.somersethouse |
855 | 18864590 | 2484 | 0.000015 | in.scroll |
856 | 18864514 | 1410 | 0.000023 | com.intuit |
857 | 18864428 | 4257 | 0.000009 | uk.co.harpercollins |
858 | 18863942 | 331 | 0.000084 | jp.ameblo |
859 | 18863622 | 3370 | 0.000011 | ke.co.nation |
860 | 18863580 | 1091 | 0.000029 | com.insurancejournal |
861 | 18863360 | 3394 | 0.000011 | com.cbsistatic |
862 | 18863302 | 2697 | 0.000014 | com.spreaker |
863 | 18862358 | 2720 | 0.000014 | com.springernature |
864 | 18861824 | 2228 | 0.000017 | com.firefox |
865 | 18861222 | 4688 | 0.000008 | co.iglobal |
866 | 18860960 | 4714 | 0.000008 | io.devdocs |
867 | 18860246 | 2705 | 0.000014 | com.verywellhealth |
868 | 18860020 | 538 | 0.000051 | com.booking |
869 | 18859838 | 535 | 0.000051 | com.gofundme |
870 | 18859798 | 1234 | 0.000026 | com.indiegogo |
871 | 18859328 | 4781 | 0.000008 | com.kdpcommunity |
872 | 18858404 | 2344 | 0.000016 | build.bazel |
873 | 18858016 | 1119 | 0.000028 | com.foursquare |
874 | 18857452 | 545 | 0.000051 | com.snapchat |
875 | 18856948 | 93 | 0.000390 | com.trustpilot |
876 | 18856546 | 2586 | 0.000014 | com.avast |
877 | 18856160 | 1813 | 0.000020 | com.pcworld |
878 | 18855278 | 4149 | 0.000009 | com.hybris |
879 | 18854982 | 4937 | 0.000008 | com.jetphotos |
880 | 18854014 | 711 | 0.000041 | com.yandex |
881 | 18853962 | 1023 | 0.000031 | com.css-tricks |
882 | 18853902 | 1360 | 0.000024 | org.golang |
883 | 18853900 | 4168 | 0.000009 | uk.ac.mdx |
884 | 18853596 | 2673 | 0.000014 | com.flipboard |
885 | 18852988 | 2848 | 0.000013 | com.discovery |
886 | 18851822 | 3904 | 0.000009 | at.kleinezeitung |
887 | 18851422 | 302 | 0.000090 | de.amazon |
888 | 18850596 | 111 | 0.000276 | me.wa |
889 | 18850558 | 429 | 0.000064 | com.skype |
890 | 18850294 | 1134 | 0.000028 | com.scientificamerican |
891 | 18848646 | 2516 | 0.000015 | org.raspberrypi |
892 | 18847770 | 4426 | 0.000008 | com.armorgames |
893 | 18847596 | 1758 | 0.000020 | com.fiverr |
894 | 18847110 | 721 | 0.000040 | org.iso |
895 | 18846464 | 2707 | 0.000014 | com.codecademy |
896 | 18843948 | 3727 | 0.000010 | net.middleeasteye |
897 | 18842876 | 3057 | 0.000012 | org.man7 |
898 | 18841074 | 4531 | 0.000008 | com.e-estonia |
899 | 18840474 | 1827 | 0.000020 | fr.blogspot |
900 | 18840282 | 1047 | 0.000030 | com.huffpost |
901 | 18839944 | 4725 | 0.000008 | net.gebco |
902 | 18839822 | 4778 | 0.000008 | com.slite |
903 | 18839776 | 1799 | 0.000020 | com.visa |
904 | 18839258 | 722 | 0.000040 | com.newrelic |
905 | 18837214 | 4163 | 0.000009 | com.cnsnews |
906 | 18836004 | 807 | 0.000037 | br.com.uol |
907 | 18834494 | 3388 | 0.000011 | com.lithub |
908 | 18834036 | 3942 | 0.000009 | net.bostonreview |
909 | 18832052 | 1022 | 0.000031 | au.com.google |
910 | 18831616 | 2958 | 0.000012 | com.hackernoon |
911 | 18831490 | 2802 | 0.000013 | com.unity |
912 | 18831230 | 249 | 0.000106 | net.2mdn |
913 | 18831090 | 1224 | 0.000026 | gov.usgs |
914 | 18830714 | 400 | 0.000068 | com.semrush |
915 | 18829732 | 3855 | 0.000009 | com.indexmundi |
916 | 18829642 | 516 | 0.000053 | com.dailymotion |
917 | 18828872 | 686 | 0.000042 | com.accenture |
918 | 18827314 | 665 | 0.000043 | org.poynter |
919 | 18826574 | 2086 | 0.000018 | org.aclu |
920 | 18826336 | 3974 | 0.000009 | org.jython |
921 | 18825792 | 1152 | 0.000027 | com.searchengineland |
922 | 18825212 | 4003 | 0.000009 | com.inthesetimes |
923 | 18824910 | 1753 | 0.000020 | com.over-blog |
924 | 18824406 | 518 | 0.000053 | nl.google |
925 | 18824128 | 3324 | 0.000011 | de.bfarm |
926 | 18823544 | 1126 | 0.000028 | com.techtarget |
927 | 18823106 | 4417 | 0.000008 | za.co.ewn |
928 | 18822694 | 4251 | 0.000009 | uk.co.bristolpost |
929 | 18822100 | 4799 | 0.000008 | community.studiopress |
930 | 18821800 | 846 | 0.000036 | gov.justice |
931 | 18820682 | 1707 | 0.000021 | com.technologyreview |
932 | 18820672 | 3923 | 0.000009 | com.recyclenow |
933 | 18819750 | 4293 | 0.000009 | lb.com.dailystar |
934 | 18819328 | 384 | 0.000071 | com.bitly |
935 | 18819088 | 4101 | 0.000009 | org.occrp |
936 | 18819058 | 3786 | 0.000010 | com.theyworkforyou |
937 | 18818798 | 4022 | 0.000009 | org.ifaw |
938 | 18818648 | 168 | 0.000161 | com.jimstatic |
939 | 18818242 | 966 | 0.000033 | sh.brew |
940 | 18818066 | 4343 | 0.000008 | com.yahoosites |
941 | 18817604 | 2321 | 0.000016 | com.fool |
942 | 18817360 | 2281 | 0.000017 | com.pastebin |
943 | 18816928 | 3607 | 0.000010 | com.gr-assets |
944 | 18815242 | 3872 | 0.000009 | com.climatechangenews |
945 | 18813886 | 4771 | 0.000008 | in.ac.iith |
946 | 18813586 | 702 | 0.000041 | org.plos |
947 | 18812812 | 4068 | 0.000009 | com.chamberofcommerce |
948 | 18812606 | 4438 | 0.000008 | us.tuugo |
949 | 18812344 | 1142 | 0.000028 | com.buzzsprout |
950 | 18812110 | 1122 | 0.000028 | com.timeanddate |
951 | 18811418 | 760 | 0.000038 | com.discordapp |
952 | 18811082 | 1153 | 0.000027 | com.sitepoint |
953 | 18809798 | 4579 | 0.000008 | com.desmogblog |
954 | 18809638 | 596 | 0.000047 | com.aliexpress |
955 | 18808906 | 2522 | 0.000015 | com.sendgrid |
956 | 18807972 | 4128 | 0.000009 | uk.ac.rcplondon |
957 | 18807934 | 2004 | 0.000018 | com.ssllabs |
958 | 18807738 | 3955 | 0.000009 | org.soilassociation |
959 | 18806592 | 1359 | 0.000024 | com.xkcd |
960 | 18806192 | 536 | 0.000051 | gov.hhs |
961 | 18805588 | 3584 | 0.000010 | com.hearstapps |
962 | 18805150 | 1289 | 0.000025 | com.searchenginejournal |
963 | 18804458 | 442 | 0.000062 | me.fb |
964 | 18804132 | 4711 | 0.000008 | net.sott |
965 | 18803628 | 4594 | 0.000008 | com.gpsvisualizer |
966 | 18803548 | 213 | 0.000120 | com.discord |
967 | 18802758 | 1820 | 0.000020 | org.mitre |
968 | 18801916 | 4744 | 0.000008 | com.natureindex |
969 | 18801374 | 3499 | 0.000010 | uk.org.rspca |
970 | 18801322 | 4087 | 0.000009 | org.c2es |
971 | 18801296 | 3824 | 0.000010 | com.qgiv |
972 | 18801288 | 3799 | 0.000010 | ug.co.monitor |
973 | 18800492 | 4596 | 0.000008 | com.lacartes |
974 | 18800384 | 178 | 0.000142 | com.xing |
975 | 18799966 | 3973 | 0.000009 | com.svbtle |
976 | 18798944 | 3875 | 0.000009 | uk.org.savethechildren |
977 | 18798932 | 4616 | 0.000008 | com.slurl |
978 | 18798332 | 2466 | 0.000015 | com.sophos |
979 | 18797956 | 2198 | 0.000018 | com.twilio |
980 | 18797008 | 4662 | 0.000008 | za.co.moneyweb |
981 | 18796288 | 4265 | 0.000009 | com.menafn |
982 | 18796048 | 3821 | 0.000010 | org.usip |
983 | 18795572 | 4584 | 0.000008 | com.power-technology |
984 | 18795368 | 4601 | 0.000008 | org.heartland |
985 | 18794834 | 675 | 0.000042 | com.usnews |
986 | 18794200 | 2557 | 0.000015 | org.usenix |
987 | 18793962 | 2899 | 0.000013 | net.privacypolicytemplate |
988 | 18793900 | 4081 | 0.000009 | org.theecologist |
989 | 18792970 | 4132 | 0.000009 | org.neweconomics |
990 | 18792680 | 1290 | 0.000025 | com.netlify |
991 | 18791954 | 4189 | 0.000009 | com.businessgreen |
992 | 18790752 | 4611 | 0.000008 | org.monthlyreview |
993 | 18790450 | 2369 | 0.000016 | uk.ac.ed |
994 | 18790194 | 2245 | 0.000017 | ch.ethz |
995 | 18789974 | 267 | 0.000099 | com.nielsen |
996 | 18789302 | 2674 | 0.000014 | ca.uwaterloo |
997 | 18788810 | 4284 | 0.000009 | org.unep-wcmc |
998 | 18787702 | 4042 | 0.000009 | org.ramsar |
999 | 18786952 | 4384 | 0.000008 | com.googlelabs |
1000 | 18786808 | 4634 | 0.000008 | org.berkeleyearth |
Credits
Thanks to the authors of the WebGraph framework, whose software made the computation of graph properties and ranks possible.
We hope the data will be useful for you to do any kind of research on ranking, graph analysis, link spam detection, etc. Let us know about your results via Common Crawl’s Google Group!