Host- and Domain-Level Web Graphs Feb/Mar/Apr 2018
We are pleased to announce a new release of host-level and domain-level web graphs based on the published crawls of February, March and April 2018. Additional information about data formats, the processing pipeline, our objectives, and credits can be found in the announcements of prior webgraph releases (e.g., Nov/Dec/Jan 2017-2018 Webgraphs).
What’s new?
The graphs now contain links from sitemap announcements in robots.txt files. This small addition of 2.5 million inter-host links is motivated by the fact that sitemaps directives are sometimes (see example 1, 2, 3) used for link spam or aggressive SEO, often in combination with excessive use of inter-host hyperlinks on HTML pages. We hope that this addition helps to improve the detection rate of link spam detection algorithms.
Host-level graph
The graph consists of 2.14 billion nodes and 10.15 billion edges and includes dangling nodes i.e. hosts that have not been crawled yet are pointed to from a link on a crawled page. There are 2.02 billion dangling nodes (94%) and the largest strongly connected component contains only 77 million (3.6%) nodes. The host names are reversed and a leading www.
is stripped: www.subdomain.example.com
becomes com.example.subdomain
.
You can download the graph and the ranks of all 2 billion hosts from AWS S3 on the path s3://commoncrawl/projects/hyperlinkgraph/cc-main-2018-feb-mar-apr/host/
. Alternatively, you can use https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2018-feb-mar-apr/host/
as prefix to access the files from everywhere.
The following files and formats are provided:
Download files of the Common Crawl Feb/Mar/Apr 2018 host-level webgraph
Size | File | Description |
---|---|---|
12.45 GB | cc-main-2018-feb-mar-apr-host-vertices.paths.gz | nodes 〈id, rev host〉, paths of 80 vertices files |
50.22 GB | cc-main-2018-feb-mar-apr-host-edges.paths.gz | edges 〈from_id, to_id〉, paths of 160 edges files |
20.68 GB | cc-main-2018-feb-mar-apr-host.graph | graph in BVGraph format |
2 kB | cc-main-2018-feb-mar-apr-host.properties | |
24.82 GB | cc-main-2018-feb-mar-apr-host-t.graph | transpose of the graph (outlinks inverted to inlinks) |
2 kB | cc-main-2018-feb-mar-apr-host-t.properties | |
1 kB | cc-main-2018-feb-mar-apr-host.stats | WebGraph statistics |
28.84 GB | cc-main-2018-feb-mar-apr-host-ranks.txt.gz | harmonic centrality and pagerank |
Domain-level graph
The domain graph was built by aggregating the host graph on the level of pay-level domains (PLDs) based on the public suffix list maintained on publicsuffix.org.
The domain-level graph has 98 million nodes and 1.5 billion edges. 57% or 56 million nodes are dangling nodes, the largest strongly connected component covers 37 million or 38% of the nodes.
All files related to the domain graph are available on AWS S3 under s3://commoncrawl/projects/hyperlinkgraph/cc-main-2018-feb-mar-apr/domain/
resp. https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2018-feb-mar-apr/domain/
.
Download files of the Common Crawl Feb/Mar/Apr 2018 domain-level webgraph
Size | File | Description |
---|---|---|
0.68 GB | cc-main-2018-feb-mar-apr-domain-vertices.txt.gz | nodes 〈id, rev domain, num hosts〉 |
6.04 GB | cc-main-2018-feb-mar-apr-domain-edges.txt.gz | edges 〈from_id, to_id〉 |
3.32 GB | cc-main-2018-feb-mar-apr-domain.graph | graph in BVGraph format |
2 kB | cc-main-2018-feb-mar-apr-domain.properties | |
3.53 GB | cc-main-2018-feb-mar-apr-domain-t.graph | transpose of the graph |
2 kB | cc-main-2018-feb-mar-apr-domain-t.properties | |
1 kB | cc-main-2018-feb-mar-apr-domain.stats | WebGraph statistics |
2.06 GB | cc-main-2018-feb-mar-apr-domain-ranks.txt.gz | harmonic centrality and pagerank |
Below you’ll find the top 1000 domains ranked by Harmonic Centrality or PageRank. The full list of all 98 million domains is available for download.
Top 1000 domains ranked by harmonic centrality (Feb/Mar/Apr 2018)
harmonic centrality rank | hc value | page rank | page rank value | reversed hostname |
---|---|---|---|---|
1 | 27160490 | 1 | 0.016926 | com.googleapis |
2 | 26917400 | 2 | 0.013683 | com.facebook |
3 | 25023208 | 3 | 0.009981 | com.google |
4 | 24241492 | 4 | 0.008519 | com.twitter |
5 | 23923990 | 5 | 0.007249 | com.youtube |
6 | 23055944 | 6 | 0.006339 | org.w |
7 | 21208132 | 7 | 0.004853 | org.gmpg |
8 | 21126452 | 8 | 0.003674 | com.instagram |
9 | 20871022 | 10 | 0.003315 | com.linkedin |
10 | 20308692 | 14 | 0.002286 | com.wordpress |
11 | 20254236 | 12 | 0.002787 | org.wordpress |
12 | 20083558 | 23 | 0.001537 | com.gravatar |
13 | 20073594 | 26 | 0.001290 | org.wikipedia |
14 | 19978538 | 18 | 0.001671 | com.pinterest |
15 | 19658798 | 11 | 0.002973 | com.bootstrapcdn |
16 | 19570742 | 20 | 0.001624 | com.apple |
17 | 19538492 | 31 | 0.000948 | com.blogspot |
18 | 19437996 | 25 | 0.001294 | com.vimeo |
19 | 19203616 | 35 | 0.000867 | gl.goo |
20 | 19193288 | 37 | 0.000853 | com.amazon |
21 | 19158752 | 17 | 0.001701 | com.adobe |
22 | 19158570 | 29 | 0.001124 | com.microsoft |
23 | 19126248 | 45 | 0.000704 | com.tumblr |
24 | 19082854 | 15 | 0.001792 | com.macromedia |
25 | 19011582 | 36 | 0.000856 | com.wp |
26 | 19005558 | 41 | 0.000794 | ly.bit |
27 | 18975638 | 54 | 0.000499 | com.yahoo |
28 | 18971200 | 16 | 0.001786 | com.googletagmanager |
29 | 18852580 | 44 | 0.000711 | be.youtu |
30 | 18806694 | 33 | 0.000921 | com.amazonaws |
31 | 18791732 | 32 | 0.000922 | com.paypal |
32 | 18760344 | 19 | 0.001634 | com.cloudflare |
33 | 18706230 | 42 | 0.000775 | com.flickr |
34 | 18680604 | 61 | 0.000433 | org.mozilla |
35 | 18680160 | 30 | 0.001017 | com.github |
36 | 18678006 | 96 | 0.000297 | com.googleusercontent |
37 | 18625646 | 69 | 0.000409 | com.weebly |
38 | 18604632 | 49 | 0.000594 | org.w3 |
39 | 18547840 | 66 | 0.000424 | org.creativecommons |
40 | 18536644 | 83 | 0.000354 | com.soundcloud |
41 | 18495276 | 24 | 0.001407 | net.doubleclick |
42 | 18465844 | 149 | 0.000207 | com.blogger |
43 | 18401620 | 147 | 0.000212 | com.imgur |
44 | 18400744 | 40 | 0.000809 | me.wp |
45 | 18397664 | 28 | 0.001163 | com.gstatic |
46 | 18392744 | 55 | 0.000498 | com.list-manage |
47 | 18391416 | 174 | 0.000162 | com.myspace |
48 | 18390430 | 67 | 0.000417 | com.medium |
49 | 18373270 | 154 | 0.000194 | net.slideshare |
50 | 18360766 | 87 | 0.000337 | io.github |
51 | 18348888 | 177 | 0.000161 | com.wsj |
52 | 18332910 | 51 | 0.000589 | co.t |
53 | 18256278 | 228 | 0.000115 | com.reuters |
54 | 18245054 | 39 | 0.000818 | org.apache |
55 | 18231016 | 38 | 0.000837 | com.statcounter |
56 | 18220940 | 236 | 0.000110 | uk.co.telegraph |
57 | 18214734 | 68 | 0.000415 | eu.europa |
58 | 18207382 | 232 | 0.000111 | org.npr |
59 | 18200074 | 292 | 0.000087 | com.appspot |
60 | 18195584 | 53 | 0.000550 | com.jquery |
61 | 18185738 | 166 | 0.000178 | com.android |
62 | 18184272 | 266 | 0.000096 | com.cnbc |
63 | 18183666 | 146 | 0.000213 | com.issuu |
64 | 18181476 | 78 | 0.000387 | com.cnn |
65 | 18170136 | 261 | 0.000099 | com.about |
66 | 18161744 | 133 | 0.000240 | com.nytimes |
67 | 18160852 | 137 | 0.000231 | com.yelp |
68 | 18152792 | 253 | 0.000102 | me.about |
69 | 18132888 | 170 | 0.000172 | com.spotify |
70 | 18111336 | 190 | 0.000146 | uk.co.bbc |
71 | 18104748 | 151 | 0.000201 | com.wixsite |
72 | 18099394 | 171 | 0.000168 | com.tripadvisor |
73 | 18098982 | 178 | 0.000160 | org.gnu |
74 | 18086240 | 204 | 0.000134 | org.wikimedia |
75 | 18085918 | 356 | 0.000072 | edu.washington |
76 | 18084938 | 43 | 0.000730 | net.cloudfront |
77 | 18080872 | 201 | 0.000135 | com.oracle |
78 | 18075484 | 282 | 0.000088 | org.python |
79 | 18065858 | 427 | 0.000063 | org.chromium |
80 | 18063268 | 165 | 0.000182 | org.ietf |
81 | 18058042 | 72 | 0.000391 | com.huffingtonpost |
82 | 18050730 | 403 | 0.000067 | edu.ucla |
83 | 18036482 | 449 | 0.000059 | edu.princeton |
84 | 18028720 | 368 | 0.000070 | com.slate |
85 | 18023116 | 120 | 0.000254 | com.reddit |
86 | 18017944 | 241 | 0.000107 | com.mozilla |
87 | 18013952 | 305 | 0.000085 | com.mysql |
88 | 18004788 | 63 | 0.000428 | com.ytimg |
89 | 17983326 | 60 | 0.000457 | com.bing |
90 | 17979552 | 139 | 0.000220 | com.dropbox |
91 | 17970658 | 414 | 0.000065 | com.pixabay |
92 | 17969240 | 213 | 0.000122 | com.nbcnews |
93 | 17948072 | 164 | 0.000182 | com.forbes |
94 | 17947722 | 332 | 0.000077 | gov.loc |
95 | 17943522 | 380 | 0.000069 | com.googlecode |
96 | 17938852 | 167 | 0.000176 | org.archive |
97 | 17936504 | 311 | 0.000083 | com.foursquare |
98 | 17935122 | 160 | 0.000186 | net.sourceforge |
99 | 17922956 | 271 | 0.000093 | com.go |
100 | 17914992 | 511 | 0.000053 | edu.gatech |
101 | 17914728 | 189 | 0.000148 | com.theguardian |
102 | 17911318 | 57 | 0.000476 | org.schema |
103 | 17908700 | 207 | 0.000129 | es.google |
104 | 17904466 | 268 | 0.000094 | com.example |
105 | 17893934 | 234 | 0.000110 | com.hubspot |
106 | 17893100 | 34 | 0.000899 | com.squarespace |
107 | 17882030 | 71 | 0.000392 | com.paypalobjects |
108 | 17876036 | 91 | 0.000322 | com.mashable |
109 | 17871792 | 390 | 0.000068 | com.steampowered |
110 | 17871338 | 329 | 0.000079 | gov.fda |
111 | 17866752 | 81 | 0.000369 | com.wix |
112 | 17863474 | 56 | 0.000486 | net.fbcdn |
113 | 17861988 | 384 | 0.000069 | com.tinypic |
114 | 17860528 | 431 | 0.000062 | com.variety |
115 | 17859474 | 382 | 0.000069 | org.nodejs |
116 | 17856378 | 203 | 0.000135 | edu.stanford |
117 | 17848552 | 221 | 0.000119 | com.dribbble |
118 | 17844996 | 9 | 0.003327 | com.godaddy |
119 | 17835638 | 210 | 0.000126 | com.tinyurl |
120 | 17833096 | 62 | 0.000433 | com.fb |
121 | 17827518 | 252 | 0.000102 | com.businessinsider |
122 | 17820142 | 585 | 0.000048 | edu.utah |
123 | 17816830 | 558 | 0.000050 | edu.illinois |
124 | 17814998 | 211 | 0.000125 | com.imdb |
125 | 17807936 | 273 | 0.000093 | com.live |
126 | 17798828 | 229 | 0.000112 | com.washingtonpost |
127 | 17795696 | 286 | 0.000088 | au.com.google |
128 | 17794884 | 665 | 0.000046 | com.chrome |
129 | 17794014 | 310 | 0.000083 | edu.mit |
130 | 17793162 | 215 | 0.000121 | com.typepad |
131 | 17792828 | 246 | 0.000104 | com.techcrunch |
132 | 17792612 | 391 | 0.000068 | com.sun |
133 | 17788146 | 459 | 0.000059 | org.sciencemag |
134 | 17786288 | 463 | 0.000058 | org.eclipse |
135 | 17785568 | 436 | 0.000061 | com.withgoogle |
136 | 17763488 | 104 | 0.000272 | com.addthis |
137 | 17762648 | 144 | 0.000217 | com.jimdo |
138 | 17751854 | 89 | 0.000332 | net.akamaihd |
139 | 17750766 | 505 | 0.000053 | com.nike |
140 | 17746698 | 281 | 0.000088 | com.bloomberg |
141 | 17746522 | 454 | 0.000059 | org.ampproject |
142 | 17744596 | 306 | 0.000084 | edu.harvard |
143 | 17742618 | 677 | 0.000045 | com.hbo |
144 | 17740448 | 308 | 0.000083 | com.cnet |
145 | 17739928 | 466 | 0.000058 | co.g |
146 | 17733410 | 510 | 0.000053 | com.chron |
147 | 17732706 | 544 | 0.000051 | com.jetbrains |
148 | 17731054 | 531 | 0.000052 | edu.tamu |
149 | 17726236 | 172 | 0.000167 | com.etsy |
150 | 17724162 | 479 | 0.000055 | com.sap |
151 | 17723422 | 591 | 0.000047 | com.wikidot |
152 | 17723074 | 445 | 0.000060 | com.libsyn |
153 | 17708952 | 27 | 0.001246 | ru.yandex |
154 | 17700802 | 307 | 0.000084 | com.wired |
155 | 17699308 | 678 | 0.000045 | uk.org.tate |
156 | 17696186 | 323 | 0.000080 | com.aol |
157 | 17695480 | 156 | 0.000192 | com.twimg |
158 | 17692140 | 278 | 0.000090 | com.usatoday |
159 | 17691756 | 381 | 0.000069 | uk.co.dailymail |
160 | 17689780 | 537 | 0.000051 | com.cc |
161 | 17689300 | 274 | 0.000092 | io.codepen |
162 | 17688614 | 360 | 0.000071 | com.cdbaby |
163 | 17688360 | 592 | 0.000047 | org.virtualbox |
164 | 17686966 | 514 | 0.000053 | edu.berkeley |
165 | 17684366 | 599 | 0.000047 | com.googleblog |
166 | 17676682 | 694 | 0.000044 | com.discogs |
167 | 17673938 | 327 | 0.000079 | com.time |
168 | 17669642 | 110 | 0.000259 | com.shopify |
169 | 17668396 | 291 | 0.000087 | com.images-amazon |
170 | 17668298 | 183 | 0.000155 | gov.nih |
171 | 17666218 | 136 | 0.000237 | com.mailchimp |
172 | 17656016 | 386 | 0.000069 | com.bbc |
173 | 17654450 | 674 | 0.000045 | com.quora |
174 | 17649714 | 434 | 0.000062 | com.marketingland |
175 | 17642560 | 297 | 0.000086 | com.ibm |
176 | 17638146 | 422 | 0.000064 | gov.nasa |
177 | 17637004 | 318 | 0.000081 | com.photobucket |
178 | 17636812 | 181 | 0.000159 | com.eventbrite |
179 | 17636508 | 542 | 0.000051 | com.theverge |
180 | 17635956 | 500 | 0.000054 | edu.cornell |
181 | 17635416 | 418 | 0.000064 | com.git-scm |
182 | 17634154 | 417 | 0.000065 | com.livejournal |
183 | 17633590 | 328 | 0.000079 | com.msn |
184 | 17625340 | 516 | 0.000052 | com.strikingly |
185 | 17624154 | 255 | 0.000102 | com.mapquest |
186 | 17620876 | 727 | 0.000042 | id.co.blogspot |
187 | 17618460 | 574 | 0.000049 | com.yellowpages |
188 | 17617522 | 551 | 0.000050 | org.rubyonrails |
189 | 17612342 | 472 | 0.000057 | com.xrea |
190 | 17610712 | 383 | 0.000069 | au.gov.nsw |
191 | 17609080 | 363 | 0.000071 | com.latimes |
192 | 17608010 | 475 | 0.000056 | org.kernel |
193 | 17603658 | 376 | 0.000069 | com.gmail |
194 | 17597398 | 99 | 0.000283 | edu.utexas |
195 | 17595922 | 296 | 0.000086 | net.windows |
196 | 17595102 | 465 | 0.000058 | me.paypal |
197 | 17590876 | 243 | 0.000105 | com.stackoverflow |
198 | 17584474 | 481 | 0.000055 | com.buzzfeed |
199 | 17578072 | 334 | 0.000077 | com.meetup |
200 | 17573542 | 212 | 0.000124 | com.ebay |
201 | 17568048 | 303 | 0.000085 | com.staticflickr |
202 | 17568024 | 358 | 0.000072 | com.npmjs |
203 | 17567892 | 718 | 0.000042 | io.itch |
204 | 17567116 | 370 | 0.000070 | com.ted |
205 | 17560926 | 557 | 0.000050 | org.aarp |
206 | 17552274 | 240 | 0.000108 | uk.co.amazon |
207 | 17551168 | 59 | 0.000473 | com.vk |
208 | 17548922 | 206 | 0.000130 | com.opera |
209 | 17530956 | 535 | 0.000051 | net.codecanyon |
210 | 17529384 | 176 | 0.000161 | com.feedburner |
211 | 17527604 | 522 | 0.000052 | com.cbsnews |
212 | 17519948 | 666 | 0.000046 | com.scribd |
213 | 17519336 | 550 | 0.000050 | com.neilpatel |
214 | 17519120 | 326 | 0.000079 | com.googlesyndication |
215 | 17518734 | 397 | 0.000067 | com.springer |
216 | 17515958 | 248 | 0.000103 | net.php |
217 | 17515196 | 410 | 0.000066 | uk.co.blogspot |
218 | 17513346 | 570 | 0.000049 | com.zdnet |
219 | 17513208 | 437 | 0.000061 | com.angieslist |
220 | 17513158 | 325 | 0.000079 | com.nypost |
221 | 17511876 | 529 | 0.000052 | com.venturebeat |
222 | 17504546 | 471 | 0.000057 | com.theatlantic |
223 | 17504004 | 467 | 0.000058 | com.fortune |
224 | 17502878 | 100 | 0.000282 | de.google |
225 | 17502814 | 97 | 0.000292 | com.livestream |
226 | 17499932 | 64 | 0.000427 | com.qq |
227 | 17496208 | 263 | 0.000097 | com.surveymonkey |
228 | 17494348 | 671 | 0.000046 | com.vice |
229 | 17492276 | 161 | 0.000185 | uk.co.google |
230 | 17488066 | 225 | 0.000117 | com.getclicky |
231 | 17486500 | 577 | 0.000049 | net.daringfireball |
232 | 17485306 | 586 | 0.000048 | org.maven |
233 | 17481380 | 272 | 0.000093 | io.atom |
234 | 17481032 | 1012 | 0.000034 | org.arxiv |
235 | 17478092 | 242 | 0.000107 | com.digg |
236 | 17473982 | 425 | 0.000063 | gov.whitehouse |
237 | 17473120 | 525 | 0.000052 | com.box |
238 | 17472022 | 699 | 0.000043 | com.newyorker |
239 | 17467094 | 394 | 0.000068 | com.wiley |
240 | 17465666 | 109 | 0.000264 | cc.co |
241 | 17465268 | 739 | 0.000041 | com.arstechnica |
242 | 17462818 | 373 | 0.000069 | org.mediawiki |
243 | 17461856 | 442 | 0.000060 | com.kickstarter |
244 | 17461472 | 789 | 0.000039 | com.jsbin |
245 | 17457848 | 564 | 0.000050 | com.ft |
246 | 17454848 | 94 | 0.000305 | me.fb |
247 | 17454110 | 541 | 0.000051 | com.citysearch |
248 | 17452346 | 267 | 0.000094 | com.hp |
249 | 17452146 | 289 | 0.000087 | gov.ftc |
250 | 17451720 | 314 | 0.000083 | gov.cdc |
251 | 17450692 | 198 | 0.000137 | com.zendesk |
252 | 17450430 | 716 | 0.000042 | com.unsplash |
253 | 17450132 | 259 | 0.000101 | com.disqus |
254 | 17448446 | 150 | 0.000204 | net.behance |
255 | 17445628 | 162 | 0.000184 | com.salesforce |
256 | 17439380 | 387 | 0.000069 | com.prnewswire |
257 | 17437300 | 576 | 0.000049 | org.pbs |
258 | 17436496 | 440 | 0.000060 | com.entrepreneur |
259 | 17431734 | 837 | 0.000036 | edu.yale |
260 | 17429230 | 491 | 0.000054 | com.inc |
261 | 17429186 | 573 | 0.000049 | com.wikihow |
262 | 17426100 | 101 | 0.000280 | com.baidu |
263 | 17423628 | 681 | 0.000045 | com.dropboxusercontent |
264 | 17423234 | 726 | 0.000042 | com.nationalgeographic |
265 | 17422796 | 756 | 0.000040 | com.foxnews |
266 | 17421910 | 562 | 0.000050 | com.wikia |
267 | 17419728 | 195 | 0.000140 | jp.co.yahoo |
268 | 17419544 | 794 | 0.000038 | com.naturalnews |
269 | 17418472 | 566 | 0.000050 | com.deviantart |
270 | 17414396 | 276 | 0.000091 | com.webs |
271 | 17413872 | 348 | 0.000075 | fr.free |
272 | 17412210 | 317 | 0.000081 | org.acm |
273 | 17402816 | 396 | 0.000067 | ly.ow |
274 | 17394884 | 1453 | 0.000026 | edu.purdue |
275 | 17393680 | 345 | 0.000075 | gov.ca |
276 | 17390674 | 218 | 0.000120 | com.stumbleupon |
277 | 17389254 | 918 | 0.000035 | edu.psu |
278 | 17385144 | 423 | 0.000063 | org.un |
279 | 17384400 | 501 | 0.000054 | com.cisco |
280 | 17383434 | 1349 | 0.000029 | edu.ucsd |
281 | 17381706 | 474 | 0.000056 | com.giphy |
282 | 17380516 | 736 | 0.000041 | com.economist |
283 | 17379374 | 251 | 0.000103 | com.wufoo |
284 | 17374174 | 1265 | 0.000032 | com.gizmodo |
285 | 17373752 | 369 | 0.000070 | com.dailymotion |
286 | 17372864 | 1291 | 0.000031 | gov.fbi |
287 | 17372780 | 556 | 0.000050 | com.office |
288 | 17372482 | 753 | 0.000041 | org.aclweb |
289 | 17372370 | 173 | 0.000165 | com.constantcontact |
290 | 17371880 | 453 | 0.000059 | com.businesswire |
291 | 17370058 | 415 | 0.000065 | com.skype |
292 | 17369740 | 738 | 0.000041 | org.amnesty |
293 | 17366926 | 684 | 0.000045 | com.nature |
294 | 17366574 | 932 | 0.000034 | edu.columbia |
295 | 17365858 | 518 | 0.000052 | org.postgresql |
296 | 17364668 | 683 | 0.000045 | org.tigris |
297 | 17361368 | 1547 | 0.000023 | com.hotmail |
298 | 17356586 | 746 | 0.000041 | com.storify |
299 | 17352004 | 1587 | 0.000022 | com.vanityfair |
300 | 17351342 | 321 | 0.000081 | it.placehold |
301 | 17348558 | 740 | 0.000041 | com.yarnpkg |
302 | 17341886 | 357 | 0.000072 | com.oreilly |
303 | 17338208 | 494 | 0.000054 | com.snapchat |
304 | 17337314 | 1032 | 0.000033 | edu.upenn |
305 | 17335204 | 807 | 0.000037 | com.googledrive |
306 | 17334830 | 1277 | 0.000032 | com.qz |
307 | 17333774 | 1079 | 0.000033 | com.evernote |
308 | 17331758 | 322 | 0.000080 | com.tripod |
309 | 17330634 | 704 | 0.000043 | com.googlesource |
310 | 17329636 | 426 | 0.000063 | int.who |
311 | 17326366 | 710 | 0.000043 | com.intel |
312 | 17325786 | 734 | 0.000041 | com.sublimetext |
313 | 17324870 | 1135 | 0.000033 | com.shutterstock |
314 | 17322072 | 182 | 0.000158 | com.weibo |
315 | 17318946 | 944 | 0.000034 | org.ieee |
316 | 17318594 | 991 | 0.000034 | gov.uspto |
317 | 17316354 | 1826 | 0.000018 | com.fifa |
318 | 17315094 | 790 | 0.000039 | ly.snip |
319 | 17314668 | 693 | 0.000044 | com.bandsintown |
320 | 17314008 | 230 | 0.000111 | com.bandcamp |
321 | 17313572 | 892 | 0.000035 | com.statista |
322 | 17309656 | 572 | 0.000049 | com.goodreads |
323 | 17309586 | 911 | 0.000035 | com.bizcommunity |
324 | 17309092 | 1485 | 0.000025 | uk.co.theregister |
325 | 17308842 | 749 | 0.000041 | com.engadget |
326 | 17306184 | 1072 | 0.000033 | org.eff |
327 | 17303336 | 1406 | 0.000027 | com.trello |
328 | 17302060 | 194 | 0.000141 | de.amazon |
329 | 17301380 | 444 | 0.000060 | org.hbr |
330 | 17301080 | 905 | 0.000035 | com.psychologytoday |
331 | 17300476 | 1470 | 0.000025 | com.elpais |
332 | 17299750 | 1576 | 0.000023 | com.upwork |
333 | 17295340 | 725 | 0.000042 | com.samsung |
334 | 17291766 | 719 | 0.000042 | org.gnupg |
335 | 17291566 | 1532 | 0.000024 | edu.northwestern |
336 | 17291454 | 324 | 0.000080 | com.smugmug |
337 | 17290484 | 846 | 0.000036 | com.stackexchange |
338 | 17288864 | 435 | 0.000061 | com.force |
339 | 17282768 | 1602 | 0.000022 | org.khanacademy |
340 | 17281430 | 1284 | 0.000031 | com.hootsuite |
341 | 17278686 | 1396 | 0.000028 | com.ning |
342 | 17278552 | 1001 | 0.000034 | com.thenextweb |
343 | 17278098 | 955 | 0.000034 | com.weather |
344 | 17277624 | 906 | 0.000035 | org.webmproject |
345 | 17277242 | 887 | 0.000035 | com.timeanddate |
346 | 17276782 | 1500 | 0.000025 | com.pexels |
347 | 17276050 | 764 | 0.000040 | com.manta |
348 | 17275578 | 797 | 0.000038 | com.mysanantonio |
349 | 17273800 | 1384 | 0.000028 | co.vine |
350 | 17272326 | 784 | 0.000039 | uk.co.guardian |
351 | 17269704 | 1660 | 0.000021 | com.speakerdeck |
352 | 17268970 | 774 | 0.000039 | com.uk |
353 | 17265152 | 1259 | 0.000032 | org.iso |
354 | 17263298 | 1560 | 0.000023 | com.billboard |
355 | 17260422 | 874 | 0.000035 | com.marketwatch |
356 | 17258760 | 765 | 0.000040 | com.sciencedaily |
357 | 17258600 | 1442 | 0.000026 | com.thinkwithgoogle |
358 | 17258120 | 769 | 0.000040 | com.digitaljournal |
359 | 17255602 | 1379 | 0.000028 | in.blogspot |
360 | 17255046 | 93 | 0.000313 | org.networkadvertising |
361 | 17254784 | 1519 | 0.000024 | com.pcworld |
362 | 17253308 | 1590 | 0.000022 | com.posterous |
363 | 17253158 | 1432 | 0.000026 | com.pcmag |
364 | 17251690 | 1281 | 0.000032 | com.mckinsey |
365 | 17249758 | 744 | 0.000041 | com.blackberry |
366 | 17248626 | 904 | 0.000035 | org.unesco |
367 | 17247916 | 692 | 0.000044 | gov.noaa |
368 | 17247316 | 1351 | 0.000029 | com.airbnb |
369 | 17240632 | 1356 | 0.000029 | com.istockphoto |
370 | 17240122 | 1350 | 0.000029 | org.altervista |
371 | 17239506 | 553 | 0.000050 | com.githubusercontent |
372 | 17238936 | 264 | 0.000096 | to.amzn |
373 | 17238552 | 1719 | 0.000020 | org.owasp |
374 | 17237848 | 108 | 0.000266 | com.bleacherreport |
375 | 17237484 | 244 | 0.000105 | org.joomla |
376 | 17236790 | 1275 | 0.000032 | com.netflix |
377 | 17235170 | 917 | 0.000035 | edu.utep |
378 | 17234928 | 140 | 0.000218 | com.googleadservices |
379 | 17234584 | 793 | 0.000038 | com.merchantcircle |
380 | 17231562 | 158 | 0.000190 | org.bbb |
381 | 17227502 | 1782 | 0.000018 | uk.co.metro |
382 | 17227096 | 504 | 0.000053 | com.bizjournals |
383 | 17225090 | 1274 | 0.000032 | ca.blogspot |
384 | 17224548 | 1556 | 0.000023 | com.merriam-webster |
385 | 17224328 | 333 | 0.000077 | com.rawgit |
386 | 17222966 | 1663 | 0.000021 | edu.usc |
387 | 17222606 | 1337 | 0.000029 | uk.ac.ox |
388 | 17222120 | 717 | 0.000042 | gov.sec |
389 | 17221794 | 1436 | 0.000026 | de.spiegel |
390 | 17221688 | 791 | 0.000039 | com.vagrantup |
391 | 17219850 | 803 | 0.000038 | com.sfgate |
392 | 17215736 | 1273 | 0.000032 | us.imageshack |
393 | 17214432 | 1083 | 0.000033 | com.lifehacker |
394 | 17213262 | 366 | 0.000070 | com.sxsw |
395 | 17212900 | 1850 | 0.000017 | net.boingboing |
396 | 17211916 | 985 | 0.000034 | com.americanexpress |
397 | 17211422 | 696 | 0.000044 | com.moz |
398 | 17210936 | 492 | 0.000054 | net.openid |
399 | 17209724 | 1266 | 0.000032 | com.indiegogo |
400 | 17209430 | 288 | 0.000088 | com.windowsphone |
401 | 17209366 | 313 | 0.000083 | ca.google |
402 | 17208872 | 105 | 0.000271 | com.people |
403 | 17208682 | 1628 | 0.000021 | edu.jhu |
404 | 17206274 | 219 | 0.000120 | org.drupal |
405 | 17202352 | 1842 | 0.000018 | com.nfl |
406 | 17199606 | 1360 | 0.000028 | gov.usgs |
407 | 17199448 | 295 | 0.000086 | com.fc2 |
408 | 17198942 | 1914 | 0.000017 | ca.uwaterloo |
409 | 17197332 | 131 | 0.000252 | jp.co.google |
410 | 17196900 | 1789 | 0.000018 | com.socialmediaexaminer |
411 | 17194310 | 1608 | 0.000022 | com.mcafee |
412 | 17193946 | 1965 | 0.000016 | com.tutsplus |
413 | 17192092 | 2256 | 0.000014 | com.twitpic |
414 | 17191606 | 416 | 0.000065 | com.booking |
415 | 17190504 | 330 | 0.000078 | com.bitly |
416 | 17189420 | 532 | 0.000052 | com.w3schools |
417 | 17189296 | 1457 | 0.000026 | com.boston |
418 | 17189268 | 580 | 0.000048 | com.squareup |
419 | 17188306 | 1728 | 0.000019 | com.technologyreview |
420 | 17186672 | 1461 | 0.000026 | com.gumroad |
421 | 17186610 | 1297 | 0.000031 | com.redhat |
422 | 17186498 | 1677 | 0.000020 | com.hulu |
423 | 17186032 | 1132 | 0.000033 | gov.nist |
424 | 17185478 | 1469 | 0.000025 | com.discovery |
425 | 17185444 | 1300 | 0.000031 | fr.blogspot |
426 | 17182664 | 806 | 0.000037 | gov.nps |
427 | 17181414 | 617 | 0.000047 | uk.co.independent |
428 | 17178670 | 1306 | 0.000030 | com.politico |
429 | 17176106 | 536 | 0.000051 | com.typeform |
430 | 17173968 | 1418 | 0.000027 | com.zoho |
431 | 17173742 | 1753 | 0.000019 | com.ehow |
432 | 17173098 | 1985 | 0.000016 | com.cbs |
433 | 17172420 | 1575 | 0.000023 | com.codeplex |
434 | 17172134 | 961 | 0.000034 | ca.cbc |
435 | 17172074 | 826 | 0.000037 | com.whitepages |
436 | 17171146 | 1431 | 0.000026 | com.alibaba |
437 | 17170396 | 223 | 0.000118 | org.icann |
438 | 17170314 | 497 | 0.000054 | org.doi |
439 | 17170074 | 931 | 0.000034 | net.researchgate |
440 | 17169700 | 962 | 0.000034 | au.net.abc |
441 | 17169428 | 1658 | 0.000021 | org.gnome |
442 | 17168726 | 2928 | 0.000010 | com.hubpages |
443 | 17168310 | 185 | 0.000153 | it.google |
444 | 17166836 | 343 | 0.000075 | com.nielsen |
445 | 17166198 | 197 | 0.000138 | com.histats |
446 | 17163834 | 891 | 0.000035 | com.gofundme |
447 | 17162768 | 1594 | 0.000022 | com.mtv |
448 | 17161940 | 852 | 0.000036 | gov.copyright |
449 | 17161736 | 530 | 0.000052 | com.sciencedirect |
450 | 17160994 | 600 | 0.000047 | org.doxygen |
451 | 17159968 | 469 | 0.000058 | us.icio |
452 | 17159358 | 711 | 0.000042 | com.slack |
453 | 17159294 | 1634 | 0.000021 | edu.academia |
454 | 17158884 | 1355 | 0.000029 | com.pingdom |
455 | 17157134 | 828 | 0.000036 | it.binged |
456 | 17157124 | 735 | 0.000041 | com.java |
457 | 17157112 | 1014 | 0.000034 | edu.alamo |
458 | 17156452 | 1611 | 0.000022 | edu.unc |
459 | 17155728 | 458 | 0.000059 | com.sitelock |
460 | 17155514 | 199 | 0.000137 | com.xing |
461 | 17155400 | 438 | 0.000061 | com.adweek |
462 | 17155328 | 1538 | 0.000024 | gov.nyc |
463 | 17154360 | 728 | 0.000042 | org.vim |
464 | 17153026 | 1770 | 0.000019 | edu.cuny |
465 | 17151530 | 1623 | 0.000021 | com.nba |
466 | 17151282 | 495 | 0.000054 | mp.j |
467 | 17151272 | 1062 | 0.000033 | tv.ustream |
468 | 17151014 | 936 | 0.000034 | com.groupspaces |
469 | 17149484 | 1631 | 0.000021 | com.udemy |
470 | 17147710 | 489 | 0.000054 | edu.cmu |
471 | 17145750 | 1474 | 0.000025 | com.over-blog |
472 | 17143862 | 2110 | 0.000015 | com.mentalfloss |
473 | 17143238 | 701 | 0.000043 | de.blogspot |
474 | 17143202 | 1397 | 0.000028 | uk.ac.cam |
475 | 17142926 | 1922 | 0.000017 | com.fiverr |
476 | 17141536 | 748 | 0.000041 | com.webmd |
477 | 17140340 | 747 | 0.000041 | com.questionpro |
478 | 17139384 | 960 | 0.000034 | gov.fcc |
479 | 17136972 | 1332 | 0.000030 | edu.wisc |
480 | 17136500 | 1318 | 0.000030 | org.postimg |
481 | 17135820 | 922 | 0.000035 | edu.umich |
482 | 17133282 | 193 | 0.000141 | com.eepurl |
483 | 17132390 | 1321 | 0.000030 | com.deloitte |
484 | 17132300 | 103 | 0.000278 | me.m |
485 | 17131484 | 1841 | 0.000018 | com.gamespot |
486 | 17128758 | 579 | 0.000048 | org.whatbrowser |
487 | 17125616 | 795 | 0.000038 | br.com.uol |
488 | 17123506 | 741 | 0.000041 | org.jenkins-ci |
489 | 17123454 | 825 | 0.000037 | gov.senate |
490 | 17120690 | 1544 | 0.000023 | com.hollywoodreporter |
491 | 17119678 | 1911 | 0.000017 | uk.ac.ucl |
492 | 17118776 | 3297 | 0.000009 | com.blog |
493 | 17115232 | 1534 | 0.000024 | net.recode |
494 | 17113492 | 873 | 0.000035 | com.att |
495 | 17113076 | 1752 | 0.000019 | com.angelfire |
496 | 17112818 | 1516 | 0.000024 | com.techrepublic |
497 | 17111558 | 231 | 0.000111 | fr.google |
498 | 17108292 | 1846 | 0.000017 | com.ikea |
499 | 17108114 | 1512 | 0.000024 | com.prezi |
500 | 17107216 | 723 | 0.000042 | com.adage |
501 | 17106974 | 1368 | 0.000028 | com.gigaom |
502 | 17105096 | 1817 | 0.000018 | com.canva |
503 | 17104938 | 1553 | 0.000023 | edu.uchicago |
504 | 17104528 | 1558 | 0.000023 | com.econsultancy |
505 | 17103910 | 1295 | 0.000031 | com.formstack |
506 | 17103802 | 457 | 0.000059 | com.bigcartel |
507 | 17103324 | 1549 | 0.000023 | com.scientificamerican |
508 | 17103298 | 832 | 0.000036 | gov.census |
509 | 17102038 | 1052 | 0.000033 | com.searchengineland |
510 | 17101930 | 361 | 0.000071 | com.fastcompany |
511 | 17100982 | 631 | 0.000046 | com.symantec |
512 | 17100972 | 2041 | 0.000016 | ca.ualberta |
513 | 17099190 | 971 | 0.000034 | com.pinimg |
514 | 17099162 | 724 | 0.000042 | com.geocities |
515 | 17098592 | 992 | 0.000034 | com.hotfrog |
516 | 17098588 | 21 | 0.001560 | com.wixstatic |
517 | 17097902 | 451 | 0.000059 | gov.ed |
518 | 17097814 | 1668 | 0.000021 | net.daum |
519 | 17095170 | 2040 | 0.000016 | ch.ethz |
520 | 17094160 | 1314 | 0.000030 | org.redcross |
521 | 17094148 | 392 | 0.000068 | com.naver |
522 | 17093848 | 588 | 0.000048 | tv.twitch |
523 | 17093696 | 1835 | 0.000018 | com.sky |
524 | 17093646 | 513 | 0.000053 | cn.com.sina |
525 | 17092720 | 1088 | 0.000033 | com.collegian |
526 | 17092508 | 409 | 0.000066 | net.themeforest |
527 | 17092068 | 1876 | 0.000017 | tv.periscope |
528 | 17089560 | 2348 | 0.000013 | com.flipboard |
529 | 17089370 | 1959 | 0.000016 | com.ign |
530 | 17088698 | 269 | 0.000094 | com.myshopify |
531 | 17084698 | 309 | 0.000083 | com.whatsapp |
532 | 17083820 | 1792 | 0.000018 | com.starbucks |
533 | 17081802 | 1796 | 0.000018 | com.aliexpress |
534 | 17080940 | 1894 | 0.000017 | com.ibtimes |
535 | 17080760 | 1521 | 0.000024 | com.target |
536 | 17079892 | 1185 | 0.000033 | com.fotolia |
537 | 17079836 | 731 | 0.000041 | gov.hhs |
538 | 17077972 | 1862 | 0.000017 | edu.msu |
539 | 17077562 | 1328 | 0.000030 | com.animoto |
540 | 17077096 | 952 | 0.000034 | jp.ac.kobe-u |
541 | 17075208 | 929 | 0.000034 | com.ubuntu |
542 | 17074750 | 2693 | 0.000011 | com.klout |
543 | 17074224 | 1949 | 0.000016 | it.scoop |
544 | 17073610 | 379 | 0.000069 | nl.google |
545 | 17072992 | 1440 | 0.000026 | com.com |
546 | 17071784 | 1806 | 0.000018 | com.mac |
547 | 17070640 | 1689 | 0.000020 | edu.umd |
548 | 17068586 | 2309 | 0.000013 | org.gimp |
549 | 17068116 | 512 | 0.000053 | com.msdn |
550 | 17067276 | 1460 | 0.000026 | com.nydailynews |
551 | 17066386 | 340 | 0.000076 | edu.nyu |
552 | 17065428 | 1961 | 0.000016 | org.aclu |
553 | 17065140 | 1599 | 0.000022 | com.intuit |
554 | 17063438 | 814 | 0.000037 | com.indiatimes |
555 | 17062788 | 1499 | 0.000025 | com.nymag |
556 | 17062402 | 924 | 0.000035 | com.lighthouseapp |
557 | 17061776 | 878 | 0.000035 | com.insiderpages |
558 | 17061346 | 675 | 0.000045 | com.delicious |
559 | 17061120 | 673 | 0.000046 | com.cargocollective |
560 | 17061032 | 1443 | 0.000026 | fm.last |
561 | 17060834 | 1566 | 0.000023 | gov.uscourts |
562 | 17060788 | 1261 | 0.000032 | org.worldbank |
563 | 17059018 | 1940 | 0.000016 | com.getsatisfaction |
564 | 17058980 | 2248 | 0.000014 | edu.gmu |
565 | 17057770 | 1282 | 0.000032 | org.change |
566 | 17057436 | 1310 | 0.000030 | gov.sba |
567 | 17056518 | 885 | 0.000035 | com.cbslocal |
568 | 17056116 | 563 | 0.000050 | gov.usda |
569 | 17055868 | 2122 | 0.000015 | org.d3js |
570 | 17055830 | 1357 | 0.000029 | com.500px |
571 | 17055746 | 1517 | 0.000024 | com.businessweek |
572 | 17054568 | 441 | 0.000060 | com.clicky |
573 | 17053266 | 1656 | 0.000021 | com.vox |
574 | 17052848 | 1125 | 0.000033 | net.digitalcongo |
575 | 17052276 | 1548 | 0.000023 | de.heise |
576 | 17052030 | 555 | 0.000050 | in.co.google |
577 | 17051898 | 1889 | 0.000017 | edu.arizona |
578 | 17050912 | 92 | 0.000320 | com.atdmt |
579 | 17050520 | 2118 | 0.000015 | edu.asu |
580 | 17048098 | 1033 | 0.000033 | com.citysquares |
581 | 17047646 | 583 | 0.000048 | gov.epa |
582 | 17047432 | 945 | 0.000034 | com.feedly |
583 | 17046294 | 1456 | 0.000026 | edu.si |
584 | 17046024 | 2091 | 0.000015 | uk.co.wired |
585 | 17046012 | 1475 | 0.000025 | com.globo |
586 | 17045960 | 1669 | 0.000021 | fr.lemonde |
587 | 17045812 | 1454 | 0.000026 | edu.umn |
588 | 17044250 | 184 | 0.000154 | com.youtube-nocookie |
589 | 17043428 | 777 | 0.000039 | com.usnews |
590 | 17043342 | 3029 | 0.000010 | gd.is |
591 | 17041134 | 1825 | 0.000018 | com.autodesk |
592 | 17040548 | 1978 | 0.000016 | com.exacttarget |
593 | 17039484 | 1016 | 0.000034 | com.alexa |
594 | 17039038 | 976 | 0.000034 | com.wsoctv |
595 | 17036946 | 2085 | 0.000015 | com.yolasite |
596 | 17036316 | 155 | 0.000193 | com.google-analytics |
597 | 17036062 | 1659 | 0.000021 | it.blogspot |
598 | 17034640 | 163 | 0.000183 | com.ggpht |
599 | 17034000 | 1051 | 0.000033 | org.plos |
600 | 17032394 | 757 | 0.000040 | es.com.blogspot |
601 | 17032330 | 1552 | 0.000023 | org.cancer |
602 | 17031224 | 861 | 0.000036 | com.tiddlywiki |
603 | 17029514 | 1833 | 0.000018 | au.com.blogspot |
604 | 17028688 | 430 | 0.000062 | gov.irs |
605 | 17026900 | 1784 | 0.000018 | edu.virginia |
606 | 17026496 | 279 | 0.000089 | com.getbootstrap |
607 | 17026218 | 285 | 0.000088 | jp.co.amazon |
608 | 17025160 | 157 | 0.000191 | ru.mail |
609 | 17024932 | 2147 | 0.000015 | com.bestbuy |
610 | 17024890 | 220 | 0.000120 | jp.ameblo |
611 | 17024600 | 1362 | 0.000028 | com.ycombinator |
612 | 17024552 | 74 | 0.000390 | com.messenger |
613 | 17023206 | 1693 | 0.000020 | com.zazzle |
614 | 17023136 | 447 | 0.000060 | com.barnesandnoble |
615 | 17021784 | 1128 | 0.000033 | com.reverbnation |
616 | 17021018 | 1114 | 0.000033 | site.tenerifeforum |
617 | 17020856 | 845 | 0.000036 | org.bouncycastle |
618 | 17020632 | 998 | 0.000034 | com.chamberofcommerce |
619 | 17020566 | 2010 | 0.000016 | com.marketingprofs |
620 | 17020456 | 2061 | 0.000015 | com.invisionapp |
621 | 17017808 | 1416 | 0.000027 | com.searchenginejournal |
622 | 17017782 | 1518 | 0.000024 | org.apa |
623 | 17016824 | 714 | 0.000042 | fr.amazon |
624 | 17015234 | 1505 | 0.000024 | com.kissmetrics |
625 | 17015162 | 401 | 0.000067 | com.nasdaq |
626 | 17014764 | 999 | 0.000034 | com.2findlocal |
627 | 17014494 | 1036 | 0.000033 | net.brownbook |
628 | 17013554 | 1860 | 0.000017 | com.msnbc |
629 | 17013428 | 1383 | 0.000028 | com.bufferapp |
630 | 17013012 | 187 | 0.000151 | com.amazon-adsystem |
631 | 17012132 | 2774 | 0.000011 | com.popsci |
632 | 17011438 | 1601 | 0.000022 | kr.flic |
633 | 17011354 | 208 | 0.000128 | jp.ne.hatena |
634 | 17011188 | 702 | 0.000043 | com.herokuapp |
635 | 17010902 | 429 | 0.000062 | com.custhelp |
636 | 17010798 | 2412 | 0.000013 | com.starwars |
637 | 17010634 | 1773 | 0.000019 | com.knowyourmeme |
638 | 17010568 | 2634 | 0.000011 | org.kiva |
639 | 17010310 | 1435 | 0.000026 | com.cafepress |
640 | 17009556 | 1482 | 0.000025 | com.searchenginewatch |
641 | 17008884 | 1620 | 0.000021 | com.newsweek |
642 | 17008746 | 1533 | 0.000024 | com.uber |
643 | 17008694 | 452 | 0.000059 | com.stripe |
644 | 17008600 | 2206 | 0.000014 | com.freep |
645 | 17007290 | 1732 | 0.000019 | com.salon |
646 | 17006696 | 839 | 0.000036 | com.newsbank |
647 | 17006680 | 2214 | 0.000014 | com.wikispaces |
648 | 17006380 | 1685 | 0.000020 | com.splashthat |
649 | 17005464 | 811 | 0.000037 | gov.state |
650 | 17003144 | 1799 | 0.000018 | google.blog |
651 | 17002000 | 1268 | 0.000032 | com.patreon |
652 | 17001412 | 3347 | 0.000009 | com.space |
653 | 17001010 | 1836 | 0.000018 | edu.rutgers |
654 | 17000930 | 2161 | 0.000015 | net.comcast |
655 | 17000912 | 1657 | 0.000021 | com.today |
656 | 16998832 | 1559 | 0.000023 | org.coursera |
657 | 16997998 | 844 | 0.000036 | com.tandfonline |
658 | 16997358 | 1734 | 0.000019 | org.filezilla-project |
659 | 16997118 | 1574 | 0.000023 | int.coe |
660 | 16996872 | 767 | 0.000040 | com.photoshelter |
661 | 16996786 | 928 | 0.000035 | jp.co.fujixerox |
662 | 16996146 | 1027 | 0.000034 | com.uservoice |
663 | 16995782 | 2084 | 0.000015 | uk.ac.ed |
664 | 16995128 | 1327 | 0.000030 | com.walmart |
665 | 16994982 | 1823 | 0.000018 | com.semrush |
666 | 16994576 | 3929 | 0.000007 | com.wolframalpha |
667 | 16993686 | 1808 | 0.000018 | com.blogtalkradio |
668 | 16993648 | 1680 | 0.000020 | au.com.smh |
669 | 16992638 | 978 | 0.000034 | com.independent |
670 | 16992102 | 1067 | 0.000033 | com.lacartes |
671 | 16990396 | 2153 | 0.000015 | edu.bu |
672 | 16990096 | 703 | 0.000043 | com.emarketer |
673 | 16990058 | 987 | 0.000034 | uk.co.eventbrite |
674 | 16990044 | 1380 | 0.000028 | org.iana |
675 | 16989692 | 672 | 0.000046 | com.houzz |
676 | 16989078 | 893 | 0.000035 | com.chambermaster |
677 | 16989032 | 2303 | 0.000014 | com.xerox |
678 | 16988976 | 2226 | 0.000014 | com.instructables |
679 | 16988406 | 1721 | 0.000020 | uk.co.mirror |
680 | 16987668 | 2163 | 0.000015 | nl.blogspot |
681 | 16987224 | 2093 | 0.000015 | nl.xs4all |
682 | 16986930 | 1404 | 0.000027 | com.investopedia |
683 | 16986668 | 2162 | 0.000015 | de.bild |
684 | 16986504 | 709 | 0.000043 | org.sonatype |
685 | 16985824 | 2105 | 0.000015 | com.newscientist |
686 | 16985532 | 981 | 0.000034 | com.strawberryperl |
687 | 16985100 | 1330 | 0.000030 | gov.dot |
688 | 16983528 | 1564 | 0.000023 | com.mediafire |
689 | 16982966 | 1621 | 0.000021 | org.weforum |
690 | 16982964 | 1767 | 0.000019 | com.thedailybeast |
691 | 16982646 | 186 | 0.000152 | com.sharethis |
692 | 16981478 | 3018 | 0.000010 | com.tvguide |
693 | 16981346 | 2192 | 0.000014 | com.foxsports |
694 | 16980324 | 1845 | 0.000018 | ru.narod |
695 | 16978844 | 2621 | 0.000012 | edu.caltech |
696 | 16978428 | 1731 | 0.000019 | org.cambridge |
697 | 16978344 | 1502 | 0.000025 | com.mixcloud |
698 | 16977896 | 1536 | 0.000024 | com.smashingmagazine |
699 | 16977506 | 2819 | 0.000011 | org.greenpeace |
700 | 16976818 | 1652 | 0.000021 | com.timeout |
701 | 16976528 | 2282 | 0.000014 | com.homedepot |
702 | 16975962 | 1481 | 0.000025 | com.ssrn |
703 | 16975782 | 1895 | 0.000017 | uk.ac.lse |
704 | 16975462 | 2923 | 0.000010 | org.icrc |
705 | 16973580 | 2792 | 0.000011 | pt.sapo |
706 | 16973088 | 1718 | 0.000020 | br.com.blogspot |
707 | 16972998 | 2323 | 0.000013 | com.googlepages |
708 | 16972748 | 1540 | 0.000024 | com.playstation |
709 | 16972196 | 1428 | 0.000026 | com.elsevier |
710 | 16972182 | 1733 | 0.000019 | mil.navy |
711 | 16970806 | 2133 | 0.000015 | com.britannica |
712 | 16970328 | 1025 | 0.000034 | org.gwtproject |
713 | 16969454 | 2160 | 0.000015 | com.gawker |
714 | 16968516 | 2157 | 0.000015 | au.com.news |
715 | 16968430 | 1392 | 0.000028 | com.dell |
716 | 16968084 | 2914 | 0.000010 | com.fivethirtyeight |
717 | 16967948 | 1316 | 0.000030 | net.java |
718 | 16967542 | 1936 | 0.000017 | com.vogue |
719 | 16966846 | 836 | 0.000036 | com.gartner |
720 | 16965886 | 1805 | 0.000018 | com.deezer |
721 | 16965706 | 362 | 0.000071 | com.heroku |
722 | 16965626 | 1031 | 0.000033 | org.twinery |
723 | 16964740 | 1288 | 0.000031 | net.azurewebsites |
724 | 16964378 | 378 | 0.000069 | com.ea |
725 | 16964240 | 2141 | 0.000015 | com.seattletimes |
726 | 16963600 | 2793 | 0.000011 | org.angularjs |
727 | 16960694 | 921 | 0.000035 | com.prweb |
728 | 16960014 | 1858 | 0.000017 | edu.ucdavis |
729 | 16959918 | 2026 | 0.000016 | edu.uci |
730 | 16958606 | 1391 | 0.000028 | com.bostonglobe |
731 | 16958432 | 1395 | 0.000028 | com.hostgator |
732 | 16958290 | 1581 | 0.000023 | com.nokia |
733 | 16957718 | 1950 | 0.000016 | edu.ucsf |
734 | 16957126 | 1625 | 0.000021 | com.bmj |
735 | 16956474 | 2230 | 0.000014 | com.nbc |
736 | 16956220 | 2138 | 0.000015 | ca.ubc |
737 | 16955840 | 800 | 0.000038 | st.assi |
738 | 16955820 | 2090 | 0.000015 | uk.co.thesun |
739 | 16954528 | 2541 | 0.000012 | edu.brown |
740 | 16954474 | 1788 | 0.000018 | com.zillow |
741 | 16954474 | 1049 | 0.000033 | org.swi-prolog |
742 | 16953520 | 1701 | 0.000020 | edu.duke |
743 | 16953518 | 1783 | 0.000018 | com.csmonitor |
744 | 16953450 | 2890 | 0.000010 | com.voanews |
745 | 16952050 | 1038 | 0.000033 | com.zwire |
746 | 16952034 | 1702 | 0.000020 | com.yandex |
747 | 16951812 | 1635 | 0.000021 | com.rollingstone |
748 | 16951272 | 2178 | 0.000014 | com.webnode |
749 | 16951212 | 3119 | 0.000009 | edu.uic |
750 | 16949574 | 1683 | 0.000020 | com.examiner |
751 | 16948794 | 499 | 0.000054 | com.marriott |
752 | 16947258 | 1433 | 0.000026 | com.digiday |
753 | 16946826 | 3247 | 0.000009 | com.lmgtfy |
754 | 16946300 | 2915 | 0.000010 | com.campaignmonitor |
755 | 16945992 | 1617 | 0.000022 | com.thomsonreuters |
756 | 16945804 | 1567 | 0.000023 | com.vmware |
757 | 16945728 | 1018 | 0.000034 | com.themonitor |
758 | 16945334 | 1942 | 0.000016 | edu.indiana |
759 | 16944864 | 1269 | 0.000032 | net.yahoo |
760 | 16944796 | 1296 | 0.000031 | org.openstreetmap |
761 | 16944696 | 1043 | 0.000033 | com.sagepub |
762 | 16943548 | 1462 | 0.000026 | jp.blogspot |
763 | 16943408 | 294 | 0.000087 | com.wpengine |
764 | 16942720 | 2381 | 0.000013 | com.rt |
765 | 16942360 | 1802 | 0.000018 | com.pastebin |
766 | 16942116 | 2846 | 0.000011 | int.esa |
767 | 16939958 | 2126 | 0.000015 | net.oauth |
768 | 16939804 | 1648 | 0.000021 | com.css-tricks |
769 | 16939376 | 2154 | 0.000015 | org.acs |
770 | 16939202 | 2064 | 0.000015 | com.aljazeera |
771 | 16938812 | 817 | 0.000037 | io.getmdl |
772 | 16938164 | 2193 | 0.000014 | com.redbubble |
773 | 16935928 | 919 | 0.000035 | com.sacurrent |
774 | 16935754 | 377 | 0.000069 | com.monster |
775 | 16935418 | 2448 | 0.000013 | edu.unl |
776 | 16935302 | 1458 | 0.000026 | gov.congress |
777 | 16935298 | 1780 | 0.000018 | org.ap |
778 | 16935136 | 1787 | 0.000018 | org.golang |
779 | 16935112 | 3194 | 0.000009 | ru.blogspot |
780 | 16934608 | 1727 | 0.000019 | net.battle |
781 | 16933748 | 1280 | 0.000032 | com.marketwired |
782 | 16932996 | 1624 | 0.000021 | com.hyatt |
783 | 16932774 | 1834 | 0.000018 | int.wipo |
784 | 16932588 | 169 | 0.000173 | info.aboutads |
785 | 16931964 | 1055 | 0.000033 | com.hatenadiary |
786 | 16931446 | 2027 | 0.000016 | com.irishtimes |
787 | 16930742 | 1445 | 0.000026 | com.mlb |
788 | 16930558 | 1026 | 0.000034 | com.showmelocal |
789 | 16929958 | 2069 | 0.000015 | com.getfirebug |
790 | 16929732 | 2220 | 0.000014 | com.crunchbase |
791 | 16929508 | 2592 | 0.000012 | ms.1drv |
792 | 16929354 | 1716 | 0.000020 | ru.spb |
793 | 16928860 | 829 | 0.000036 | com.engineyard |
794 | 16927652 | 1388 | 0.000028 | com.justgiving |
795 | 16926126 | 2144 | 0.000015 | org.hrw |
796 | 16925806 | 2862 | 0.000010 | com.threadless |
797 | 16925672 | 862 | 0.000036 | com.qualaroo |
798 | 16925146 | 2788 | 0.000011 | com.lynda |
799 | 16924758 | 907 | 0.000035 | com.proofpoint |
800 | 16924708 | 1600 | 0.000022 | com.xbox |
801 | 16924552 | 1508 | 0.000024 | com.steamcommunity |
802 | 16924384 | 2334 | 0.000013 | com.theonion |
803 | 16924160 | 2600 | 0.000012 | edu.hawaii |
804 | 16923374 | 815 | 0.000037 | gov.justice |
805 | 16923170 | 567 | 0.000050 | com.bigcommerce |
806 | 16922882 | 1425 | 0.000026 | com.docker |
807 | 16920896 | 1986 | 0.000016 | com.si |
808 | 16920648 | 2017 | 0.000016 | com.allthingsd |
809 | 16920338 | 2527 | 0.000012 | com.madmimi |
810 | 16919718 | 1289 | 0.000031 | com.atlassian |
811 | 16919684 | 1035 | 0.000033 | com.bitballoon |
812 | 16919080 | 1541 | 0.000024 | com.theglobeandmail |
813 | 16918114 | 2551 | 0.000012 | org.phys |
814 | 16917590 | 1918 | 0.000017 | edu.umass |
815 | 16917306 | 982 | 0.000034 | com.judysbook |
816 | 16916882 | 1871 | 0.000017 | com.buffer |
817 | 16915704 | 367 | 0.000070 | jp.co.rakuten |
818 | 16915586 | 1059 | 0.000033 | com.spoke |
819 | 16915360 | 3179 | 0.000009 | uk.bl |
820 | 16915232 | 82 | 0.000360 | com.parallels |
821 | 16915094 | 2467 | 0.000013 | com.fox |
822 | 16914570 | 347 | 0.000075 | com.youku |
823 | 16913934 | 2185 | 0.000014 | com.topsy |
824 | 16913414 | 1674 | 0.000021 | com.fedex |
825 | 16912930 | 439 | 0.000061 | com.taobao |
826 | 16911624 | 3362 | 0.000009 | com.friendfeed |
827 | 16911362 | 1057 | 0.000033 | com.ibegin |
828 | 16908382 | 2684 | 0.000011 | org.semanticscholar |
829 | 16908112 | 1688 | 0.000020 | com.ecwid |
830 | 16905344 | 280 | 0.000089 | com.automattic |
831 | 16905164 | 365 | 0.000070 | me.t |
832 | 16904014 | 446 | 0.000060 | com.cracked |
833 | 16902880 | 752 | 0.000041 | ru.google |
834 | 16902568 | 2464 | 0.000013 | com.groupon |
835 | 16902230 | 2137 | 0.000015 | org.videolan |
836 | 16901150 | 1636 | 0.000021 | org.unicode |
837 | 16900016 | 1653 | 0.000021 | com.gettyimages |
838 | 16899790 | 934 | 0.000034 | com.gfmag |
839 | 16899376 | 2156 | 0.000015 | com.lonelyplanet |
840 | 16898958 | 2455 | 0.000013 | edu.hbs |
841 | 16898564 | 1649 | 0.000021 | com.unity3d |
842 | 16898400 | 1060 | 0.000033 | dk.brics |
843 | 16898330 | 1087 | 0.000033 | com.salespider |
844 | 16897458 | 2341 | 0.000013 | hk.com.google |
845 | 16897240 | 1323 | 0.000030 | org.oecd |
846 | 16896204 | 2102 | 0.000015 | com.livestrong |
847 | 16895900 | 1786 | 0.000018 | com.freewebs |
848 | 16895046 | 283 | 0.000088 | com.garmin |
849 | 16894806 | 1546 | 0.000023 | gov.wa |
850 | 16894290 | 2116 | 0.000015 | com.netvibes |
851 | 16892110 | 1708 | 0.000020 | com.lulu |
852 | 16890928 | 3579 | 0.000008 | com.aviary |
853 | 16890402 | 1346 | 0.000029 | es.amazon |
854 | 16890092 | 2656 | 0.000011 | org.wikiquote |
855 | 16889952 | 2011 | 0.000016 | com.getresponse |
856 | 16889400 | 2023 | 0.000016 | com.espn |
857 | 16889116 | 1479 | 0.000025 | com.xkcd |
858 | 16888708 | 3547 | 0.000008 | org.edx |
859 | 16888596 | 1437 | 0.000026 | gov.va |
860 | 16888566 | 860 | 0.000036 | com.infusionsoft |
861 | 16888418 | 2074 | 0.000015 | com.history |
862 | 16888374 | 2263 | 0.000014 | me.flavors |
863 | 16887748 | 2806 | 0.000011 | org.moma |
864 | 16887652 | 7233 | 0.000004 | com.weheartit |
865 | 16887596 | 1987 | 0.000016 | com.popsugar |
866 | 16885864 | 1592 | 0.000022 | org.mayoclinic |
867 | 16885784 | 964 | 0.000034 | com.chicagotribune |
868 | 16885782 | 179 | 0.000160 | com.fontawesome |
869 | 16885584 | 1530 | 0.000024 | com.oup |
870 | 16885026 | 2044 | 0.000016 | com.w3techs |
871 | 16884320 | 1449 | 0.000026 | gov.bls |
872 | 16882438 | 3534 | 0.000008 | com.squidoo |
873 | 16881512 | 3331 | 0.000009 | edu.rochester |
874 | 16880454 | 2432 | 0.000013 | gov.cia |
875 | 16880366 | 2101 | 0.000015 | com.mercurynews |
876 | 16880258 | 1666 | 0.000021 | se.haxx |
877 | 16880238 | 1938 | 0.000017 | org.jstor |
878 | 16880112 | 1670 | 0.000021 | com.adjust |
879 | 16880022 | 2360 | 0.000013 | com.hindustantimes |
880 | 16879894 | 1042 | 0.000033 | com.enterprisenetworkingplanet |
881 | 16877894 | 3885 | 0.000008 | com.4shared |
882 | 16876582 | 1745 | 0.000019 | com.ssllabs |
883 | 16876172 | 1758 | 0.000019 | com.freepik |
884 | 16876008 | 1757 | 0.000019 | de.welt |
885 | 16875394 | 2673 | 0.000011 | com.panasonic |
886 | 16875294 | 1465 | 0.000025 | com.forrester |
887 | 16874980 | 2265 | 0.000014 | com.readwriteweb |
888 | 16874450 | 2968 | 0.000010 | com.softonic |
889 | 16873806 | 3072 | 0.000010 | org.psychologicalscience |
890 | 16872972 | 3809 | 0.000008 | org.libreoffice |
891 | 16871210 | 2402 | 0.000013 | net.faz |
892 | 16870474 | 2008 | 0.000016 | com.urbandictionary |
893 | 16870448 | 968 | 0.000034 | com.marketersmedia |
894 | 16870204 | 1292 | 0.000031 | com.brightcove |
895 | 16870198 | 1439 | 0.000026 | com.techtarget |
896 | 16869678 | 1011 | 0.000034 | com.shareasale |
897 | 16869582 | 819 | 0.000037 | gov.house |
898 | 16868858 | 111 | 0.000259 | com.namecheap |
899 | 16868596 | 3445 | 0.000008 | edu.rit |
900 | 16868496 | 1329 | 0.000030 | gov.archives |
901 | 16868332 | 1131 | 0.000033 | place.yellow |
902 | 16868126 | 432 | 0.000062 | pl.google |
903 | 16867896 | 2483 | 0.000012 | com.shutterfly |
904 | 16867822 | 1603 | 0.000022 | mil.army |
905 | 16867790 | 3244 | 0.000009 | com.avast |
906 | 16866940 | 2376 | 0.000013 | com.iconfinder |
907 | 16866928 | 5656 | 0.000005 | ro.blogspot |
908 | 16866544 | 1626 | 0.000021 | com.warnerbros |
909 | 16866516 | 1076 | 0.000033 | org.rethinkingschools |
910 | 16866252 | 3077 | 0.000010 | cc.tiny |
911 | 16865146 | 2594 | 0.000012 | com.html5rocks |
912 | 16864978 | 3243 | 0.000009 | com.askmen |
913 | 16864698 | 1952 | 0.000016 | com.nvidia |
914 | 16863352 | 2273 | 0.000014 | com.cbssports |
915 | 16862626 | 2275 | 0.000014 | edu.osu |
916 | 16861716 | 3269 | 0.000009 | edu.missouri |
917 | 16861414 | 2857 | 0.000010 | edu.oregonstate |
918 | 16860496 | 1979 | 0.000016 | com.colourlovers |
919 | 16860460 | 1073 | 0.000033 | com.elocal |
920 | 16860332 | 2209 | 0.000014 | com.ask |
921 | 16860210 | 787 | 0.000039 | org.bitbucket |
922 | 16860016 | 2042 | 0.000016 | com.me |
923 | 16859930 | 2556 | 0.000012 | com.technet |
924 | 16859514 | 2891 | 0.000010 | com.ezinearticles |
925 | 16858972 | 2983 | 0.000010 | com.scmp |
926 | 16858804 | 473 | 0.000057 | br.com.google |
927 | 16858300 | 3129 | 0.000009 | com.fitbit |
928 | 16857884 | 2112 | 0.000015 | com.comcast |
929 | 16857884 | 456 | 0.000059 | com.udacity |
930 | 16857642 | 2709 | 0.000011 | edu.pitt |
931 | 16857070 | 1756 | 0.000019 | com.findlaw |
932 | 16855402 | 2063 | 0.000015 | org.openoffice |
933 | 16855272 | 4482 | 0.000007 | net.minecraft |
934 | 16855074 | 2012 | 0.000016 | org.kde |
935 | 16854876 | 496 | 0.000054 | jp.ne.sakura |
936 | 16854736 | 2655 | 0.000011 | edu.tufts |
937 | 16854372 | 3823 | 0.000008 | com.techsmith |
938 | 16854054 | 1813 | 0.000018 | com.screencast |
939 | 16853734 | 2274 | 0.000014 | net.earthlink |
940 | 16853732 | 1760 | 0.000019 | uk.co.thetimes |
941 | 16853352 | 916 | 0.000035 | com.campaign-archive1 |
942 | 16853262 | 3031 | 0.000010 | edu.ucsc |
943 | 16852842 | 1586 | 0.000022 | com.outlook |
944 | 16852646 | 1344 | 0.000029 | com.usps |
945 | 16852484 | 1704 | 0.000020 | gov.uscis |
946 | 16852240 | 2639 | 0.000011 | com.virgin |
947 | 16851920 | 2685 | 0.000011 | ly.cl |
948 | 16851904 | 2763 | 0.000011 | com.asus |
949 | 16851360 | 2164 | 0.000014 | fr.lefigaro |
950 | 16850858 | 2003 | 0.000016 | org.poynter |
951 | 16850446 | 3962 | 0.000007 | edu.byu |
952 | 16850298 | 2822 | 0.000011 | com.rottentomatoes |
953 | 16850126 | 2372 | 0.000013 | uk.co.express |
954 | 16849406 | 1929 | 0.000017 | org.craigslist |
955 | 16849218 | 1816 | 0.000018 | com.smartinsights |
956 | 16849068 | 226 | 0.000117 | me.line |
957 | 16848958 | 1577 | 0.000023 | com.yoast |
958 | 16847912 | 2195 | 0.000014 | com.podbean |
959 | 16847122 | 2734 | 0.000011 | com.tesla |
960 | 16846772 | 3177 | 0.000009 | com.9to5mac |
961 | 16845622 | 3679 | 0.000008 | org.wikibooks |
962 | 16845576 | 1531 | 0.000024 | com.business2community |
963 | 16844552 | 1934 | 0.000017 | tech.ces |
964 | 16844034 | 2785 | 0.000011 | ca.huffingtonpost |
965 | 16843788 | 2578 | 0.000012 | com.sophos |
966 | 16843532 | 1063 | 0.000033 | com.fixr |
967 | 16843502 | 2972 | 0.000010 | edu.dartmouth |
968 | 16843380 | 3733 | 0.000008 | org.laptop |
969 | 16842304 | 2276 | 0.000014 | com.denverpost |
970 | 16842204 | 2773 | 0.000011 | com.business |
971 | 16842174 | 1441 | 0.000026 | jp.geocities |
972 | 16842034 | 1141 | 0.000033 | com.microbiologybytes |
973 | 16841636 | 2176 | 0.000014 | ca.sfu |
974 | 16841290 | 1853 | 0.000017 | com.deadline |
975 | 16840372 | 1999 | 0.000016 | com.jamanetwork |
976 | 16840134 | 2015 | 0.000016 | jp.ne.biglobe |
977 | 16839882 | 1514 | 0.000024 | org.fao |
978 | 16839876 | 733 | 0.000041 | com.sprinklr |
979 | 16838932 | 1520 | 0.000024 | jp.ne.goo |
980 | 16838696 | 4288 | 0.000007 | com.panoramio |
981 | 16838544 | 3078 | 0.000010 | com.freelancer |
982 | 16838516 | 4386 | 0.000007 | com.ladygaga |
983 | 16837918 | 3235 | 0.000009 | be.blogspot |
984 | 16837020 | 750 | 0.000041 | com.aweber |
985 | 16836864 | 7439 | 0.000004 | com.xanga |
986 | 16836534 | 2952 | 0.000010 | se.blogspot |
987 | 16836266 | 1324 | 0.000030 | com.linksynergy |
988 | 16836034 | 1759 | 0.000019 | com.ew |
989 | 16834924 | 3520 | 0.000008 | com.diigo |
990 | 16833654 | 2418 | 0.000013 | com.asahi |
991 | 16833642 | 970 | 0.000034 | de.bund |
992 | 16832758 | 2306 | 0.000014 | com.teenvogue |
993 | 16831744 | 3562 | 0.000008 | edu.fsu |
994 | 16831484 | 953 | 0.000034 | net.viainfo |
995 | 16831124 | 1066 | 0.000033 | com.superiorthreads |
996 | 16830498 | 1106 | 0.000033 | lt.yn |
997 | 16829872 | 1335 | 0.000029 | it.amazon |
998 | 16829434 | 821 | 0.000037 | ca.amazon |
999 | 16829292 | 1848 | 0.000017 | com.bigthink |
1000 | 16828640 | 335 | 0.000077 | org.debian |
Credits
Thanks to the authors of the WebGraph framework, whose software made the computation of graph properties and ranks possible.
We hope the data will be useful for you to do any kind of research on ranking, graph analysis, link spam detection, etc. Let us know about your results via Common Crawl’s Google Group!