Host- and Domain-Level Web Graphs Nov/Dec/Jan 2018 – 2019
We are pleased to announce a new release of host-level and domain-level web graphs based on the published crawls of November, December 2018 and January 2019. Additional information about the data formats, the processing pipeline, our objectives, and credits can be found in the announcements of prior webgraph releases (e.g., Nov/Dec/Jan 2017-2018 Webgraphs). You may also visit the projects cc-webgraph and cc-pyspark which host all scripts and tools required to construct the graphs.
Host-level graph
The graph consists of 407 million nodes and 4.2 billion edges and includes dangling nodes i.e. hosts that have not been crawled yet are pointed to from a link on a crawled page. There are 323 million dangling nodes (79%) and the largest strongly connected component contains 63 million (15%) nodes.
You can download the graph and the ranks of all 407 million hosts from AWS S3 on the path s3://commoncrawl/projects/hyperlinkgraph/cc-main-2018-19-nov-dec-jan/host/
. Alternatively, you can use https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2018-19-nov-dec-jan/host/
as prefix to access the files from everywhere.
Download files of the Common Crawl Nov/Dec/Jan 2018-19 host-level webgraph
Size | File | Description |
---|---|---|
2.90 GB | cc-main-2018-19-nov-dec-jan-host-vertices.paths.gz | nodes 〈id, rev host〉, paths of 42 vertices files |
18.84 GB | cc-main-2018-19-nov-dec-jan-host-edges.paths.gz | edges 〈from_id, to_id〉, paths of 84 edges files |
7.81 GB | cc-main-2018-19-nov-dec-jan-host.graph | graph in BVGraph format |
2 kB | cc-main-2018-19-nov-dec-jan-host.properties | |
8.16 GB | cc-main-2018-19-nov-dec-jan-host-t.graph | transpose of the graph (outlinks inverted to inlinks) |
2 kB | cc-main-2018-19-nov-dec-jan-host-t.properties | |
1 kB | cc-main-2018-19-nov-dec-jan-host.stats | WebGraph statistics |
7.50 GB | cc-main-2018-19-nov-dec-jan-host-ranks.txt.gz | harmonic centrality and pagerank |
Note that the host names are reversed and a leading www.
is stripped: www.subdomain.example.com
becomes com.example.subdomain
.
Domain-level graph
The domain graph was built by aggregating the host graph on the level of pay-level domains (PLDs) based on the public suffix list maintained on publicsuffix.org.
The domain-level graph has 90 million nodes and 1.69 billion edges. 53% or 48 million nodes are dangling nodes, the largest strongly connected component covers 37 million or 41% of the nodes.
All files related to the domain graph are available on AWS S3 under s3://commoncrawl/projects/hyperlinkgraph/cc-main-2018-19-nov-dec-jan/domain/
resp. https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2018-19-nov-dec-jan/domain/
.
Download files of the Common Crawl Nov/Dec/Jan 2018-19 domain-level webgraph
Size | File | Description |
---|---|---|
0.62 GB | cc-main-2018-19-nov-dec-jan-domain-vertices.txt.gz | nodes 〈id, rev domain, num hosts〉 |
6.76 GB | cc-main-2018-19-nov-dec-jan-domain-edges.txt.gz | edges 〈from_id, to_id〉 |
3.68 GB | cc-main-2018-19-nov-dec-jan-domain.graph | graph in BVGraph format |
2 kB | cc-main-2018-19-nov-dec-jan-domain.properties | |
3.82 GB | cc-main-2018-19-nov-dec-jan-domain-t.graph | transpose of the graph |
2 kB | cc-main-2018-19-nov-dec-jan-domain-t.properties | |
1 kB | cc-main-2018-19-nov-dec-jan-domain.stats | WebGraph statistics |
1.96 GB | cc-main-2018-19-nov-dec-jan-domain-ranks.txt.gz | harmonic centrality and pagerank |
Below you’ll find the top 1000 domains ranked by Harmonic Centrality or PageRank. The full list of all 90 million domain ranks is available for download.
Top 1000 domains ranked by harmonic centrality (Nov/Dec/Jan 2018-2019)
harmonic centrality rank | hc value | page rank | page rank value | reversed hostname |
---|---|---|---|---|
1 | 27203288 | 2 | 0.012818 | com.facebook |
2 | 27081816 | 1 | 0.017236 | com.googleapis |
3 | 25533108 | 3 | 0.010690 | com.google |
4 | 24267906 | 4 | 0.007625 | com.twitter |
5 | 24001384 | 5 | 0.006755 | com.youtube |
6 | 23187226 | 6 | 0.006532 | org.w |
7 | 21605786 | 8 | 0.003925 | com.instagram |
8 | 21386658 | 7 | 0.004753 | org.gmpg |
9 | 20954100 | 11 | 0.003053 | com.linkedin |
10 | 20252174 | 12 | 0.002871 | org.wordpress |
11 | 20166276 | 15 | 0.002217 | com.wordpress |
12 | 20071538 | 24 | 0.001532 | com.gravatar |
13 | 20054574 | 22 | 0.001673 | com.pinterest |
14 | 20035420 | 27 | 0.001366 | org.wikipedia |
15 | 19689680 | 21 | 0.001831 | com.apple |
16 | 19669598 | 13 | 0.002776 | com.bootstrapcdn |
17 | 19590352 | 36 | 0.000986 | com.blogspot |
18 | 19579602 | 28 | 0.001308 | com.vimeo |
19 | 19357866 | 41 | 0.000827 | be.youtu |
20 | 19345240 | 14 | 0.002221 | com.cloudflare |
21 | 19288382 | 37 | 0.000940 | gl.goo |
22 | 19267938 | 29 | 0.001236 | com.microsoft |
23 | 19181584 | 25 | 0.001444 | com.adobe |
24 | 19148714 | 42 | 0.000817 | com.amazon |
25 | 19143492 | 17 | 0.002000 | com.googletagmanager |
26 | 19087530 | 49 | 0.000656 | com.tumblr |
27 | 19040054 | 23 | 0.001572 | com.macromedia |
28 | 19024404 | 51 | 0.000647 | com.wp |
29 | 19009908 | 16 | 0.002181 | com.flickr |
30 | 18980982 | 71 | 0.000509 | ly.bit |
31 | 18864572 | 74 | 0.000479 | com.yahoo |
32 | 18847172 | 39 | 0.000879 | com.amazonaws |
33 | 18818456 | 38 | 0.000888 | com.paypal |
34 | 18798784 | 20 | 0.001840 | com.github |
35 | 18762366 | 65 | 0.000584 | org.mozilla |
36 | 18761330 | 26 | 0.001413 | com.gstatic |
37 | 18756286 | 64 | 0.000596 | me.wp |
38 | 18648308 | 97 | 0.000312 | com.googleusercontent |
39 | 18645512 | 40 | 0.000867 | net.cloudfront |
40 | 18636726 | 85 | 0.000364 | com.soundcloud |
41 | 18628624 | 109 | 0.000267 | com.nytimes |
42 | 18621690 | 81 | 0.000425 | com.weebly |
43 | 18599952 | 54 | 0.000633 | net.doubleclick |
44 | 18588240 | 44 | 0.000760 | org.w3 |
45 | 18584910 | 87 | 0.000346 | co.t |
46 | 18575634 | 101 | 0.000303 | com.reddit |
47 | 18568330 | 68 | 0.000521 | com.medium |
48 | 18560552 | 150 | 0.000157 | org.wikimedia |
49 | 18552104 | 111 | 0.000257 | com.dropbox |
50 | 18520572 | 83 | 0.000402 | org.creativecommons |
51 | 18509376 | 134 | 0.000192 | org.archive |
52 | 18508730 | 33 | 0.001034 | io.github |
53 | 18458414 | 77 | 0.000443 | com.bing |
54 | 18443042 | 146 | 0.000176 | net.slideshare |
55 | 18442342 | 124 | 0.000215 | com.imgur |
56 | 18429066 | 31 | 0.001176 | ru.yandex |
57 | 18423958 | 82 | 0.000417 | de.google |
58 | 18405610 | 30 | 0.001179 | net.fbcdn |
59 | 18398944 | 158 | 0.000150 | edu.stanford |
60 | 18379294 | 241 | 0.000099 | com.bbc |
61 | 18375750 | 215 | 0.000111 | com.tinyurl |
62 | 18368156 | 34 | 0.001028 | org.apache |
63 | 18362114 | 94 | 0.000316 | com.mailchimp |
64 | 18338296 | 183 | 0.000127 | com.wired |
65 | 18322334 | 136 | 0.000190 | com.blogger |
66 | 18280996 | 63 | 0.000599 | eu.europa |
67 | 18277804 | 130 | 0.000200 | com.issuu |
68 | 18271824 | 219 | 0.000109 | com.bloomberg |
69 | 18257422 | 182 | 0.000127 | com.myspace |
70 | 18254210 | 80 | 0.000425 | com.jquery |
71 | 18249798 | 78 | 0.000433 | com.baidu |
72 | 18230364 | 347 | 0.000069 | com.appspot |
73 | 18220768 | 137 | 0.000188 | com.eventbrite |
74 | 18214820 | 125 | 0.000212 | com.yelp |
75 | 18209194 | 138 | 0.000185 | com.spotify |
76 | 18208644 | 143 | 0.000180 | org.ietf |
77 | 18202076 | 189 | 0.000125 | com.oracle |
78 | 18200628 | 172 | 0.000139 | com.android |
79 | 18196004 | 248 | 0.000095 | org.npr |
80 | 18194938 | 331 | 0.000072 | com.theverge |
81 | 18188710 | 32 | 0.001108 | com.squarespace |
82 | 18180064 | 307 | 0.000077 | com.googleblog |
83 | 18168696 | 173 | 0.000139 | org.gnu |
84 | 18168282 | 115 | 0.000241 | com.youtube-nocookie |
85 | 18166400 | 352 | 0.000068 | com.quora |
86 | 18166372 | 84 | 0.000388 | com.statcounter |
87 | 18162270 | 355 | 0.000068 | com.deviantart |
88 | 18147690 | 314 | 0.000076 | com.buzzfeed |
89 | 18132148 | 281 | 0.000083 | org.python |
90 | 18130544 | 284 | 0.000082 | me.about |
91 | 18122852 | 426 | 0.000057 | com.slate |
92 | 18120874 | 443 | 0.000055 | org.ieee |
93 | 18109888 | 357 | 0.000068 | uk.co.independent |
94 | 18104220 | 117 | 0.000228 | com.whatsapp |
95 | 18094292 | 279 | 0.000085 | com.w3schools |
96 | 18092538 | 72 | 0.000495 | org.schema |
97 | 18087066 | 448 | 0.000054 | edu.upenn |
98 | 18080120 | 45 | 0.000737 | com.fontawesome |
99 | 18076578 | 476 | 0.000051 | edu.ucla |
100 | 18072366 | 424 | 0.000057 | edu.washington |
101 | 18072078 | 641 | 0.000045 | org.chromium |
102 | 18068624 | 468 | 0.000052 | uk.ac.ox |
103 | 18067404 | 386 | 0.000063 | com.newyorker |
104 | 18066728 | 186 | 0.000125 | net.behance |
105 | 18057700 | 282 | 0.000083 | com.example |
106 | 18054090 | 400 | 0.000061 | org.arxiv |
107 | 18052930 | 104 | 0.000285 | com.ytimg |
108 | 18049852 | 192 | 0.000123 | com.dribbble |
109 | 18029132 | 222 | 0.000109 | gov.ca |
110 | 18026716 | 140 | 0.000184 | com.forbes |
111 | 18025030 | 374 | 0.000065 | gov.loc |
112 | 18013454 | 228 | 0.000103 | com.fastcompany |
113 | 18008156 | 253 | 0.000092 | com.foursquare |
114 | 18007062 | 380 | 0.000064 | com.about |
115 | 18005498 | 179 | 0.000132 | com.cnn |
116 | 18005262 | 157 | 0.000150 | com.theguardian |
117 | 18005254 | 466 | 0.000052 | com.evernote |
118 | 18002708 | 379 | 0.000064 | com.git-scm |
119 | 18001892 | 337 | 0.000071 | au.com.google |
120 | 18001316 | 490 | 0.000050 | edu.princeton |
121 | 17997576 | 247 | 0.000096 | com.typeform |
122 | 17995020 | 469 | 0.000052 | com.withgoogle |
123 | 17991120 | 648 | 0.000044 | com.storify |
124 | 17986952 | 525 | 0.000047 | com.stackexchange |
125 | 17985482 | 652 | 0.000044 | google.blog |
126 | 17982244 | 9 | 0.003675 | com.godaddy |
127 | 17976782 | 229 | 0.000103 | com.nbcnews |
128 | 17974972 | 161 | 0.000148 | uk.co.bbc |
129 | 17973294 | 332 | 0.000072 | uk.co.blogspot |
130 | 17971188 | 396 | 0.000061 | com.tandfonline |
131 | 17957502 | 408 | 0.000060 | com.mysql |
132 | 17946028 | 632 | 0.000045 | ca.blogspot |
133 | 17943522 | 479 | 0.000051 | com.libsyn |
134 | 17940278 | 196 | 0.000120 | es.google |
135 | 17934926 | 491 | 0.000050 | com.tinypic |
136 | 17933522 | 482 | 0.000051 | com.ubuntu |
137 | 17932534 | 748 | 0.000039 | com.nike |
138 | 17931294 | 402 | 0.000061 | org.bitbucket |
139 | 17930976 | 276 | 0.000085 | org.doi |
140 | 17929634 | 336 | 0.000072 | com.getpocket |
141 | 17927596 | 676 | 0.000043 | com.jetbrains |
142 | 17909710 | 278 | 0.000085 | com.mozilla |
143 | 17909040 | 697 | 0.000041 | com.sap |
144 | 17900594 | 449 | 0.000054 | com.googlecode |
145 | 17899774 | 73 | 0.000484 | com.list-manage |
146 | 17895240 | 185 | 0.000126 | com.huffingtonpost |
147 | 17894146 | 635 | 0.000045 | tv.ustream |
148 | 17893688 | 86 | 0.000351 | com.paypalobjects |
149 | 17890446 | 459 | 0.000053 | com.trello |
150 | 17886818 | 269 | 0.000086 | edu.mit |
151 | 17882064 | 152 | 0.000154 | net.sourceforge |
152 | 17879878 | 245 | 0.000096 | com.githubusercontent |
153 | 17877554 | 498 | 0.000049 | com.chrome |
154 | 17864368 | 953 | 0.000033 | edu.gatech |
155 | 17859670 | 447 | 0.000054 | com.docker |
156 | 17858794 | 719 | 0.000040 | com.ssrn |
157 | 17858574 | 597 | 0.000045 | co.g |
158 | 17857678 | 90 | 0.000329 | com.wix |
159 | 17856626 | 205 | 0.000116 | com.washingtonpost |
160 | 17849554 | 1082 | 0.000029 | com.diigo |
161 | 17847314 | 360 | 0.000067 | gov.fda |
162 | 17845128 | 127 | 0.000205 | org.bbb |
163 | 17840318 | 961 | 0.000033 | com.flipboard |
164 | 17839092 | 939 | 0.000034 | it.scoop |
165 | 17838238 | 819 | 0.000037 | com.nvidia |
166 | 17836702 | 297 | 0.000080 | com.reuters |
167 | 17836356 | 296 | 0.000080 | com.mapquest |
168 | 17830996 | 570 | 0.000046 | com.pingdom |
169 | 17830362 | 277 | 0.000085 | com.go |
170 | 17827980 | 199 | 0.000119 | org.debian |
171 | 17822238 | 198 | 0.000119 | com.wsj |
172 | 17822206 | 898 | 0.000035 | com.fastcodesign |
173 | 17819482 | 35 | 0.001004 | com.fb |
174 | 17815978 | 814 | 0.000037 | site.business |
175 | 17814932 | 234 | 0.000101 | com.techcrunch |
176 | 17807884 | 250 | 0.000094 | com.usatoday |
177 | 17807344 | 148 | 0.000171 | gov.nih |
178 | 17807156 | 153 | 0.000154 | com.etsy |
179 | 17804386 | 543 | 0.000047 | org.eclipse |
180 | 17796560 | 1025 | 0.000031 | com.hbo |
181 | 17791748 | 46 | 0.000708 | net.akamaihd |
182 | 17790986 | 200 | 0.000118 | com.live |
183 | 17790210 | 977 | 0.000032 | ms.1drv |
184 | 17789540 | 975 | 0.000033 | nl.blogspot |
185 | 17782296 | 216 | 0.000111 | com.businessinsider |
186 | 17779806 | 415 | 0.000059 | com.unity3d |
187 | 17772776 | 471 | 0.000052 | com.cdbaby |
188 | 17769846 | 710 | 0.000041 | se.haxx |
189 | 17768930 | 163 | 0.000142 | org.iana |
190 | 17766540 | 98 | 0.000311 | com.shopify |
191 | 17765610 | 283 | 0.000082 | com.herokuapp |
192 | 17762614 | 280 | 0.000084 | edu.harvard |
193 | 17760570 | 293 | 0.000080 | net.windows |
194 | 17760214 | 747 | 0.000039 | org.unicode |
195 | 17758178 | 110 | 0.000264 | com.jimdo |
196 | 17758168 | 344 | 0.000070 | com.msn |
197 | 17757864 | 287 | 0.000081 | uk.co.telegraph |
198 | 17756896 | 209 | 0.000112 | com.typepad |
199 | 17755326 | 147 | 0.000174 | com.opera |
200 | 17752324 | 1084 | 0.000029 | com.creativebloq |
201 | 17750792 | 852 | 0.000036 | edu.rutgers |
202 | 17750190 | 662 | 0.000043 | gov.wa |
203 | 17750042 | 944 | 0.000034 | com.history |
204 | 17748756 | 362 | 0.000066 | gov.nasa |
205 | 17748704 | 844 | 0.000037 | edu.illinois |
206 | 17743998 | 509 | 0.000049 | au.gov.nsw |
207 | 17737554 | 631 | 0.000045 | gov.dot |
208 | 17730560 | 1024 | 0.000031 | edu.pitt |
209 | 17730390 | 191 | 0.000124 | com.imdb |
210 | 17727110 | 95 | 0.000315 | net.jsdelivr |
211 | 17726578 | 373 | 0.000065 | com.mashable |
212 | 17721654 | 67 | 0.000526 | com.vk |
213 | 17719938 | 47 | 0.000677 | net.facebook |
214 | 17719050 | 195 | 0.000121 | uk.co.amazon |
215 | 17717626 | 105 | 0.000279 | com.google-analytics |
216 | 17715986 | 313 | 0.000076 | com.cnet |
217 | 17712616 | 1192 | 0.000027 | org.wikibooks |
218 | 17711346 | 238 | 0.000100 | com.ibm |
219 | 17708674 | 906 | 0.000035 | ca.utoronto |
220 | 17706048 | 372 | 0.000065 | com.ted |
221 | 17703164 | 930 | 0.000034 | au.com.blogspot |
222 | 17696634 | 809 | 0.000038 | com.ecwid |
223 | 17692804 | 422 | 0.000058 | uk.co.pinterest |
224 | 17688850 | 954 | 0.000033 | com.theknot |
225 | 17683380 | 971 | 0.000033 | edu.osu |
226 | 17676892 | 368 | 0.000066 | com.latimes |
227 | 17675948 | 231 | 0.000103 | net.php |
228 | 17674866 | 1023 | 0.000031 | com.dw |
229 | 17673722 | 972 | 0.000033 | org.hrw |
230 | 17669176 | 181 | 0.000128 | com.stackoverflow |
231 | 17666396 | 1063 | 0.000030 | io.itch |
232 | 17663236 | 262 | 0.000090 | com.npmjs |
233 | 17654604 | 917 | 0.000035 | us.mn.state |
234 | 17654482 | 387 | 0.000063 | uk.co.dailymail |
235 | 17654042 | 306 | 0.000077 | com.time |
236 | 17653078 | 175 | 0.000137 | com.twimg |
237 | 17651364 | 214 | 0.000112 | com.surveymonkey |
238 | 17648462 | 493 | 0.000050 | net.researchgate |
239 | 17639638 | 1287 | 0.000024 | com.kinja |
240 | 17636060 | 913 | 0.000035 | gov.defense |
241 | 17634608 | 423 | 0.000058 | edu.cornell |
242 | 17632872 | 804 | 0.000038 | com.citrix |
243 | 17631522 | 18 | 0.001984 | com.wixstatic |
244 | 17627972 | 1349 | 0.000023 | com.instapaper |
245 | 17627386 | 456 | 0.000053 | io.readthedocs |
246 | 17622738 | 903 | 0.000035 | com.vogue |
247 | 17622484 | 339 | 0.000071 | me.telegram |
248 | 17622274 | 738 | 0.000040 | org.postgresql |
249 | 17619732 | 1211 | 0.000026 | com.dezeen |
250 | 17619540 | 842 | 0.000037 | com.citysearch |
251 | 17617810 | 440 | 0.000056 | com.ft |
252 | 17616210 | 688 | 0.000042 | org.kernel |
253 | 17615932 | 969 | 0.000033 | com.yellowpages |
254 | 17615850 | 144 | 0.000179 | uk.co.google |
255 | 17615132 | 275 | 0.000085 | org.acm |
256 | 17611938 | 160 | 0.000148 | com.zendesk |
257 | 17608414 | 420 | 0.000058 | com.kickstarter |
258 | 17607082 | 1060 | 0.000030 | com.strava |
259 | 17606762 | 419 | 0.000058 | edu.berkeley |
260 | 17606252 | 1045 | 0.000030 | gov.mo |
261 | 17604126 | 333 | 0.000072 | com.cnbc |
262 | 17602550 | 52 | 0.000636 | com.qq |
263 | 17598790 | 670 | 0.000043 | com.adjust |
264 | 17596982 | 1026 | 0.000031 | gov.oregon |
265 | 17596684 | 299 | 0.000080 | com.meetup |
266 | 17594788 | 1016 | 0.000031 | org.tensorflow |
267 | 17594178 | 312 | 0.000077 | com.mapbox |
268 | 17592452 | 159 | 0.000150 | com.salesforce |
269 | 17586524 | 353 | 0.000068 | com.gmail |
270 | 17577594 | 1066 | 0.000030 | com.googlesource |
271 | 17574716 | 1176 | 0.000027 | edu.kit |
272 | 17574656 | 327 | 0.000073 | com.springer |
273 | 17574172 | 55 | 0.000629 | net.jsfiddle |
274 | 17571342 | 848 | 0.000037 | com.wikia |
275 | 17570210 | 1123 | 0.000028 | gov.ky |
276 | 17570030 | 685 | 0.000042 | com.matterport |
277 | 17569184 | 1055 | 0.000030 | com.hackernoon |
278 | 17569072 | 382 | 0.000064 | com.fortune |
279 | 17568196 | 397 | 0.000061 | com.photobucket |
280 | 17565868 | 376 | 0.000065 | com.giphy |
281 | 17561918 | 349 | 0.000069 | com.nypost |
282 | 17561528 | 664 | 0.000043 | com.angieslist |
283 | 17558588 | 1103 | 0.000029 | gov.wi |
284 | 17558450 | 908 | 0.000035 | com.xrea |
285 | 17558178 | 187 | 0.000125 | com.ebay |
286 | 17557786 | 870 | 0.000036 | com.pixabay |
287 | 17555784 | 1035 | 0.000031 | org.wnyc |
288 | 17554024 | 627 | 0.000045 | com.economist |
289 | 17553246 | 285 | 0.000082 | com.hubspot |
290 | 17552904 | 858 | 0.000036 | edu.columbia |
291 | 17552482 | 317 | 0.000076 | org.un |
292 | 17551250 | 394 | 0.000062 | org.hbr |
293 | 17547768 | 824 | 0.000037 | com.arstechnica |
294 | 17547252 | 521 | 0.000048 | com.livechatinc |
295 | 17544648 | 967 | 0.000033 | com.missingkids |
296 | 17542812 | 135 | 0.000191 | com.feedburner |
297 | 17542646 | 563 | 0.000046 | com.nationalgeographic |
298 | 17542210 | 839 | 0.000037 | edu.yale |
299 | 17541890 | 960 | 0.000033 | org.ohchr |
300 | 17539760 | 826 | 0.000037 | org.aarp |
301 | 17538968 | 550 | 0.000046 | com.scribd |
302 | 17536254 | 1037 | 0.000031 | gov.maryland |
303 | 17535552 | 987 | 0.000032 | gov.michigan |
304 | 17534878 | 1170 | 0.000027 | gov.mt |
305 | 17532728 | 354 | 0.000068 | com.oreilly |
306 | 17528914 | 116 | 0.000238 | com.addthis |
307 | 17524962 | 410 | 0.000060 | com.theatlantic |
308 | 17522894 | 1164 | 0.000027 | org.amnesty |
309 | 17522838 | 767 | 0.000039 | com.engadget |
310 | 17522742 | 1048 | 0.000030 | us.pa.state |
311 | 17522588 | 1446 | 0.000022 | com.jigsy |
312 | 17520734 | 1275 | 0.000025 | com.healthgrades |
313 | 17520216 | 679 | 0.000042 | com.intel |
314 | 17517294 | 404 | 0.000061 | gov.whitehouse |
315 | 17517106 | 1250 | 0.000025 | com.manta |
316 | 17515170 | 689 | 0.000042 | com.vice |
317 | 17515068 | 412 | 0.000059 | com.unsplash |
318 | 17507818 | 311 | 0.000077 | com.wiley |
319 | 17506494 | 128 | 0.000204 | com.wixsite |
320 | 17503220 | 637 | 0.000045 | com.wikihow |
321 | 17499836 | 1302 | 0.000024 | com.merchantcircle |
322 | 17496442 | 341 | 0.000070 | com.livejournal |
323 | 17494952 | 342 | 0.000070 | com.booking |
324 | 17494632 | 1395 | 0.000022 | io.soup |
325 | 17493230 | 370 | 0.000065 | com.skype |
326 | 17490618 | 518 | 0.000048 | com.samsung |
327 | 17490516 | 655 | 0.000044 | com.zdnet |
328 | 17487772 | 398 | 0.000061 | com.entrepreneur |
329 | 17485998 | 300 | 0.000080 | com.staticflickr |
330 | 17485468 | 343 | 0.000070 | com.prnewswire |
331 | 17484254 | 1306 | 0.000024 | ca.yelp |
332 | 17484254 | 1216 | 0.000026 | com.contently |
333 | 17483554 | 272 | 0.000085 | int.who |
334 | 17483044 | 828 | 0.000037 | com.qz |
335 | 17477120 | 359 | 0.000067 | com.office |
336 | 17476598 | 472 | 0.000052 | com.cisco |
337 | 17476580 | 1424 | 0.000022 | com.gimletmedia |
338 | 17476460 | 1540 | 0.000020 | com.designobserver |
339 | 17475042 | 294 | 0.000080 | com.hp |
340 | 17474806 | 260 | 0.000090 | gov.cdc |
341 | 17471496 | 236 | 0.000101 | com.disqus |
342 | 17470994 | 1376 | 0.000023 | us.wi.state |
343 | 17467786 | 640 | 0.000045 | com.cbsnews |
344 | 17467412 | 517 | 0.000048 | com.statista |
345 | 17467326 | 126 | 0.000208 | com.weibo |
346 | 17466370 | 729 | 0.000040 | co.elastic |
347 | 17465780 | 551 | 0.000046 | ca.pinterest |
348 | 17465738 | 832 | 0.000037 | edu.psu |
349 | 17462258 | 1212 | 0.000026 | org.tigris |
350 | 17460552 | 1296 | 0.000024 | com.thoughtworks |
351 | 17454102 | 407 | 0.000060 | com.inc |
352 | 17452694 | 492 | 0.000050 | org.mediawiki |
353 | 17450142 | 340 | 0.000071 | com.dailymotion |
354 | 17449322 | 389 | 0.000063 | com.aol |
355 | 17448426 | 976 | 0.000033 | com.gizmodo |
356 | 17447376 | 1278 | 0.000025 | org.emojipedia |
357 | 17445752 | 1081 | 0.000029 | net.leadpages |
358 | 17445540 | 500 | 0.000049 | gov.nist |
359 | 17442880 | 1459 | 0.000021 | com.zynga |
360 | 17442700 | 361 | 0.000067 | org.ampproject |
361 | 17442350 | 1218 | 0.000026 | us.nm.state |
362 | 17442298 | 1453 | 0.000021 | com.activerain |
363 | 17441802 | 1046 | 0.000030 | com.bandsintown |
364 | 17439472 | 484 | 0.000051 | com.nature |
365 | 17439328 | 520 | 0.000048 | com.venturebeat |
366 | 17438974 | 572 | 0.000046 | com.box |
367 | 17438964 | 178 | 0.000135 | com.constantcontact |
368 | 17438634 | 213 | 0.000112 | to.amzn |
369 | 17433964 | 970 | 0.000033 | com.thenextweb |
370 | 17433742 | 1322 | 0.000024 | com.superpages |
371 | 17432018 | 508 | 0.000049 | com.symantec |
372 | 17424908 | 552 | 0.000046 | org.nodejs |
373 | 17424538 | 242 | 0.000099 | org.drupal |
374 | 17423606 | 180 | 0.000131 | com.tripadvisor |
375 | 17423290 | 698 | 0.000041 | com.deloitte |
376 | 17422498 | 1044 | 0.000030 | us.fl.state |
377 | 17422248 | 251 | 0.000094 | com.digg |
378 | 17419896 | 991 | 0.000032 | edu.utexas |
379 | 17419420 | 959 | 0.000033 | com.googlegroups |
380 | 17418564 | 1093 | 0.000029 | com.pexels |
381 | 17418492 | 1329 | 0.000024 | ly.snip |
382 | 17418108 | 322 | 0.000075 | fr.free |
383 | 17417322 | 308 | 0.000077 | com.sciencedirect |
384 | 17413382 | 203 | 0.000117 | com.bandcamp |
385 | 17413228 | 633 | 0.000045 | com.moz |
386 | 17412704 | 1408 | 0.000022 | com.whitepages |
387 | 17410218 | 732 | 0.000040 | com.psychologytoday |
388 | 17407554 | 1480 | 0.000021 | com.digitaltrends |
389 | 17404092 | 1539 | 0.000020 | edu.scad |
390 | 17399826 | 1056 | 0.000030 | org.weforum |
391 | 17397762 | 330 | 0.000072 | com.sxsw |
392 | 17394976 | 202 | 0.000117 | de.amazon |
393 | 17394802 | 464 | 0.000052 | com.goodreads |
394 | 17393720 | 937 | 0.000034 | org.eff |
395 | 17392836 | 754 | 0.000039 | com.indiatimes |
396 | 17391108 | 1147 | 0.000028 | com.thinkwithgoogle |
397 | 17385920 | 1442 | 0.000022 | org.khanacademy |
398 | 17380096 | 901 | 0.000035 | com.shutterstock |
399 | 17379546 | 829 | 0.000037 | edu.umich |
400 | 17377974 | 658 | 0.000043 | com.raywenderlich |
401 | 17376058 | 375 | 0.000065 | com.businesswire |
402 | 17375914 | 1352 | 0.000023 | edu.usc |
403 | 17375836 | 270 | 0.000086 | ca.google |
404 | 17373678 | 226 | 0.000104 | com.stumbleupon |
405 | 17373002 | 1371 | 0.000023 | com.mysanantonio |
406 | 17368554 | 204 | 0.000116 | com.automattic |
407 | 17368054 | 891 | 0.000035 | au.net.abc |
408 | 17365624 | 864 | 0.000036 | org.worldbank |
409 | 17364686 | 1350 | 0.000023 | edu.unc |
410 | 17364370 | 1113 | 0.000028 | org.example |
411 | 17362738 | 1375 | 0.000023 | it.eventbrite |
412 | 17361690 | 1243 | 0.000025 | com.merriam-webster |
413 | 17360026 | 1550 | 0.000020 | edu.hmc |
414 | 17357560 | 912 | 0.000035 | uk.co.guardian |
415 | 17356764 | 871 | 0.000036 | com.netflix |
416 | 17354116 | 446 | 0.000055 | com.slack |
417 | 17352062 | 1438 | 0.000022 | me.websta |
418 | 17350742 | 1261 | 0.000025 | com.kaggle |
419 | 17350270 | 544 | 0.000047 | org.pbs |
420 | 17347142 | 506 | 0.000049 | com.webs |
421 | 17341612 | 1338 | 0.000023 | com.ning |
422 | 17341024 | 1339 | 0.000023 | com.speakerdeck |
423 | 17338712 | 1598 | 0.000020 | au.com.yelp |
424 | 17337250 | 1602 | 0.000020 | org.themoth |
425 | 17336832 | 1272 | 0.000025 | com.canva |
426 | 17336530 | 1384 | 0.000023 | com.pcworld |
427 | 17335622 | 1186 | 0.000027 | com.indiegogo |
428 | 17334616 | 1247 | 0.000025 | edu.toronto |
429 | 17333104 | 2537 | 0.000014 | com.instructables |
430 | 17331566 | 1517 | 0.000021 | com.brandyourself |
431 | 17331038 | 722 | 0.000040 | org.unesco |
432 | 17330476 | 1171 | 0.000027 | com.pcmag |
433 | 17330344 | 956 | 0.000033 | com.marketwatch |
434 | 17329390 | 945 | 0.000033 | com.foxnews |
435 | 17325772 | 526 | 0.000047 | tv.twitch |
436 | 17321778 | 1196 | 0.000026 | org.mozillazine |
437 | 17320920 | 1552 | 0.000020 | org.owasp |
438 | 17319708 | 1374 | 0.000023 | com.googleapps |
439 | 17319644 | 1146 | 0.000028 | co.leadpages |
440 | 17319502 | 1604 | 0.000020 | com.yellowbook |
441 | 17319460 | 1391 | 0.000022 | org.coursera |
442 | 17319074 | 1316 | 0.000024 | edu.academia |
443 | 17318194 | 318 | 0.000075 | com.tripod |
444 | 17318084 | 996 | 0.000032 | edu.ucsd |
445 | 17316988 | 763 | 0.000039 | com.gartner |
446 | 17316564 | 915 | 0.000035 | com.sfgate |
447 | 17315318 | 718 | 0.000040 | com.blackberry |
448 | 17314360 | 1117 | 0.000028 | org.haskell |
449 | 17314258 | 364 | 0.000066 | it.placehold |
450 | 17311942 | 1549 | 0.000020 | edu.utep |
451 | 17311156 | 1224 | 0.000026 | gov.nh |
452 | 17310230 | 1263 | 0.000025 | edu.northwestern |
453 | 17306310 | 1190 | 0.000027 | de.spiegel |
454 | 17303936 | 321 | 0.000075 | com.getclicky |
455 | 17302292 | 328 | 0.000073 | com.rawgit |
456 | 17301718 | 371 | 0.000065 | edu.nyu |
457 | 17300434 | 1087 | 0.000029 | org.maven |
458 | 17299754 | 348 | 0.000069 | edu.cmu |
459 | 17298408 | 1065 | 0.000030 | edu.wisc |
460 | 17294964 | 957 | 0.000033 | com.dropboxusercontent |
461 | 17294946 | 295 | 0.000080 | com.smugmug |
462 | 17290908 | 1335 | 0.000024 | com.googledrive |
463 | 17290086 | 923 | 0.000034 | gov.fcc |
464 | 17289604 | 534 | 0.000047 | com.outlook |
465 | 17288796 | 1277 | 0.000025 | edu.uchicago |
466 | 17287666 | 634 | 0.000045 | com.windowsphone |
467 | 17284804 | 1327 | 0.000024 | gov.la |
468 | 17284524 | 1689 | 0.000019 | org.maximumfun |
469 | 17284360 | 305 | 0.000078 | net.datatables |
470 | 17284320 | 571 | 0.000046 | com.lifehacker |
471 | 17283846 | 501 | 0.000049 | in.co.google |
472 | 17283788 | 580 | 0.000046 | gov.noaa |
473 | 17283492 | 1644 | 0.000020 | edu.uah |
474 | 17282770 | 802 | 0.000038 | com.steampowered |
475 | 17279092 | 1427 | 0.000022 | com.invisionapp |
476 | 17274466 | 704 | 0.000041 | com.msdn |
477 | 17274380 | 1088 | 0.000029 | org.vim |
478 | 17274242 | 169 | 0.000141 | jp.co.yahoo |
479 | 17274032 | 473 | 0.000052 | com.cargocollective |
480 | 17273984 | 1142 | 0.000028 | com.ycombinator |
481 | 17272438 | 235 | 0.000101 | gov.ftc |
482 | 17271196 | 1364 | 0.000023 | org.iihs |
483 | 17270984 | 896 | 0.000035 | gov.census |
484 | 17270534 | 1245 | 0.000025 | com.upwork |
485 | 17270494 | 2228 | 0.000017 | com.ehow |
486 | 17270410 | 100 | 0.000305 | org.networkadvertising |
487 | 17267670 | 696 | 0.000041 | com.webmd |
488 | 17267420 | 1422 | 0.000022 | edu.purdue |
489 | 17267352 | 335 | 0.000072 | com.stripe |
490 | 17266616 | 2427 | 0.000015 | com.techradar |
491 | 17266546 | 1052 | 0.000030 | org.sciencemag |
492 | 17264826 | 1127 | 0.000028 | org.altervista |
493 | 17264782 | 1151 | 0.000028 | io.material |
494 | 17263612 | 1482 | 0.000021 | com.fifa |
495 | 17262826 | 2161 | 0.000018 | com.crunchbase |
496 | 17262428 | 1451 | 0.000021 | com.technologyreview |
497 | 17261712 | 822 | 0.000037 | gov.senate |
498 | 17260998 | 993 | 0.000032 | ly.ow |
499 | 17260098 | 1169 | 0.000027 | com.playstation |
500 | 17259954 | 1237 | 0.000026 | com.target |
501 | 17258268 | 916 | 0.000035 | com.clicky |
502 | 17257832 | 1538 | 0.000020 | uk.co.wired |
503 | 17256742 | 391 | 0.000062 | com.force |
504 | 17256046 | 926 | 0.000034 | com.java |
505 | 17255234 | 1537 | 0.000020 | com.gettyimages |
506 | 17254874 | 1809 | 0.000019 | us.countrystudies |
507 | 17254832 | 1965 | 0.000018 | com.semrush |
508 | 17251558 | 1185 | 0.000027 | org.gnupg |
509 | 17250598 | 1122 | 0.000028 | com.politico |
510 | 17250452 | 1662 | 0.000019 | com.womentechmakers |
511 | 17250130 | 902 | 0.000035 | gov.uspto |
512 | 17247996 | 851 | 0.000036 | org.whatbrowser |
513 | 17247558 | 2155 | 0.000018 | com.vanityfair |
514 | 17245144 | 142 | 0.000180 | ru.mail |
515 | 17243458 | 435 | 0.000056 | com.snapchat |
516 | 17242522 | 1129 | 0.000028 | com.istockphoto |
517 | 17242096 | 217 | 0.000110 | com.bitly |
518 | 17241974 | 384 | 0.000064 | com.adweek |
519 | 17241808 | 1698 | 0.000019 | com.ikea |
520 | 17241278 | 268 | 0.000087 | com.wufoo |
521 | 17238236 | 162 | 0.000144 | com.eepurl |
522 | 17233098 | 1109 | 0.000029 | org.archlinux |
523 | 17232910 | 1334 | 0.000024 | fr.lemonde |
524 | 17231910 | 1331 | 0.000024 | com.econsultancy |
525 | 17231408 | 1138 | 0.000028 | com.udemy |
526 | 17231268 | 108 | 0.000268 | jp.co.google |
527 | 17230832 | 1389 | 0.000022 | com.today |
528 | 17228032 | 1717 | 0.000019 | com.yellowbot |
529 | 17227482 | 1227 | 0.000026 | com.intuit |
530 | 17227376 | 973 | 0.000033 | org.iso |
531 | 17226796 | 1567 | 0.000020 | com.aliexpress |
532 | 17226258 | 1468 | 0.000021 | au.com.smh |
533 | 17225468 | 1197 | 0.000026 | co.vine |
534 | 17225278 | 958 | 0.000033 | com.hootsuite |
535 | 17224354 | 1432 | 0.000022 | com.underconsideration |
536 | 17223030 | 1633 | 0.000020 | uk.ac.hud |
537 | 17222818 | 1429 | 0.000022 | com.com |
538 | 17221248 | 874 | 0.000036 | com.nielsen |
539 | 17219942 | 1755 | 0.000019 | com.communitywalk |
540 | 17219670 | 2806 | 0.000013 | com.123rf |
541 | 17217362 | 170 | 0.000141 | com.xing |
542 | 17216198 | 941 | 0.000034 | com.livestream |
543 | 17215352 | 950 | 0.000033 | com.timeanddate |
544 | 17214566 | 892 | 0.000035 | de.blogspot |
545 | 17214498 | 687 | 0.000042 | com.proofpoint |
546 | 17214342 | 316 | 0.000076 | org.joomla |
547 | 17214010 | 1303 | 0.000024 | org.pnas |
548 | 17213976 | 949 | 0.000033 | com.americanexpress |
549 | 17213226 | 1140 | 0.000028 | org.fao |
550 | 17211764 | 246 | 0.000096 | com.wpengine |
551 | 17211060 | 1011 | 0.000031 | uk.ac.cam |
552 | 17210928 | 1344 | 0.000023 | com.snap |
553 | 17210646 | 1270 | 0.000025 | us.ma.state |
554 | 17210158 | 430 | 0.000056 | com.barnesandnoble |
555 | 17210110 | 427 | 0.000057 | com.squareup |
556 | 17209608 | 772 | 0.000039 | gov.justice |
557 | 17207476 | 1341 | 0.000023 | com.billboard |
558 | 17207004 | 1020 | 0.000031 | com.alibaba |
559 | 17205496 | 1198 | 0.000026 | net.noscript |
560 | 17204520 | 1397 | 0.000022 | org.letsencrypt |
561 | 17203670 | 2386 | 0.000016 | ca.uwaterloo |
562 | 17203164 | 1711 | 0.000019 | com.espn |
563 | 17201262 | 1033 | 0.000031 | io.fabric |
564 | 17199364 | 2322 | 0.000016 | ca.ubc |
565 | 17198912 | 980 | 0.000032 | com.variety |
566 | 17195066 | 1143 | 0.000028 | com.bostonglobe |
567 | 17194856 | 1416 | 0.000022 | com.homestars |
568 | 17194608 | 2401 | 0.000015 | com.tutsplus |
569 | 17194034 | 2192 | 0.000018 | edu.msu |
570 | 17193846 | 1706 | 0.000019 | com.bitballoon |
571 | 17192748 | 668 | 0.000043 | com.feedly |
572 | 17192454 | 1292 | 0.000024 | in.blogspot |
573 | 17191504 | 1086 | 0.000029 | fr.blogspot |
574 | 17191464 | 2272 | 0.000017 | com.fiverr |
575 | 17189994 | 2226 | 0.000017 | edu.indiana |
576 | 17189122 | 1479 | 0.000021 | uk.co.thesun |
577 | 17187842 | 884 | 0.000036 | gov.nps |
578 | 17187810 | 1671 | 0.000019 | com.mcafee |
579 | 17186678 | 820 | 0.000037 | com.gofundme |
580 | 17186358 | 2859 | 0.000012 | com.twitpic |
581 | 17183206 | 1148 | 0.000028 | com.dell |
582 | 17182996 | 2892 | 0.000012 | com.codecademy |
583 | 17182726 | 1426 | 0.000022 | com.city-data |
584 | 17182686 | 1460 | 0.000021 | io.bitbucket |
585 | 17181510 | 708 | 0.000041 | com.photoshelter |
586 | 17181394 | 3334 | 0.000010 | com.dreamstime |
587 | 17181320 | 2493 | 0.000015 | com.newscientist |
588 | 17180454 | 1363 | 0.000023 | com.nytco |
589 | 17179308 | 463 | 0.000052 | us.icio |
590 | 17178552 | 1202 | 0.000026 | com.yandex |
591 | 17178234 | 206 | 0.000116 | com.histats |
592 | 17176076 | 2342 | 0.000016 | uk.ac.ed |
593 | 17175502 | 1040 | 0.000031 | gov.fbi |
594 | 17174634 | 846 | 0.000037 | com.500px |
595 | 17174572 | 431 | 0.000056 | cn.com.sina |
596 | 17173950 | 630 | 0.000045 | com.mobirise |
597 | 17173428 | 1217 | 0.000026 | org.jenkins-ci |
598 | 17172852 | 2448 | 0.000015 | ca.ualberta |
599 | 17170928 | 1618 | 0.000020 | com.googlelabs |
600 | 17170156 | 2164 | 0.000018 | com.socialmediaexaminer |
601 | 17170034 | 1059 | 0.000030 | com.wayfair |
602 | 17169444 | 1238 | 0.000026 | uk.co.mirror |
603 | 17169408 | 1300 | 0.000024 | us.oh.state |
604 | 17169406 | 806 | 0.000038 | com.buffer |
605 | 17169298 | 155 | 0.000152 | it.google |
606 | 17168866 | 529 | 0.000047 | com.format |
607 | 17168200 | 1346 | 0.000023 | org.threejs |
608 | 17167624 | 774 | 0.000039 | com.uk |
609 | 17167450 | 1448 | 0.000022 | org.spie |
610 | 17165660 | 1294 | 0.000024 | kr.flic |
611 | 17165516 | 1132 | 0.000028 | edu.umn |
612 | 17165214 | 1304 | 0.000024 | com.iconarchive |
613 | 17163904 | 233 | 0.000103 | com.myshopify |
614 | 17162886 | 434 | 0.000056 | com.nasdaq |
615 | 17162052 | 709 | 0.000041 | com.uservoice |
616 | 17161576 | 2353 | 0.000016 | com.screencast |
617 | 17161352 | 905 | 0.000035 | br.com.uol |
618 | 17160850 | 298 | 0.000080 | nl.google |
619 | 17160062 | 1219 | 0.000026 | com.scientificamerican |
620 | 17159442 | 2800 | 0.000013 | ly.visual |
621 | 17158882 | 964 | 0.000033 | com.prweb |
622 | 17158856 | 1178 | 0.000027 | com.smashingmagazine |
623 | 17158618 | 1366 | 0.000023 | com.nymag |
624 | 17157146 | 381 | 0.000064 | com.dmca |
625 | 17156996 | 1324 | 0.000024 | com.hollywoodreporter |
626 | 17155372 | 1273 | 0.000025 | com.warnerbros |
627 | 17155154 | 862 | 0.000036 | net.openid |
628 | 17154578 | 765 | 0.000039 | gov.copyright |
629 | 17153906 | 1249 | 0.000025 | com.prezi |
630 | 17152002 | 2439 | 0.000015 | com.aljazeera |
631 | 17151074 | 149 | 0.000170 | gov.privacyshield |
632 | 17150824 | 1042 | 0.000031 | com.airbnb |
633 | 17150340 | 924 | 0.000034 | ca.cbc |
634 | 17149820 | 1253 | 0.000025 | com.gigaom |
635 | 17148414 | 1101 | 0.000029 | com.searchengineland |
636 | 17148086 | 1320 | 0.000024 | net.recode |
637 | 17147394 | 2214 | 0.000017 | com.searchenginejournal |
638 | 17145414 | 1165 | 0.000027 | com.reverbnation |
639 | 17144640 | 1058 | 0.000030 | com.redhat |
640 | 17143504 | 273 | 0.000085 | com.fc2 |
641 | 17142386 | 3438 | 0.000010 | com.hubpages |
642 | 17142298 | 1378 | 0.000023 | com.freepik |
643 | 17141892 | 1333 | 0.000024 | com.nyt |
644 | 17141868 | 699 | 0.000041 | com.patreon |
645 | 17141858 | 646 | 0.000044 | gov.hhs |
646 | 17141712 | 1357 | 0.000023 | com.kissmetrics |
647 | 17141112 | 1485 | 0.000021 | com.rollingstone |
648 | 17140398 | 1039 | 0.000031 | org.apa |
649 | 17139398 | 223 | 0.000108 | fr.google |
650 | 17138016 | 1191 | 0.000027 | com.crashlytics |
651 | 17137096 | 4071 | 0.000008 | com.answers |
652 | 17137056 | 1450 | 0.000022 | com.autodesk |
653 | 17136872 | 1348 | 0.000023 | com.theglobeandmail |
654 | 17136816 | 1210 | 0.000026 | com.indeed |
655 | 17136588 | 257 | 0.000091 | com.getbootstrap |
656 | 17135766 | 3377 | 0.000010 | com.domaintools |
657 | 17134556 | 1533 | 0.000020 | edu.dukeupress |
658 | 17134490 | 2474 | 0.000015 | edu.bu |
659 | 17133898 | 1297 | 0.000024 | org.scala-lang |
660 | 17133524 | 706 | 0.000041 | com.alexa |
661 | 17133178 | 1047 | 0.000030 | com.sciencedaily |
662 | 17131500 | 1323 | 0.000024 | com.vox |
663 | 17131458 | 1080 | 0.000029 | gov.usgs |
664 | 17130422 | 107 | 0.000269 | com.googleadservices |
665 | 17130056 | 1419 | 0.000022 | com.elpais |
666 | 17129938 | 1777 | 0.000019 | edu.alamo |
667 | 17129706 | 474 | 0.000052 | br.com.google |
668 | 17128186 | 2346 | 0.000016 | edu.asu |
669 | 17128168 | 390 | 0.000062 | com.newrelic |
670 | 17127826 | 1505 | 0.000021 | com.nba |
671 | 17127350 | 788 | 0.000038 | gov.state |
672 | 17127102 | 2778 | 0.000013 | com.macrumors |
673 | 17126992 | 2393 | 0.000016 | edu.ncsu |
674 | 17126312 | 1385 | 0.000023 | edu.jhu |
675 | 17125306 | 2759 | 0.000013 | com.starwars |
676 | 17124492 | 1225 | 0.000026 | us.imageshack |
677 | 17124350 | 320 | 0.000075 | com.netdna-ssl |
678 | 17123996 | 1675 | 0.000019 | org.virginiadot |
679 | 17122508 | 2334 | 0.000016 | ch.ethz |
680 | 17122024 | 2301 | 0.000016 | com.msnbc |
681 | 17121934 | 1571 | 0.000020 | com.nokia |
682 | 17121692 | 705 | 0.000041 | com.mckinsey |
683 | 17121268 | 1182 | 0.000027 | org.gentoo |
684 | 17120294 | 429 | 0.000057 | gov.irs |
685 | 17119582 | 2046 | 0.000018 | com.css-tricks |
686 | 17119430 | 417 | 0.000059 | com.bigcartel |
687 | 17118212 | 1354 | 0.000023 | com.thehill |
688 | 17117616 | 1799 | 0.000019 | edu.virginia |
689 | 17117124 | 53 | 0.000634 | com.messenger |
690 | 17116930 | 1753 | 0.000019 | com.fixr |
691 | 17116722 | 992 | 0.000032 | io.codepen |
692 | 17115848 | 2203 | 0.000018 | com.zazzle |
693 | 17115538 | 1399 | 0.000022 | com.gallup |
694 | 17115352 | 907 | 0.000035 | com.adage |
695 | 17115320 | 502 | 0.000049 | fr.amazon |
696 | 17114884 | 194 | 0.000121 | com.youku |
697 | 17114790 | 3323 | 0.000010 | com.rottentomatoes |
698 | 17114464 | 1269 | 0.000025 | com.businessweek |
699 | 17114350 | 1268 | 0.000025 | com.uber |
700 | 17112978 | 1307 | 0.000024 | com.nydailynews |
701 | 17112294 | 325 | 0.000073 | com.bizjournals |
702 | 17112210 | 1849 | 0.000018 | com.smartguy |
703 | 17111208 | 1553 | 0.000020 | com.hotfrog |
704 | 17110654 | 2888 | 0.000012 | edu.brown |
705 | 17110092 | 1530 | 0.000021 | uk.co.lrb |
706 | 17109686 | 1527 | 0.000021 | edu.umd |
707 | 17108562 | 2418 | 0.000015 | tv.periscope |
708 | 17107332 | 1206 | 0.000026 | int.coe |
709 | 17106560 | 982 | 0.000032 | org.oecd |
710 | 17106474 | 1004 | 0.000032 | org.change |
711 | 17104716 | 1493 | 0.000021 | com.searchenginewatch |
712 | 17104622 | 1390 | 0.000022 | it.binged |
713 | 17104560 | 1496 | 0.000021 | io.prototypr |
714 | 17104464 | 541 | 0.000047 | gov.sec |
715 | 17103876 | 139 | 0.000185 | de.bund |
716 | 17103676 | 2165 | 0.000018 | com.posterous |
717 | 17103630 | 672 | 0.000043 | com.emarketer |
718 | 17103156 | 2500 | 0.000015 | au.com.news |
719 | 17103002 | 1853 | 0.000018 | edu.ucdavis |
720 | 17102406 | 2329 | 0.000016 | com.blogs |
721 | 17101526 | 2312 | 0.000016 | com.nfl |
722 | 17101098 | 2478 | 0.000015 | com.cbs |
723 | 17100940 | 1822 | 0.000019 | com.hulu |
724 | 17099830 | 1328 | 0.000024 | com.pwc |
725 | 17099418 | 1358 | 0.000023 | ly.plot |
726 | 17098734 | 1180 | 0.000027 | com.firebaseapp |
727 | 17098528 | 326 | 0.000073 | me.fb |
728 | 17098266 | 1236 | 0.000026 | org.cambridge |
729 | 17097620 | 1359 | 0.000023 | fm.last |
730 | 17097536 | 1256 | 0.000025 | uk.co.theregister |
731 | 17097340 | 1430 | 0.000022 | com.kudzu |
732 | 17097214 | 2298 | 0.000016 | org.aclu |
733 | 17097148 | 1541 | 0.000020 | org.ushistory |
734 | 17096970 | 286 | 0.000082 | com.naver |
735 | 17095930 | 890 | 0.000035 | gov.sba |
736 | 17095924 | 2609 | 0.000014 | com.wikidot |
737 | 17095660 | 465 | 0.000052 | gov.epa |
738 | 17095576 | 1708 | 0.000019 | com.akamai |
739 | 17094822 | 1572 | 0.000020 | org.jstor |
740 | 17094514 | 255 | 0.000092 | com.marriott |
741 | 17094372 | 1149 | 0.000028 | org.redcross |
742 | 17093170 | 350 | 0.000068 | net.themeforest |
743 | 17091942 | 2491 | 0.000015 | com.lonelyplanet |
744 | 17091664 | 2441 | 0.000015 | mp.j |
745 | 17089358 | 1518 | 0.000021 | au.com.truelocal |
746 | 17089222 | 2333 | 0.000016 | com.discovery |
747 | 17089064 | 1488 | 0.000021 | com.domain |
748 | 17088086 | 1006 | 0.000031 | com.cbslocal |
749 | 17087402 | 2773 | 0.000013 | org.phys |
750 | 17085534 | 1295 | 0.000024 | gov.nyc |
751 | 17085312 | 1134 | 0.000028 | io.bower |
752 | 17085254 | 2227 | 0.000017 | org.rubyonrails |
753 | 17085212 | 677 | 0.000043 | uk.co.tripadvisor |
754 | 17083968 | 2286 | 0.000017 | com.urbandictionary |
755 | 17083722 | 3081 | 0.000011 | com.fivethirtyeight |
756 | 17083390 | 1463 | 0.000021 | com.insiderpages |
757 | 17082484 | 1694 | 0.000019 | org.twinery |
758 | 17081344 | 190 | 0.000124 | jp.ne.hatena |
759 | 17080300 | 1795 | 0.000019 | org.milaap |
760 | 17079140 | 1678 | 0.000019 | es.iac |
761 | 17078816 | 1168 | 0.000027 | com.accenture |
762 | 17077842 | 1690 | 0.000019 | com.2findlocal |
763 | 17077284 | 872 | 0.000036 | com.att |
764 | 17077178 | 2240 | 0.000017 | de.zeit |
765 | 17077136 | 653 | 0.000044 | gov.ny |
766 | 17075592 | 914 | 0.000035 | com.chicagotribune |
767 | 17075424 | 1745 | 0.000019 | com.planetware |
768 | 17075300 | 237 | 0.000100 | jp.co.amazon |
769 | 17075058 | 2274 | 0.000017 | edu.umass |
770 | 17074694 | 1070 | 0.000029 | com.investopedia |
771 | 17074424 | 1656 | 0.000020 | com.wsoctv |
772 | 17074178 | 1902 | 0.000018 | org.postimg |
773 | 17073772 | 2157 | 0.000018 | uk.ac.ucl |
774 | 17072414 | 1857 | 0.000018 | com.linkcentre |
775 | 17072314 | 1585 | 0.000020 | edu.vassar |
776 | 17071320 | 2332 | 0.000016 | com.ibtimes |
777 | 17071232 | 1908 | 0.000018 | com.chron |
778 | 17071194 | 2151 | 0.000018 | edu.cuny |
779 | 17070736 | 1043 | 0.000030 | gov.va |
780 | 17070650 | 1568 | 0.000020 | com.zillow |
781 | 17070606 | 3084 | 0.000011 | com.lynda |
782 | 17070176 | 1667 | 0.000019 | com.phnompenhpost |
783 | 17069034 | 1002 | 0.000032 | com.formstack |
784 | 17068194 | 1345 | 0.000023 | re.cli |
785 | 17067768 | 831 | 0.000037 | com.sagepub |
786 | 17067044 | 2842 | 0.000013 | com.animoto |
787 | 17066988 | 1461 | 0.000021 | ca.kijiji |
788 | 17066682 | 1264 | 0.000025 | com.xkcd |
789 | 17066212 | 1564 | 0.000020 | com.warriorplus |
790 | 17066032 | 1120 | 0.000028 | com.business2community |
791 | 17065974 | 1473 | 0.000021 | org.sigcomm |
792 | 17065804 | 673 | 0.000043 | org.openstreetmap |
793 | 17064674 | 1654 | 0.000020 | com.tiki-toki |
794 | 17063856 | 1554 | 0.000020 | jp.ac.kobe-u |
795 | 17063490 | 2674 | 0.000013 | com.kaspersky |
796 | 17062710 | 1750 | 0.000019 | com.trendland |
797 | 17062642 | 478 | 0.000051 | com.atlassian |
798 | 17061988 | 983 | 0.000032 | com.zoho |
799 | 17061278 | 1663 | 0.000019 | fr.estrepublicain |
800 | 17059814 | 451 | 0.000053 | gov.usda |
801 | 17058166 | 2986 | 0.000012 | com.9to5mac |
802 | 17057630 | 1477 | 0.000021 | com.theoutline |
803 | 17057298 | 811 | 0.000038 | gov.usa |
804 | 17055890 | 3123 | 0.000011 | uk.bl |
805 | 17055592 | 1372 | 0.000023 | com.strikingly |
806 | 17055276 | 1756 | 0.000019 | edu.ufl |
807 | 17054970 | 256 | 0.000091 | com.elegantthemes |
808 | 17054808 | 2321 | 0.000016 | com.apnews |
809 | 17054684 | 454 | 0.000053 | com.pinimg |
810 | 17054674 | 1555 | 0.000020 | org.gwtproject |
811 | 17054664 | 93 | 0.000317 | com.namecheap |
812 | 17054558 | 530 | 0.000047 | com.gotowebinar |
813 | 17054260 | 2345 | 0.000016 | org.gimp |
814 | 17054258 | 647 | 0.000044 | gov.ed |
815 | 17054118 | 176 | 0.000136 | org.icann |
816 | 17053764 | 1676 | 0.000019 | ws.snack |
817 | 17053588 | 1519 | 0.000021 | com.hotmail |
818 | 17053486 | 2514 | 0.000015 | com.ifttt |
819 | 17053234 | 1489 | 0.000021 | net.hockeyapp |
820 | 17051790 | 3465 | 0.000010 | com.virustotal |
821 | 17051586 | 369 | 0.000066 | org.opensource |
822 | 17051534 | 1513 | 0.000021 | com.acninc |
823 | 17050572 | 2950 | 0.000012 | org.moma |
824 | 17050542 | 684 | 0.000042 | ca.amazon |
825 | 17049542 | 1380 | 0.000023 | com.stitcher |
826 | 17048914 | 994 | 0.000032 | org.plos |
827 | 17048462 | 2791 | 0.000013 | edu.unl |
828 | 17048406 | 1310 | 0.000024 | com.over-blog |
829 | 17048000 | 1746 | 0.000019 | com.mercurynews |
830 | 17047454 | 2762 | 0.000013 | com.topsy |
831 | 17046932 | 1790 | 0.000019 | com.khamsat |
832 | 17046596 | 4389 | 0.000007 | com.lmgtfy |
833 | 17046156 | 2853 | 0.000012 | com.sophos |
834 | 17045274 | 1720 | 0.000019 | com.ignimgs |
835 | 17044996 | 1392 | 0.000022 | us.zoom |
836 | 17044350 | 274 | 0.000085 | com.maxcdn |
837 | 17043462 | 2676 | 0.000013 | edu.gmu |
838 | 17043266 | 1008 | 0.000031 | com.oup |
839 | 17043250 | 947 | 0.000033 | com.accuweather |
840 | 17042470 | 1855 | 0.000018 | net.wrightflyer |
841 | 17042238 | 2487 | 0.000015 | edu.utah |
842 | 17042178 | 1128 | 0.000028 | com.mixcloud |
843 | 17041944 | 1099 | 0.000029 | org.doxygen |
844 | 17041938 | 2467 | 0.000015 | com.producthunt |
845 | 17041168 | 2315 | 0.000016 | com.thestar |
846 | 17040806 | 2230 | 0.000017 | edu.arizona |
847 | 17040254 | 1491 | 0.000021 | com.sky |
848 | 17039272 | 2473 | 0.000015 | org.openoffice |
849 | 17038806 | 691 | 0.000042 | com.163 |
850 | 17037800 | 1702 | 0.000019 | com.howstuffworks |
851 | 17036946 | 1551 | 0.000020 | com.company |
852 | 17036894 | 2201 | 0.000018 | com.pastebin |
853 | 17036498 | 2269 | 0.000017 | ru.narod |
854 | 17036430 | 1398 | 0.000022 | io.pantheon |
855 | 17036358 | 1635 | 0.000020 | com.discordapp |
856 | 17035370 | 3275 | 0.000010 | org.greenpeace |
857 | 17034618 | 2231 | 0.000017 | com.deadline |
858 | 17034446 | 1472 | 0.000021 | com.local |
859 | 17034088 | 2873 | 0.000012 | com.campaignmonitor |
860 | 17033592 | 193 | 0.000121 | jp.ameblo |
861 | 17032336 | 2889 | 0.000012 | org.bitcoin |
862 | 17031994 | 1351 | 0.000023 | com.socialmediatoday |
863 | 17031174 | 1589 | 0.000020 | it.blogspot |
864 | 17030976 | 1293 | 0.000024 | edu.si |
865 | 17030968 | 7175 | 0.000005 | org.audacityteam |
866 | 17030720 | 841 | 0.000037 | com.yp |
867 | 17030368 | 2242 | 0.000017 | com.livestrong |
868 | 17030334 | 2450 | 0.000015 | com.bestbuy |
869 | 17029458 | 1313 | 0.000024 | com.globo |
870 | 17029366 | 166 | 0.000142 | me.line |
871 | 17028546 | 1852 | 0.000018 | tv.royanews |
872 | 17027902 | 2535 | 0.000014 | com.mentalfloss |
873 | 17027090 | 1298 | 0.000024 | com.gumroad |
874 | 17026950 | 1863 | 0.000018 | com.boston |
875 | 17026888 | 2617 | 0.000014 | com.getresponse |
876 | 17024844 | 1435 | 0.000022 | com.cafepress |
877 | 17024728 | 1208 | 0.000026 | com.forrester |
878 | 17022092 | 703 | 0.000041 | com.usnews |
879 | 17021648 | 999 | 0.000032 | com.walmart |
880 | 17020694 | 1449 | 0.000022 | org.wiktionary |
881 | 17020672 | 437 | 0.000056 | com.criteo |
882 | 17020270 | 1631 | 0.000020 | au.com.whitepages |
883 | 17016310 | 1444 | 0.000022 | ca.calgaryseocompany |
884 | 17016272 | 421 | 0.000058 | com.adroll |
885 | 17015756 | 1019 | 0.000031 | de.heise |
886 | 17014878 | 1441 | 0.000022 | com.technorati |
887 | 17014632 | 1808 | 0.000019 | de.welt |
888 | 17014592 | 1565 | 0.000020 | com.bizcommunity |
889 | 17014084 | 1401 | 0.000022 | mil.army |
890 | 17012948 | 2825 | 0.000013 | com.fox |
891 | 17012222 | 1729 | 0.000019 | com.contentmarketinginstitute |
892 | 17011716 | 2561 | 0.000014 | com.yolasite |
893 | 17011618 | 512 | 0.000048 | com.udacity |
894 | 17011062 | 2170 | 0.000018 | com.podbean |
895 | 17011022 | 1481 | 0.000021 | de.bundesverfassungsgericht |
896 | 17010836 | 221 | 0.000109 | me.t |
897 | 17010598 | 112 | 0.000255 | info.aboutads |
898 | 17010538 | 3071 | 0.000011 | com.googlepages |
899 | 17009902 | 1738 | 0.000019 | com.pushwoosh |
900 | 17009370 | 701 | 0.000041 | com.gitlab |
901 | 17009104 | 1233 | 0.000026 | org.sonatype |
902 | 17008736 | 3493 | 0.000010 | org.notepad-plus-plus |
903 | 17008340 | 3301 | 0.000010 | edu.uic |
904 | 17008246 | 1668 | 0.000019 | com.waze |
905 | 17007154 | 808 | 0.000038 | es.com.blogspot |
906 | 17007064 | 1458 | 0.000021 | com.tiddlywiki |
907 | 17006900 | 1100 | 0.000029 | com.digiday |
908 | 17006648 | 1658 | 0.000020 | com.lulu |
909 | 17006086 | 807 | 0.000038 | uk.co.eventbrite |
910 | 17005352 | 2910 | 0.000012 | com.ndtv |
911 | 17005126 | 1683 | 0.000019 | com.ssllabs |
912 | 17004666 | 1583 | 0.000020 | com.sproutsocial |
913 | 17004224 | 1830 | 0.000019 | me.pxlme |
914 | 17004142 | 1528 | 0.000021 | com.neilpatel |
915 | 17003742 | 1407 | 0.000022 | int.wipo |
916 | 17003612 | 1502 | 0.000021 | org.filezilla-project |
917 | 17002472 | 452 | 0.000053 | com.custhelp |
918 | 17001786 | 2238 | 0.000017 | org.raspberrypi |
919 | 17000878 | 1685 | 0.000019 | com.quandl |
920 | 17000606 | 2883 | 0.000012 | edu.tufts |
921 | 17000112 | 2366 | 0.000016 | com.salon |
922 | 16999154 | 3279 | 0.000010 | org.metmuseum |
923 | 16998660 | 3480 | 0.000010 | com.spreaker |
924 | 16998546 | 2543 | 0.000014 | com.fineartamerica |
925 | 16996432 | 1652 | 0.000020 | net.brownbook |
926 | 16996258 | 1289 | 0.000024 | com.bmj |
927 | 16994812 | 2542 | 0.000014 | uk.co.express |
928 | 16994548 | 3268 | 0.000010 | in.lnkd |
929 | 16993498 | 1189 | 0.000027 | com.techtarget |
930 | 16991836 | 3027 | 0.000012 | edu.hawaii |
931 | 16991760 | 1254 | 0.000025 | org.pewresearch |
932 | 16991692 | 2876 | 0.000012 | com.fitbit |
933 | 16991658 | 3392 | 0.000010 | org.edx |
934 | 16991126 | 2154 | 0.000018 | uk.co.huffingtonpost |
935 | 16990656 | 1030 | 0.000031 | com.fotolia |
936 | 16990256 | 1311 | 0.000024 | com.optimizely |
937 | 16990212 | 727 | 0.000040 | com.geocities |
938 | 16989440 | 1410 | 0.000022 | com.mariadb |
939 | 16989388 | 1068 | 0.000030 | com.infusionsoft |
940 | 16988498 | 3210 | 0.000011 | com.popsci |
941 | 16987912 | 827 | 0.000037 | gov.house |
942 | 16987790 | 3467 | 0.000010 | cc.tiny |
943 | 16986628 | 1766 | 0.000019 | com.spoke |
944 | 16986466 | 2666 | 0.000014 | nl.uva |
945 | 16985926 | 1727 | 0.000019 | org.unfe |
946 | 16985880 | 1028 | 0.000031 | es.amazon |
947 | 16985718 | 1647 | 0.000020 | uk.gov.westsussex |
948 | 16985558 | 1681 | 0.000019 | com.chamberofcommerce |
949 | 16985386 | 3584 | 0.000009 | gd.is |
950 | 16985282 | 1308 | 0.000024 | net.java |
951 | 16985238 | 654 | 0.000044 | com.houzz |
952 | 16985156 | 1090 | 0.000029 | gov.archives |
953 | 16984162 | 3313 | 0.000010 | com.avast |
954 | 16983948 | 2216 | 0.000017 | com.examiner |
955 | 16983802 | 1645 | 0.000020 | com.thefabricator |
956 | 16983790 | 505 | 0.000049 | com.redbubble |
957 | 16983296 | 1824 | 0.000019 | com.computerworld |
958 | 16982204 | 3454 | 0.000010 | com.klout |
959 | 16981086 | 934 | 0.000034 | com.delicious |
960 | 16978942 | 3329 | 0.000010 | org.kiva |
961 | 16978376 | 453 | 0.000053 | com.teamviewer |
962 | 16978280 | 2048 | 0.000018 | com.cio |
963 | 16977838 | 2171 | 0.000018 | com.thedailybeast |
964 | 16977598 | 411 | 0.000059 | mp.mailchi |
965 | 16977372 | 2435 | 0.000015 | br.com.blogspot |
966 | 16976616 | 1166 | 0.000027 | com.netdna-cdn |
967 | 16976496 | 889 | 0.000036 | com.arcgis |
968 | 16976058 | 2844 | 0.000013 | com.createspace |
969 | 16976028 | 4182 | 0.000008 | net.deviantart |
970 | 16975580 | 1761 | 0.000019 | com.yelloyello |
971 | 16975516 | 1576 | 0.000020 | gov.cabq |
972 | 16975490 | 480 | 0.000051 | com.iconfinder |
973 | 16975074 | 1431 | 0.000022 | au.com.yellowpages |
974 | 16973724 | 1257 | 0.000025 | io.getmdl |
975 | 16972780 | 1228 | 0.000026 | com.thedrum |
976 | 16972204 | 1696 | 0.000019 | com.us |
977 | 16971756 | 2422 | 0.000015 | org.linuxfoundation |
978 | 16969112 | 5378 | 0.000006 | com.depositphotos |
979 | 16969008 | 2328 | 0.000016 | com.ign |
980 | 16967900 | 1563 | 0.000020 | org.gmplib |
981 | 16967888 | 2832 | 0.000013 | edu.caltech |
982 | 16967252 | 2895 | 0.000012 | com.infoq |
983 | 16966764 | 2202 | 0.000018 | edu.uci |
984 | 16966186 | 1332 | 0.000024 | com.xbox |
985 | 16966066 | 1425 | 0.000022 | com.techrepublic |
986 | 16966028 | 1262 | 0.000025 | com.glassdoor |
987 | 16965506 | 1599 | 0.000020 | com.apachelounge |
988 | 16965454 | 895 | 0.000035 | org.unicef |
989 | 16965116 | 2990 | 0.000012 | com.discogs |
990 | 16964500 | 2913 | 0.000012 | es.abc |
991 | 16963166 | 743 | 0.000039 | com.biomedcentral |
992 | 16962674 | 2863 | 0.000012 | nl.xs4all |
993 | 16962502 | 1423 | 0.000022 | org.heart |
994 | 16961832 | 2610 | 0.000014 | org.olympic |
995 | 16960736 | 252 | 0.000093 | com.ssl-images-amazon |
996 | 16959972 | 2680 | 0.000013 | de.bild |
997 | 16959790 | 2672 | 0.000013 | com.nbc |
998 | 16959298 | 1691 | 0.000019 | com.realtytimes |
999 | 16959228 | 1456 | 0.000021 | com.mediafire |
1000 | 16959080 | 1569 | 0.000020 | com.galvanize |
Credits
Thanks to the authors of the WebGraph framework, whose software made the computation of graph properties and ranks possible.
We hope the data will be useful for you to do any kind of research on ranking, graph analysis, link spam detection, etc. Let us know about your results via Common Crawl’s Google Group!