It is a truth universally acknowledged, that a person in possession of a fast internet connection must be in want of some porn.While it's difficult domain to penetrate â€” hard numbers are few and far between â€” we know for a fact that porn sites are some of the most trafficked parts of the internet. According to Google's DoubleClick Ad Planner, which tracks users across the web with a cookie, dozens of adult destinations populate the top 500 websites.

Xvideos, the largest porn site on the web with 4.4 billion page views per month, is three times the size of CNN or ESPN, and twice the size of Reddit. LiveJasmin isn't much smaller. YouPorn, Tube8, and Pornhub â€” they're all vast, vast sites that dwarf almost everything except the Googles and Facebooks of the internet.

While page views are a fine starting point, they only tell you that X porn site is more popular than Y non-porn site. Four billion page views sure sounds like a lot, but it's only when you factor in what those porn surfers are actually doing that the size and scale of adult websites truly comes into focus.

We'll start by laying the ground work, and then on the second page we have some real world figures from YouPorn, the second largest porn site on the web. If you like, take a moment to try and estimate the amount of traffic that YouPorn handles every second. Let us know in the comments if your guess is anywhere near.Scale

The main difference between porn and non-porn sites is the average duration of a visit: For a news site like Engadget or ExtremeTech, an average visit is usually between three and six minutes; enough time to read one or two stories. The average time spent on a porn site, however, is between 15 and 20 minutes.

Then you need to factor in that most websites are predominantly text and images, while the largest porn sites push streaming video. When you load the ExtremeTech home page, you're talking about a couple of megabytes, and then maybe 500 kilobytes if you load an article. When you stream porn, assuming a low resolution of 480200, you're looking at around 100 kilobytes per second â€” which, over 15 minutes, is around 90 megabytes.

Then you need to multiply 90 megabytes by the number of monthly visits â€” which is around 350 million for Xvideos. This comes to around 29 petabytes of data transferred every month, or 50 gigabytes per second. To put this into comparison, your home internet connection is probably capable of transferring a couple of megabytes per second, which is about 25,000 times smaller.

In short, porn sites cope with astronomical amounts of data. The only sites that really come close in term of raw bandwidth are YouTube or Hulu, but even then YouPorn is something like six times larger than Hulu.Infrastructure

Serving up videos requires a lot more resources than plain text and images, in terms of storage, CPU cycles, internal I/O, and bandwidth.While it obviously varies from site to site, most adult sites will probably store in the region of 50 to 200 terabytes of porn. This is quite a lot for a website (only something like Google, Facebook, Blogger, or YouTube would store more data), but in a world where 2TB drives are cheap and plentiful, this isn't ultimately a very large amount. Last year we wrote about a Backblaze storage pod that can store 135TB in a 4U case, for just $7,400.

CPU cycles and I/O will be a function of the bitrate of the streaming video and the number of page views. First the porn site has to serve up a dynamic, searchable database of thousands of videos, and then, when someone clicks on a video, that file needs to be read from a hard disk and streamed over the internet. If you've ever transferred a lot of big files over a local network (i.e. stressed both your hard drive and Ethernet port) you will know how taxing this is.

Actual hardware requirements are almost impossible to derive (they're not publicized), but in the case of a large porn site we're probably talking about racks of quad-CPU servers, gigabit switches, and load balancers. Software-wise, most large porn sites will use a very-high-throughput database such as Redis to store and serve videos, and a light-weight HTTP server like Nginx to serve up the web pages.

Finally, bandwidth. Referring back to our Xvideos example (based on an Ad Planner estimate), a large porn site will have to have enough connectivity to serve up 50 gigabytes per second, or 400Gbps. Bear in mind this is an average data rate, too: At peak time, Xvideos might burst to 1,000Gbps (1Tbps) or more. To put this into perspective, there's only about 15Tbps of connectivity between London and New York.

There are only so many ways of coping with this much traffic: You set up your own data center, rent a few racks in a very large data center, or use a cloud provider like Amazon AWS or Microsoft Azure.

The second largest porn site on the web, YouPorn, was kind enough to furnish us with some real-world facts and figures. You'll be glad (or scared) to know that the estimated DoubleClick Ad Planner figures are actually quite a lot lower than reality.

YouPorn hosts "over 100TB of porn", and serves "over 100 million" page views per day. All told, this equates to an average of 950 terabytes of data transfer per day, almost all of which is streaming video. This is around 28 petabytes per month, which means our 29PB estimate for Xvideos is on the low side; it probably serves 35 to 40PB per month.

It gets better! At peak time, YouPorn serves 4000 pages per second, equating to burst traffic in the region of 100 gigabytes per second, or 800Gbps. This is equivalent to transferring more than 10 dual-layer DVDs every second.

On the software-side of things, YouPorn's primary data store is 100% Redis, with MySQL used as an admin tool to manage and add data to the Redis cluster. The site used to be primarily programmed in Perl with a MySQL backend, but in 2011 Perl was switched out for PHP and MySQL replaced with Redis. Nginx acts as the HTTP server, with both HAProxy and Varnish both used to load balance.
The Redis server deals with 300,000 queries per second, and between 8-15GB of data is logged every hour (visitor logs, behavior data, and so on). We're told that this software stack should be capable of scaling up to 200 million views per day.

Sadly, YouPorn couldn't tell us about its hardware infrastructure. Judging by the IP addresses of the YouPorn content delivery network (CDN), it's probably not hosted by a cloud provider like Amazon, but rather in a large data center somewhere, with peering provided by Level 3.

To put that 800Gbps figure into perspective, the internet only handles around half an exabyte of traffic every day, which equates to around 50Tbps â€” in other words, a single porn site accounts for almost 2% of the internet's total traffic. There are dozens of porn sites on the scale of YouPorn, and hundreds that are the size of ExtremeTech or your favorite news site. It's probably not unrealistic to say that porn makes up 30% of the total data transferred across the internet.

Click to expand...

Bloody fascinating to see how big it really is! Russian mafia supposedly owns the big ones!?

"in other words, a single porn site accounts for almost 2% of the internet's total traffic. There are dozens of porn sites on the scale of YouPorn, and hundreds that are the size of ExtremeTech or your favorite news site. It's probably not unrealistic to say that porn makes up 30% of the total data transferred across the internet.The internet really is for porn."

Epic article. Reads like a dark History Channel episode. Crazy as it sounds I once read in a newspaper article that said 70% of internet traffic is porn related not the "conservative" 30% they say in this article. He says Youporn has 2% of net traffic and "There are dozens of porn sites the size of Youporn.."

The Russian mafia owns the biggest ones ? No wonder it is so hard to compete in the adult niche

Click to expand...

I think it is mostly a conspiracy theory that they own the biggest ones,but I wouldn't be that surprised as the Russians are the only mafia trying to go "legit". From what I heard,they are big into day trading and futures instead of drugs and extortion.

I have the feeling that its alot less bandwidth used,and the math is flawed in the article. 25 videos account for 2.5% of todays views if the site gets 100 million page views. And then theres page views from just looking for videos,and those dont take up much bandwidth as its just text and pics of around 7KB each. And of those 25 videos 15 of them were under 10 minutes so the bandwidth from them isn't that high compared to a full length movie.

If you just go to youporn that counts as one page view then go to a single video that counts as another,so for just watching 1 video you have given them 2 page views. Its way more complex to find out how much bandwidth youporn uses,then just a simple multiplication.

Then rinse and repeat Google say "Don't be evil" and they own YT, so it would go against their ethics.

Click to expand...

I think ethics play little in modern business, its money that talks. I'm sure at some point Google considered the idea, its a pretty large niche to avoid without a good reason. For example, they dont have to operate under Google's brand, they can open a subsidiary with different name and use Youtube servers as a service.

I think ethics play little in modern business, its money that talks. I'm sure at some point Google considered the idea, its a pretty large niche to avoid without a good reason. For example, they dont have to operate under Google's brand, they can open a subsidiary with different name and use Youtube servers as a service.

Click to expand...

I agree totally with you, as an adult webmaster myself I would certainly pounce on it, but sometimes billionaires out there (like that douche zuckerberg) get all high and mighty about themselves and try and buy their way into heaven or something.

$70 for a TB is a rip off, I use about 3TB a month on shared hosting and it only costs me $11.And host gator never complained to me or terminated my account.

Click to expand...

Just giving you the going rate for a content delivery network, its the only way you can move that much data around... if they were moving data in your situation then it would simply bottle neck, they need their content housed all around the globe (which is pretty shit cool in all fairness).

The reasonable man adapts himself to the world; the unreasonable one persists in trying to adapt the world to himself. Therefore all progress depends on the unreasonable man.
—GEORGE BERNARD SHAW, Maxims for Revolutionists

Storing that much data on one server or in just one DC location is asking for way too much trouble. The only sane way to do it, is with a CDN, even if it is one you build yourself.

I know for a fact that one of the main sites listed in the article, is using one of the top CDN networks. Was actually quite surprised when I did a packet capture and a network trace for a client. As the terms of the CDN state that they don't do porn (at least they did at the time).

It just hit me: maybe the CDN is the one who owns the site (at arms length) . Interesting way to utilise unused capacity and still generate an income/profit.

Note that adblockers might block our captcha, and other functionality on BHW so if you don't see the captcha or see reduced functionality please disable adblockers to ensure full functionality, note we only allow relevant management verified ads on BHW.