Canonical Voiceshttp://voices.canonical.comCanonical VoicesFri, 21 Sep 2012 15:08:55 -0000Jussi Pakkanen: Relative popularity of build systemshttp://voices.canonical.com/jussi.pakkanen/2012/09/21/relative-popularity-of-build-systems/<p>The conventional wisdom in build systems is that GNU Autotools is the one true established standard and other ones are used only rarely.</p>
<p>But is this really true?</p>
<p>I created a script that downloads all original source packages from Ubuntu&#8217;s main pool. If there were multple versions of the same project, only the newest was chosen. Then I created a second script that goes through those packages and checks what build system they actually use. Here&#8217;s the breakdown:</p>
<pre>CMake: 348 9%
Autofoo: 1618 45%
SCons: 10 0%
Ant: 149 4%
Maven: 41 1%
Distutil: 313 8%
Waf: 8 0%
Perl: 341 9%
Make(ish): 351 9%
Customconf: 45 1%
Unknown: 361 10%</pre>
<p>Here <em>Make(ish)</em> means packages that don&#8217;t have any other build system, but do have a makefile. This usually indicates building via custom makefiles. Correspondingly <em>customconf</em> is for projects that don&#8217;t have any other build system, but have a <em>configure</em> file. This is usually a handwritten shell or Python file.</p>
<p>This data is skewed by the fact that the pool is just a jumble of packages. It would be interesting to run this analysis separately for precise, oneiric etc to see the progression over time. For truly interesting results you would run it against the whole of Debian.</p>
<p>The relative popularity of CMake and Autotools is roughly 20/80. This shows that Autotools is not the sole dominant player for C/C++ it once was. It&#8217;s still far and away the most popular, though.</p>
<p>The unknown set contains stuff such as Rake builds. I simply did not have time to add them all. It also has a lot of fonts, which makes sense, since you don&#8217;t really build those in the traditional sense.</p>
<p>The scripts can be downloaded <a href="https://code.launchpad.net/~jpakkane/+junk/buildcounter">here</a>. A word of warning: to run the analysis you need to download 13 GB of source. Don&#8217;t do it just for the heck of it. The parser script does not download anything, it just produces a list of urls. Download the packages with <em>wget -i</em>.</p>
<p>Some orig packages are compressed with xz, which Python&#8217;s tarfile module can&#8217;t handle. You have to repack them yourself prior to running the analysis script.</p>nospam@nospam.com (Jussi Pakkanen)Fri, 21 Sep 2012 15:08:55 -0000http://voices.canonical.com/jussi.pakkanen/2012/09/21/relative-popularity-of-build-systems/analysisbuilddevelopmentstatistics