Tag Archives: publication

Figure 1. Accumulated publication count for scientifically reported ADC implementations in mainstream IEEE sources. The number of publications equivalent to 20% of total is indicated for reference.

SURVEYS GALORE: If the ten posts long A/D-converter survey just concluded did not fully satisfy your desire for scatter plots and tech trends, then this post will provide a list of prior ADC survey works as suggested “further reading”. In fact, I’d recommend everyone serious about data-converter technology trends to get hold of these documents. The list will also serve as a brief history of the ADC survey field. But first some thoughts on surveys:

Survey characteristics

When is it a “survey”? — I’m not going to spend too much energy on a stringent definition of a “survey”. My guideline is that a survey should be based on a significant amount of data, and that the visualization, discussion and interpretation of the data is the main work. Many scientific papers nowadays include a scatter plot that compares a particular design with 5–20 relevant prior efforts. While it’s a good idea to do so, these papers are not considered surveys in this context. Others use large amounts of empirical data to validate or derive a model, but the focus is more on the model.

What is “a significant amount of data”? — The size of the survey should be related to the total amount of data available at the time of the survey. A survey of 200 papers would have been exhaustive in 1990. Today it represents less than 12% of all scientific publications. The accumulated amount of scientific papers over time is shown in Fig. 1. While this is not the absolute total number of ADC publications, it covers the ADC implementations reported in nearly all journals and conferences central to the A/D-converter field, and shall for simplicity be referred to as the “total” amount here. The number of sources equivalent to 20% of the accumulated total at any given time is also shown in Fig. 1.

So, how much of the total do I need? Well, it depends on what you’re trying to do. When it comes to survey data, I’m a firm believer in “the more the merrier”, but there are tasks which can be done with a fairly small subset. For example, if you want to get an idea of the overall trend for one parameter vs. another or just make a quick sanity check.

Small subsets do have some limitations though. For the subset to function as a reasonably generic approximation of the exhaustive set, its data must span roughly the same chunk of parameter space, and have similar distribution of values in all dimensions. This is difficult to achieve unless you make a random sampling of the exhaustive set. A smaller set also risks running out of data, for example when dividing it further according to some parameter such as resolution or architecture.

How quickly will a survey become dated? — I really don’t know. I guess it depends on what you wish to study. But we can observe, as in Fig. 2, how the accumulated total at any given time relates to the overall total (here 1708 papers), and what percentage of currently available works were yet unpublished at any given time (e.g., at the end year of a particular survey). It is seen that approximately 50% of all currently available papers (~Q1-2012) were published in the last 8–8.5 years, i.e., after 2003, and almost 30% were not yet published in 2007. By the end of 1997, 70% of today’s body of empirical data was still unpublished.

You can use Fig. 2 to assess how old a survey can be before it’s no longer useful for your purpose. Can you make business decisions based on trend estimates where the most recent half of the data set is missing? Probably not. Most recent 30/20/10%? If so, you need a survey that’s less than approximately 4/3/1 years old.

It is clear that continuously updated surveys, such as Murmann’s, or the one used here at Converter Passion are preferable over single-shot attempts, since the former allows for continuously updated trend estimations.

Figure 2. Paper “yield”. The fraction of current total already published (blue) and yet to be published (red) at the end of any given year.

Known ADC surveys

Author

Size

Years

Type

What

Ref

Walden

100

≤ 1994

Both

Perf. limits, FOM

[1]

Walden

150

1978-1997

Both

Perf. limits, FOM, jitter, evolution

[2]

Merkel

150

1993-2002

Both

Perf. limits, SFDR, power, VDD, scaling, device, arch.

[3]

Le

1000

1983-2004

Parts

Perf. limits, jitter, cost, arch., no. chan, N

[4]

Walden

175

1978-2007

Both

Update++

[5]

Walden

n/a

1978-2008

Both

Update

[6]

Murmann

~260

1997-2008

Sci

Perf. limits, VDD, scaling, FOM, evolution

[7]

Jonsson

1400

1974-2010

Sci

Perf., VDD, scaling, FOM, evolution

[8]

Jonsson

1100

1976-2010

Sci

Perf. & FOM vs. CMOS scaling, evolution

[9]

Fuiano

5540

1970-2010

Sci

Data-converters, research/patent correlation

[10]

Jonsson

1400

1974-2010

Sci

Energy/sample by arch

[11]

Jonsson

1500

1974-2011

Sci

Area eff by arch

[12]

Murmann

~350

1997-2012

Sci

Online survey data

[13]

Jonsson

1700

1974-2012

Sci

Perf., VDD, scaling, jitter, SFDR, FOM, evolution

[14]

About the surveys

Walden

The “mother of all ADC surveys”, and the most frequently cited of all, is the pioneering work by Walden [2] where 150 scientific and commercial ADCs were analyzed, and performance trends were extracted. An earlier version was published already in 1994 [1], but this extended work became “The Walden Survey” to most of us. Although the 150 source documents originated from a mix of commercial and experimental designs, the Walden survey had a size equivalent to 30% of all scientific publications available at the time. The methods introduced in [2] are still useful, but Fig. 1 and Fig. 2 suggest that the trends extracted in [2] are unlikely to be valid and applicable today. At least they would have to be confirmed using more recent data. Two updated versions of the survey were published in 2008 – one covering 175 ADCs and data until 2007 [5], and one with an unspecified survey size and data until 2008 [6]. It is unclear how the 175 converters included in [5] were selected. During the time from Walden’s classic survey to 2007, the academic output alone generated another 715 new sources – commercial parts not counted. The +25 increase in source data therefore seems surprisingly incremental. Still, some of the results in [5] align very well with Converter Passion data, so apparently it was a carefully chosen subset.

Merkel & Wilson

Merkel and Wilson surveyed 150 commercial and scientific ADCs with specifications suitable for defense space applications [3]. Their data appear to span from 1993–2002, and the selection criteria for inclusion in the survey was a sampling rate fs ≥ 1 MS/s, and nominal resolution N ≥ 12 bits. The paper does not reveal the mix between scientific papers and commercial parts, but gathering 150 sources must have been quite an effortby the authors. The total scientific output matching these specs and the time period is no more than 81 papers, and only 59 in the two sources (ISSCC, JSSC) the authors mention as primary. An additional minimum of 69–91 commercial parts must have been included to reach 150 sources. It is therefore assumed that the Merkel & Wilson data set was close to exhaustive for the spec range surveyed, and exhaustive data sets are always applauded here at Converter Passion.

The analysis and discussion itself is geared towards the stated application and focused on linearity (SFDR) to the extent that noise parameters are not treated at all. Power dissipation, supply voltage, speed, device type, scaling and architecture were observed.

Le, Rondeau, Reed & Bostian

An enormous data set, covering nearly 1000 commercial ADC parts from 1983–2004 was used in the survey by Le, Rondeau, Reed and Bostian [4]. As a comparison, the scientific output from the same years (not included in their survey) is 900 papers. The work is firmly rooted in the Walden tradition, but also considers parameters such as the number of channels per package and cost vs. performance. Additionally, the treatment separates the data by architecture, which adds an interesting extra dimension. Because of the larger volume and time span of the data set, part of the focus is to establish differences between this work and the classic Walden paper. Unfortunately, some exponentially improving parameters were plotted along linear axes, which makes many results from the survey difficult to see or interpret. Nevertheless, the contribution by Le et al. is a gigantic work and a key reference.

Murmann

The survey by Murmann [7] is a significant recent contribution to the analysis of empirical performance data. It covers approximately 260 scientific ADCs reported 1997–2008 at the two conferences VLSI Circuit Symposium and ISSCC. The work analyzes ADC performance trends with a focus on energy per sample and signal-to-noise-and-distortion ratio (SNDR). The impact of process and voltage scaling is considered. If you don’t have this paper already, you should definitely head over to IEEE Xplore and get it right now.

Murmann’s survey has further benefits in that it is continuously updated and the data set is available online [13]. The latter opens up a lot of possibilities for anyone wishing to analyze the data in their own way, and makes the survey a very important contribution to the field. It currently includes around 350 sources.

Fuiano, Cagnazzo & Carbone

A rather different angle is taken in [10], where Fuiano, Cagnazzo and Carbone use survey data to analyze the correlation between scientific literature and patent activity. Compared to more “Waldenesque” surveys, this is a rather different animal. It nevertheless appeals to me as it illustrates an attempt to mine large amounts of survey data for something more unusual than ENOB, fs and FOM.

Jonsson

The ADMS Design data set used here at Converter Passion has also been used in five scientific papers, of which four are “surveys”:

ADC trends and performance evolution over time was analyzed in [8].

The impact of CMOS scaling on ADC performance was empirically analyzed in [9].

ADC architectures were compared with respect to energy efficiency in [11].

Other survey-related literature

A few other prior publications that are “survey-ish”, or otherwise use a large set of empirical data for their analysis are listed here:

Vogels and Gielen used a multidimensional regression fit to derive an ADC power dissipation model/FOM based on ≥ 70 empirical data points divided by architecture [15]. A similar approach was recently used by Verhelst and Murmann to analyze power dissipation and area vs. scaling based on Murmann’s data set [16] .

Sundström, Murmann, and Svensson derived theoretical power dissipation bounds in [17], and used the Murmann set to compare theory with empirical reality.

In [18], it was illustrated how the quality of a figure-of-merit (FOM) can be assessed by testing it against a large set of empirical data.

If you feel that I’ve left out any contributions that could have been mentioned in this post, just add a comment below.

SCIENTIFIC PRACTICES: In the previous post, your opinions on which parameters should be mandatory in an A/D-converter implementation paper were surveyed through a poll. In this one we will see what parameters actually get reported in scientific papers, and how the overall reporting practices have changed over time. We can also try to see how well Converter Passion reader’s opinions are in sync with harsh scientific reality 😉

Working with the ADC survey, I had noticed that the set of measured performance parameters authors choose to report or omit changed over time. I’ve gathered the statistics, and it will be interesting to hear what you think of it. Figure 1 shows the percentage of papers reporting signal-to-noise-and-distortion ratio (SNDR), signal-to-noise ratio (SNR), spurious-free dynamic range (SFDR) and total harmonic distortion (THD) each year. The good news is that dynamic single-tone performance is more frequently reported in today’s papers than ever before. In fact, SNDR was reported in 96% of all papers from 2011. Both SNDR and SFDR show noisy but steadily increasing trends, and SFDR is now reported in around 68% of all papers (2011).

At the same time, SNR is increasingly being abandoned in favor of simply reporting SNDR instead. We can also see that THD is becoming an endangered parameter. SNR and THD have been in a visible decline after year 2000, and THD was only reported in 12% of the papers in 2011. SNR went from 60% in year 2000 to 41% 2011. These numbers trouble me. If the trend continues, we will know less about the noise in our A/D-converters for each year. I can’t possibly see how that can be of benefit to “Science” or to the reader. If you can, be sure to post a comment below.

Above we looked at the reporting frequency for each individual parameter. Authors also choose which simultaneous combination or set of performance parameters they include in a paper. This is shown in Fig. 2. Many works report SNDR together with SFDR, and 67% of all papers from 2011 reported at least these two parameters. There is a strong positive trend, so within a decade we may see SNDR+SFDR reported in nearly all published papers. The second most popular parameter pair is SNDR+SNR, with 38% coverage in 2011. Unfortunately, its reporting frequency is limited by the negative trend for SNR.

A more complete single-tone characterization is achieved with the three-parameter combination SNDR+SNR+SFDR. Only 21% of all papers published in 2011 offer this much information about the circuit. Even if there is currently a positive trend, it might soon become limited by the decline in SNR reporting, and eventually reverse.

The practice to report a full four-parameter set is very unusual – only 9% of the papers did that in 2011. It has actually never been really common, and if THD continues to disappear from papers, the four-parameter performance will be increasingly rare. Lots of credit to authors that are still reporting a full set! It is much appreciated here at Converter Passion.

Rare species

Finally, a few other rare species in the ADC parameter ecosystem are shown in Fig. 3. While the highly valuable parameter self-noise appears to be on its way to extinction, intermodulation distortion (IMD) as represented by the second– and third-order intercept point (IP2, IP3) seems to cling to life in the outskirts of the habitat.

So … what do you make of all this? Do you think it will have any long-term impact on our field of science? Does it matter to you what parameters are reported or not? Have your say in the comments below.

And, what happened around year 2000 to shift the trends so dramatically? Was it the dot-com boom or the Y2K bug? (I haven’t heard about that one for a while now)

Poll: What ADC parameters should be mandatory in ADC implementation papers?

Back in July 2011, I raised the question “What parameters should be reported in a good ADC paper?”, and I also asked you what parameters you felt should be mandatory to report in ADC implementation type of papers, when applicable. The poll has been simmering for a while now, and your verdict as of May 28, 2012 is shown above.

Sampling rate (or bandwidth) is the parameter that most of the voters felt should be mandatory to report, closely followed by signal-to-noise-and-distortion ratio (SNDR). I kind of expected these two to come out on top. The lowest ranking parameters in this poll are effective resolution bandwidth (ERBW), self-noise, and intermodulation distortion (IMD).

There are some results that surprised me: I didn’t expect to see the low interest in nominal ADC resolution (N) and power dissipation (P). Only half of the voters want to require authors to report power dissipation, and as little as one third (!) wish to enforce the reporting of nominal resolution when applicable. Interesting, indeed.

What do you say? Are these results expected? Does the ranking list match your personal parameter preferences as well? Are your top two parameters also fs and SNDR (ENOB)?

I’ll keep the poll active, so if you want to have a say too, just make your choices below.

PUBLICATION TRENDS: Now, with all the new survey data, I’m planning to do a series of posts on A/D-converter performance evolution and research trends. First out is an update of the overall number-of-publications trend, which was originally discussed in one of the first post on the blog.

The graph shows the total number of ADC implementation papers per year in the sources listed here. The y-axis is logarithmic to simplify observation of exponential trends. My interpretation is that publication count follows a consistent exponential trend from 1988 and onwards. A log-fit of the data between 1988 and 2011 reveals that the number of A/D-converter papers have doubled approximately every decade since 1988, and that the annual increase is 6.8%. For anyone interested, the expression for the trend line is

If the scientific output volume follows the current trend, it projects to 225 ADC papers per year by 2020 and 433 papers in year 2030. That’s a lot of papers! Probably we’ll see a slow-down in publication volume before that, but only the future can tell us when, and to what level it will saturate. It is possible that we’re already observing a saturation towards ~120 papers/year. The paper count has not increased since 2008. On the other hand, the historical curve is not monotonic, so it could just as well be noise in the data. A similar four-year plateau is for example observed 1996-1999, without changing the overall trend.

What do you think? Are we observing a saturation of the scientific ADC output volume? Would that be good or bad? Is there a limit for how many papers the ADC community can handle per year? Share your thoughts or answer the polls.

BREAKING NEW GROUND: The ADC landscape is continuously changing – also geographically. To the best of my knowledge, 2012 is the year when Australia became the 30th nation to successfully implement, measure, and scientifically report, an A/D-converter IC (*). Great news!

Footnote

(*) NB: The definition I use is first-author-centric. It looks only at the country of the 1st-author affiliation. It is also focused on the accumulated scientific output of the sources listed here. If you are aware of an earlier Australian ADC implementation, please let me know.