Assessment of the 2001 Government Performance and Results Act (GPRA) Report from the National Science Foundation

Directorate for Geosciences

Prepared by the Geoscience Advisory Committee November, 2001

A. Role of the Geoscience Directorate in support of research and education. The Directorate for Geosciences (GEO) supports research to advance the state of knowledge about the Earth, including its atmosphere, continents, oceans, interior, and the cycles that link them. GEO provides the largest share of federal support for fundamental research performed by U.S. academic institutions in these areas. Much of the research supported by GEO is interdisciplinary. Integration of knowledge from multiple fields is essential to fully comprehend the complex interplay of the dynamic systems governing the behavior of the Earth. Through the results of fundamental studies and through collaborative support of projects with mission-oriented agencies, NSF support of the Geosciences contributes to areas of societal concern such as natural hazards, climate change, water resources and the development of natural resources. GEO-supported projects also nurture development of a professional workforce for the geosciences through education of graduate and undergraduate students, who then enter the national and international workforce as researchers, and as practitioners throughout the expanding field of environmental science in government and the private sector. There is also increasing GEO involvement in primary, secondary and undergraduate education and outreach to the public through the development of content-rich materials as part of individual research projects and facilities; through the effective “Awards to Facilitate Geoscience Education” (AFGE) program; through the newly-formed GeoDiversity program; through significant involvement in the Digital Libraries Initiative (DLESE - Digital Libraries for Earth System Education); and through explicit coordination of cross-disciplinary education programs at the Directorate level. B. Executive Summary of Results In our annual assessment of the performance of the GEO Directorate, the Geoscience Advisory Committee expresses our strong endorsement of the quality and breadth of scientific and educational activities supported by the Directorate and the highly professional manner in which the staff directs and manages its portfolio of research grants and activities. Guided by the Directorate's long-range plan – " NSF Geosciences Beyond 2000, Understanding and Predicting Earth’s Environment and Habitability " – GEO continues to support and stimulate global leadership by US scientists in all aspects of fundamental studies of our planet's structure and environment. Increasingly, the results of these investigations are reaching the public and the classroom and finding application in areas that are of societal concern. The GEO Directorate shows strength and improvement throughout the areas specified by NSF as indicators of advancement towards the strategic goals of the Foundation. In the area of "Ideas", GEO-supported research continues the strong tradition of discovery that is the hallmark of the geosciences. Underlying many of these discoveries is NSF's support for observational and analytical "Tools" that are essential to exploring the Earth’s environment and interpreting these data in terms of the planet’s structure and history. While the core strengths of both NSF and the GEO Directorate have been and continue to be in the support of fundamental research, the past few years have seen significant evolution in GEO’s response to NSF’s declared goals to advance participation in educational activities and demonstrate the broader contributions of investments in research. An area of perennial concern has been the lack of diversity and minority in the participation in the geosciences workforce. The Advisory Committee is pleased to see that the Directorate is taking direct action to begin to correct this imbalance by creating a special program “GeoDiversity” to encourage the involvement of under-represented groups at all levels in the educational and research endeavor.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

2

C. Approach used in making the assessment This assessment by the Advisory Committee for Geosciences (AC/GEO) is based on: • the FY2001 Performance Report prepared by the Geoscience Directorate • the report from the Committee of Visitors (COV) on the Lower Atmospheric Research Section (LARS) in the Division of Atmospheric Sciences • the report of the COV on the Instrumentation and Facilities Program in the Division of Earth Sciences • AC/GEO members' knowledge of activities within the GEO Directorate and projects it supports • presentations from, and discussions with, Directorate staff • information from program officers and NSF grantees • various documents produced by and for the Directorate including Ocean Sciences at the New Millennium” prepared by the Ocean Sciences Decadal Committee, Basic Research Opportunities in Earth Science produced for the Division of Earth Sciences by the Board on Earth Sciences and Resources (BESR) of the NAS, Digital Library for Earth System Education: A Community Plan produced as a final report for NSF Grant 99-06648, the Initial Science Plan For Integrated Ocean Drilling Program, and NSF Geosciences Beyond 2000, Understanding and Predicting Earth’s Environment and Habitability produced by the NSF Directorate for Geosciences. The formal assessment of the Report took place at the regular meeting of the Advisory Committee for Geosciences on November 1-2, 2001. Based on the material provided and discussion during the meeting, members of the Advisory Committee voted on performance of the Directorate under each of the criteria specified. D. Summary assessment for performance goals The Advisory Committee for Geosciences was asked to assess the portfolio of activities relevant to the GEO Directorate and to provide a report of the progress in contributing to the achievement of the NSF-wide Strategic Outcome goals:
• • • People -- Development of "a diverse, internationally competitive and globally-engaged workforce of scientists, engineers, and well-prepared citizens." Ideas -- Enabling "discovery across the frontier of science and engineering, connected to learning, innovation, and service to society." Tools -- Providing "broadly accessible, state-of-the-art information-bases and shared research and education tools." The NSF is considered successful when, in the aggregate, results reported in the period demonstrate significant achievements in one or more of the 11 indicators that are discussed below.

COMMITTEE

OVERALL ASSESSMENT

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting ten of the eleven performance indicators under NSF's Strategic Outcome Goals and thus is considered to have overall successful performance for FY2001. The one remaining indicator (“Information and Policy Analyses”) is one that the Advisory Committee does not consider relevant for consideration related to the activities of the GEO Directorate.
Advisory Committee for Geosciences FY 2001 Performance Report Assessment 3

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

4

.

GOAL 1 - PEOPLE
Development of "a diverse, internationally competitive and globally-engaged workforce of scientists, engineers, and well-prepared citizens." NSF's performance is successful when, in the aggregate, results reported in the period demonstrate significant achievement for one or more of the following indicators:
• • • • Improved mathematics, science, and technology skills for U.S. students at the K-12 level and for citizens of all ages. A science and technology and instructional workforce that reflects America's diversity. Globally engaged science and engineering professionals who are among the best in the world. A public that is provided access to the benefits of science and engineering research and education

COMMITTEE

SUMMARY ASSESSMENT

-

Goal

1

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting all of the performance indicators under NSF's Strategic Outcome Goal related to "People" and thus is considered to have overall successful performance under this goal for FY2001.

Summary
The Advisory Committee is especially pleased with improvement in two of the indicators for this goal. Both of the COV’s for this year document a dramatic improvement over the past year in the way in which both reviewers and Program Officers are responding to the review criterion related to “broader impacts”. We also note that the Directorate has taken explicit steps to deal with the longstanding problem of under-representation of minority groups in the Geosciences. The GEO Directorate’s excellence in the development of an "internationally competitive and globally-engaged workforce of scientists and engineers" is evident and well-documented in the quality and breadth of the research accomplishments of all of its Divisions. The influence of NSF supported research on climate change, hazard and resources assessment and the fundamental structure and evolution of planet Earth extends throughout the world's research arena and impacts many areas of public policy. Through growing programs that bring the results of NSF supported research to the classroom and the public, there is increasing evidence that GEO encouragement of links between research and education is aiding in the development of "well-prepared citizens" who are more aware of the geo-environment and world in which we live. This and previous assessments of the GEO Directorate comment on the long-standing problem of developing a geoscience workforce that “reflects America’s diversity”. Significant parts of the population remain under-represented in the current demographics of the geoscience community at all levels. This year, GEO has embarked on a focused program in “GeoDiversity” to begin to establish pathways to rectify this imbalance. The GEO Advisory Committee strongly endorses these efforts, recognizing that a long-term, sustained commitment will be required to show results.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

5

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

6

Goal 1 - People - Indicator 1 Improved mathematics, science, and technology skills for U.S. students at the K-12 level and for citizens of all ages. COMMITEE STATE M EN T

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. The GEO Directorate supports a mix of national and local projects that work directly towards this goal. The impact of GEO programs on education is most directly seen at the tertiary level through the participation of Principal Investigators in research training and teaching at their own institutions. Because undergraduate research is now common at many large and small universities, many undergraduate students leave college with first-hand experience doing science as part of NSF-funded projects. In addition, many individual scientists and consortia supported by GEO have enhanced and extended the educational component of their research programs through internships, the development of web-based curriculum materials and involvement in informal education through museums and community outreach programs.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH Improved mathematics, science, and technology skills are a natural outcome of research within the atmospheric sciences for the graduate students and undergraduate students who participate in the NSF-funded grants within LARS. Awards are also made to enhance the professional development of emerging scientists. For example, the ACCESS [Atmospheric Chemistry Colloquium for Emerging Senior Scientists] program brings together senior graduate students and post docs in Atmospheric Chemistry. Following the ACCESS meeting, attendees participate in the Atmospheric Chemistry Gordon Research Conference. It has served to build long-lasting professional relationships that have made a difference to the individuals and the field as a whole. Undergraduate students are frequently included in the grants being funded, including through two targeted programs: Research Experience for Undergraduates (REU) and Research at Undergraduate Institutions (RUI). As an example, the Paleoclimatology Program awarded 5 REU proposals or proposal supplements [ATM-0105510, 0121049, 0082376, 9817560, 9986074] during the past year and 1 RUI proposal [ATM-0117170]. There are also instances where the LARS has provided funding to improve students at the K-12 level. For example, the Penn State Summer Camp [ATM-0108865] brings high school and middle school students from under represented groups to campus for a week of science activities. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES All projects funded by the IF program directly impact the scientific and technological skill and understanding of the PI’s and their graduate and undergraduate students. Some of these students, both undergraduate and graduate, go on to become research scientists in academia, industry, or government, but many more will find careers that are not directly related to their scientific training. However, the technological and scientific skills acquired by working with cutting-edge instrumentation to help answer interesting scientific questions gives these students a competitive advantage in a technological society. At Macalester College (a small liberal arts college), over the past two years 55

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

7

undergraduate students, including 21 women, have been involved in research that uses an IF funded x-ray fluorescence spectrometer (EAR-9601475) as a primary tool to help answer questions on the chemical evolution of the upper mantle and continental crust. Some large multi-user facilities like IRIS and CHiPR have model outreach programs directed at K12 students and teachers. For example, CHiPR created an Earth Science Educational Resource Center (ESERC) that “offers a suite of educational programs that bring the process of ‘doing science’ to a wide array of audiences including secondary schools students, undergraduates, teachers, elementary and pre-K.” Programs offered by ESERC include continuing education courses for K-12 teachers on the geology of Long Island to a pre-K through third grade science enrichment program that teaches basic concepts in geology and physics. The Education & Outreach (E&O) Program of the IRIS Consortium runs one-day workshops that train both pre-service and in-service K-12 teachers. IRIS uses a two-pronged approach to reach the K-12 teacher population: directly through workshops held at national professional scientific and education meetings, and by training seismologists in the research community to run teacher workshops and then providing these seismologists with the resources to run a workshop locally. From its inception, the IRIS E&O Program has placed high priority on development of educational materials that can be used at all levels. One-page handouts and posters have been distributed to a wide audience worldwide that includes research scientists, college and K-12 educators and their students, and the public. Over the past two years, more than 15,000 handouts and posters have been distributed nationally and internationally upon request, with a similar number distributed at national and regional scientific and educational meetings. Both English and Spanish versions of the one-pagers have been developed and they can be downloaded and printed from the IRIS web site (http://www.iris.washington.edu/EandO/onepager.html). Other examples The National Space Weather Program on the Web serves as a central outlet for public information on space weather by providing a collection of resources of interest to educators, the media, and the general public. The Educational Seismology Network (ESN) advances inquiry-based learning in high schools and colleges by engaging students in measuring seismograms, sharing data with researchers and using the data in the classroom. Science for “At-Risk” Students is a high-risk award that uses an Earth science curriculum to capture student interest and deliver other science, math, social science and language arts material. The Summer Program for Learning About Semi-arid Hydrology recruits students from high schools with diverse populations to spend their summer working with researchers; several have gone on to be REU students in college. The Global Learning and Observations to Benefit the Environment (GLOBE) program engages K12 students across the U.S. in making atmospheric and hydrologic measurements for use by scientists, while using inquiry-based Earth science material for learning math and science.

The GEO Advisory Committee considers that the GEO Directorate has been successful in making progress towards meeting this performance indicator. AC/GEO notes that the participation of traditionally underrepresented groups (women, people with disabilities, African-Americans, Hispanics, and Native-Americans) in the geoscience workforce is low. However, over the past two years, the Directorate has initiated a fast-path initiative to begin to rectify this situation. A very promising indicator that there is already significant movement in this direction is the number of sessions at professional society meetings in the Geosciences that involve training and career guidance for women and minorities. Many of these sessions are lead by researchers and staff directly supported by NSF and GEO programs. This year, GEO made a major step towards increasing the diversity of the Geoscience workforce with the launch of a new program called “Opportunities for the Enhancement of Diversity in the Geosciences” (also called OEDG or ‘GeoDiversity’). Sixteen awards were made for a wide range of activities including: developing earth science courses at minority-serving institutions; involving students from underrepresented minorities in geoscience research, environmental monitoring, or summer science camps; mentoring and tutoring of minority students; faculty development; building partnerships between minority-serving institutions and research institutions; and building partnerships between minority journalists and environmental journalists. (http://www.geo.nsf.gov/geo/diversity/oedg_fy_01_awards.html) Last year, AC/GEO wrote: “Although AC/GEO believes that the GEO Directorate is making a sincere and significant effort in this area, and is willing to rate its performance as successful on this diversity indicator, eventually it will be necessary to document quantitative evidence of substantive impact.” The new GeoDiversity program is working towards acquiring the requisite quantitative evidence: as a condition of receiving their second- and third-year funding, PI’s must have an approved plan for evaluation of the effectiveness of their efforts.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH The COV for LARS noted specific examples within LARS of diversity-building efforts. An REU project at Clark Atlanta University introduced students and faculty to earth system science, and encouraged minority students to seek graduate degrees in earth science. UCAR’s, project SOARS (Signification Opportunities in Atmospheric Research and Science), which provides support for students from under-represented groups to enter graduate school in atmospheric and related science, introduced students to research through the STEPS (Severe Thunderstorm Electrification and Precipitation Study) program. The COV for LARS also noted that the percent of women and minorities among NSF research grant recipients and the funding rate for women and minorities are indicators of diversity. Over the last three years between 4 and 6 minority investigators per year have received LARS funding with an average funding rate of 34%. Over the last ten years funding rates have been between 8% and 88%. Within both the GEO Directorate and NSF as a whole the rate of funding for minority investigators is

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

9

somewhat lower than for all investigators. However, these comparisons should be used with caution given the small number of grants and grant applications for minorities. Over the last three years 10% of all investigators within the Division of Atmospheric Sciences were female, with an average proposal acceptance rate of 43% versus 48% for all investigators. Data for the past 10 years shows a slightly steeper decline in funding rate for female versus all investigators in atmospheric sciences. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES As a whole, the geoscience community does not reflect the ethnic and cultural diversity of the U.S. However, some key institutions like the University of Texas, El Paso are making great strides in research training and development of ethnic minorities. Of the eight published articles from one grant, five include a Mexican-American faculty member as first author or co-author. Of the 23 abstracts supported by this same project, nine include a Mexican-American faculty member as first author or co-author, and 21 include Mexican-American student authors. Other examples One successful program that provides a "pipeline" to bring ethnically diverse undergraduates into careers in the atmospheric and related sciences is Significant Opportunities in Atmospheric Research and Science (SOARS). SOARS resides at NCAR and identifies, recruits, and provides students attending colleges/universities in the U.S. and Puerto Rico with multi-summer research experiences, year-round guidance, counseling, and mentoring, and up to two years of graduate school support. SOARS boasts an 82% retention rate. Since its 1996 inception, 62 students/protégés have participated. Forty-two are current participants, nine are alumni and 11 have left the program. To date 38 have completed bachelor’s degrees in a science field, 17 are enrolled in atmospheric or related science graduate programs, three are AMS graduate fellows, nine have completed master’s degree programs, and three are Ph.D. candidates. No protégé has left college/university without completing an undergraduate degree in science, mathematics or engineering. Seven protégés have co-authored nine papers published in refereed journals. Many protégés have presented papers and posters of their summer research results at numerous regional, national, and international professional conferences; two papers received best presentation awards, one paper received an honorable mention; one poster was awarded best poster in atmospheric science. Six alumni are in the scientific workforce; three are enrolled in Ph.D. programs.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

10

Goal 1 - People - Indicator 3 Globally engaged science and engineering professionals who are among the best in the world. COMMITEE STATE M EN T

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. By its very nature, geoscience research spans the globe. US leadership, based largely on NSF support, is evident across the spectrum of Geosciences and environmental sciences. In order to ensure a successful research portfolio, GEO supports a broad spectrum of international collaborations including international meetings and conferences, research occurring outside of the U.S. and involving collaboration with local scientists, and participation in many international organizations.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH As many of the questions that are being addressed within the atmospheric science community are beyond the local scale, LARS-supported research programs are characterized by their international scope and collaborations; and these programs represent cutting-edge atmospheric science. For example, the Atmospheric Chemistry Program has supported the International Global Atmospheric Chemistry (IGAC) Program administrative office. The Paleoclimatology Program is one of the two major financial sponsors of the Past Global Changes (PAGES) initiative of the International Geosphere Biosphere Program, which aims to further research on past global climatic changes that are relevant to understanding the patterns and forces of climatic changes that are significant to society. PAGES facilitates workshops and meetings paleoclimatologists from many countries and coordinates a number of large paleoclimatic research projects such as the Pole-Equator-Pole (PEP) transects of sites recording past terrestrial climate change, and the IMAGES program of marine investigations. There are a large number of LARS-supported U.S. scientists who participate in and contribute to the work of the International Panel on Climate Change (IPCC), an international group that provides scientific assessments for the governments of the world regarding the causes of and projections for climate change. Although these scientists are not directly supported to work for IPCC, the fact that NSF has supported their research and that they have been asked to serve on the Scientific Working Group for the IPCC is testament to the fact that NSF is supporting researchers who are world class and globally engaged. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES IF provides state-of-the-art laboratories, field instrumentation, technique development, and technical support that poise U.S. geoscientists for global engagement and competition. The mix of support to individual investigators and multi-user facilities creates considerable flexibility in meeting this goal. The multi-user facilities, such as IRIS (EAR-9843924, EAR-0126534), UNAVCO (EAR9840963, EAR-0102250), and IRM (EAR-9818704), provide data sets, technical support, and analytical facilities to the NSF investigator community in particular, as well as the scientific community at large.
Advisory Committee for Geosciences FY 2001 Performance Report Assessment 11

Over the last decade, IF has seeded 57 technician support positions. This innovative program provides incentive for universities to institutionalize support for technicians, and contributes to a globally competitive scientific community. By providing up to five years of seed funding, followed by an institutional commitment to continue the position for at least two years, this opportunity for technical support is typically embraced by universities. Further, IF supports graduate students and post-doctoral scholars who are developing new techniques on existing equipment. These experiences have resulted in professional placement that simply would not have been possible without IF support. Other examples The Ocean Drilling Program is among the largest international scientific programs in existence today with more than 20 countries participating. Due to the expense of the facilities necessary to drill deep in the oceanic crust, as well as the need for global coverage, international cooperation is of mutual advantage to participating countries. The GEO Directorate of NSF supports the participation of U.S. scientists in the ODP.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

12

Goal 1 - People - Indicator 4 A public that is provided access to the benefits of science and engineering research and education COMMITEE STATE M EN T

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. Throughout the Divisions of the Directorate, there are a number of community-based organizations that have initiated Education and Outreach projects to bring Geoscience data and results to the public through specially designed Web resources, museum displays and content-rich curriculum materials. Examples include the Southern California Earthquake Center, the IRIS Consortium, the Digital Libraries for Earth System Science, the National Center for Atmospheric Research and the Joint Oceanographic Institutions. All of these organizations have professional staff dedicated to ensuring that the results of NSF funded research are provided to the public and educational sector in clear and innovative ways. Many of these programs involve direct partnerships with educators and professional societies to ensure broad access and to assess effectiveness.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH The benefits of education and research within the Atmospheric Sciences are extremely visible to the public at large. The importance of the daily weather to individuals is self-evident. Research particularly within the Mesoscale Dynamic Meteorology Program benefits the prediction of weather and is made available to the public through improvements in weather prediction. For example, Verification of Origins of Rotation in Tornadoes Experiment (VORTEX) used airborne and surface mobile Doppler radars and other mobile sensors to map in detail the structure of tornadoes and their near environment. The modeling and observations indicated that a localized downdraft is an important ingredient in the final stages of tornado genesis. This knowledge was directly translated to more accurate tornado forecasts (tornado watches) being issued by the National Weather Service. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES Some IF awards contribute directly to public technology infrastructure that is used by the geotechnical and engineering communities. IF has supported equipment acquisition and data dissemination for GPS reference stations, especially in the western states. These projects (NBARNorthern Basin and Range Array, PANGA-Pacific Northwest Geodetic Array: EAR-0002066, EAR9615640, EAR-9616302; SCIGN-Southern California Integrated Geodetic Array: EAR-9813700; and BARD-Bay Area Regional Deformation Array: EAR-9977823) distribute data through UNAVCO (EAR9840963, EAR-0102250) and archives to the NGS and the geotechnical and engineering communities, cities, counties, and states. For the last fifteen years, the NSF and USGS, along with private foundations and universities, have made significant investments in development of the Global Seismographic Network (GSN) and its associated data collection facilities. The IRIS Consortium, in collaboration with the USGS, has begun to exploit this scientific resource for educational purposes, by making data from the GSN accessible to the general public through museum displays. By bringing live research-quality seismic data over the Internet and broadcasting it in museums, IRIS provides visitors with evidence that Earth’s surface is in motion. Accompanying handouts and classroom exercises provide the visitor

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

13

with follow-up educational materials. Currently, the IRIS E&O Program has museum exhibits at the American Museum of Natural History (NY), the Carnegie Museum of Natural History (PA), the New Mexico Museum of Natural History (NM), and an exhibit on tour with the Franklin Institute as part of their “Powers of Nature” exhibit. These exhibits together reach approximately 9 million visitors each year. Other examples DLESE (Digital Libraries for Earth Science Education) is the geoscience component of – and has emerged in a leadership position within – the National Science, Mathematics, Engineering, and Technology Education Digital Library (NSDL). DLESE is fulfilling the NSF priority that emphasizes People by mobilizing a large cross-section of the geoscience community that is enthusiastic about using, contributing to, and participating in DLESE. Many of the best of the geoscience research and education community are dedicating themselves to the governance, management, and operation of DLESE. GEO supports the Earth & Environmental Science Journalism program at Columbia University, an innovative collaboration between Lamont-Doherty Earth Observatory and the Columbia Graduate School of Journalism. GEO funding provides a research experience for each student, so that their subsequent reporting and writing will be underlain by a deeper understanding of the scientific process. Graduates of the program inform the public about the Earth and environment through newspapers, magazines and radio.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

14

GOAL 2 - IDEAS
Enabling "discovery across the frontier of science and engineering, connected to learning, innovation, and service to society." NSF's performance is successful when, in the aggregate, results reported in the period demonstrate significant achievement for one or more of the following indicators:
• • • • A robust and growing fundamental knowledge base that enhances progress in all science and engineering areas including the science of learning. Discoveries that advance the frontiers of science, engineering and technology. Partnerships connecting discovery to innovation, learning, and societal advancement. Research and education processes that are synergistic

COMMITTEE

SUMMARY ASSESSMENT

-

Goal

2

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting all four of the performance indicators under NSF's Strategic Outcome Goal related to "Ideas" and thus is considered to have overall successful performance under this goal for FY2001.

Summary
The Advisory Committee is unanimous in its assessment that NSF Geoscience supports world leadership in “discovery across the frontiers of science”. As documented in the GEO-2000 longrange plan, NSF Geosciences is poised to continue its leadership role in studies of the Earth’s structure, energetics, ecology and metabolism and the way in which these Earth systems interact with human activities in defining the future habitability of the planet. The portfolio of research activities supported by the Directorate is a rich mix of fundamental, interdisciplinary investigations, many of which have direct and immediate application to the health of society.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

15

Goal 2 - Ideas - Indicator 1
A robust and growing fundamental knowledge base that enhances progress in all science and engineering areas including the science of learning. COMMITEE STATE M EN T

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. GEO’s core programs continue to support a research portfolio that enhances all aspects of the geosciences and continually moves the field in new and bold directions. The research and discovery activities throughout the Directorate are exemplary and stand as a prime example of NSF's commitment to encouraging the highest standards in world-class research.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH The communities of researchers supported by LARS are developing a robust and growing fundamental knowledge base and are making discoveries that advance the frontiers of science, engineering and technology. There are many partnerships connecting discovery to innovation, learning and societal advancement, and the research and education processes are synergistic. The COV for LARS noted that development of aerosol mass spectrometers has taken place, in part, as a result of LARS support. These are now being used to address other needs, e.g. to improve aerosol drug delivery systems, and environmental purity in semi-conductor manufacturing. Another example is the study of the fundamental predictability of the atmosphere. These studies both initiated and contributed to chaos theory, which has been applied by many disciplines. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES The instrumentation support from IF is highly successful in facilitating new ways to study and in stimulating new ideas about the Earth system. New technology, increases in computer power, larger geophysical arrays, improvements in accuracy of chemical and isotopic analysis, and reductions of sample size have all served to contribute previously unattainable information at increasingly variable scales. These capabilities are used by many scientists to advance the frontiers of science, including those funded by all programs in the Earth Sciences Division. This collaboration of NSF programs is catalyzed by IF equipment and support, and has lead to new ideas and even paradigm shifts for our understanding of the processes that shape our planet. Other examples Scientists at the NSF-supported Arecibo Observatory recently solved a problem that has baffled ionospheric physicists for many years. The theory of incoherent scatter has been used for several decades to interpret radar echoes from the ionosphere. Correct interpretation of the incoherent scatter radar spectrum enables accurate determination of many ionospheric properties such as density, velocity and temperature. However, application of incoherent scatter theory to data obtained at the Jicamarca observatory in Peru has yielded unrealistic values for the electron temperature. Arecibo scientists showed that assumptions made in the calculation of the theoretical incoherent

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

16

scatter spectrum are not valid at Jicamarca where the radar beam is directed nearly perpendicular to the magnetic field. Recent observations of enhanced mixing above rough topography at mid-ocean ridges and new estimates of wind and tidal energies have led to a re-examination of how the ocean's stratification is maintained. Rather than requiring high uniform mixing rates in the abyssal ocean, it appears that a sufficient amount of tidal energy can be converted into mixing over seamounts and ridges. When combined with global wind mixing and frictional tidal mixing in shallow seas, this new source of abyssal mixing would be sufficient to balance global upwelling. Measurements and modeling of water movement in desert soils are filling a large knowledge gap regarding the groundwater recharge in semi-arid regions, which represent over 20% of the Earth’s land area. Researchers have reconciled apparent discrepancies between environmental tracer data and hydraulic gradient data in deep vadose zone profiles in the Southwestern U.S. A unifying theory for the hydrology of semi-arid vadose zones is particularly timely considering the rising population and water stresses of semi-arid regions, which depend heavily on pumping of groundwater. Understanding groundwater recharge rates is essential for sustainable water management.

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. Throughout the Directorate, in essentially every program, there are examples of research that advances the frontiers of science and technology. This indicator is fundamental to GEO’s mission.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH There are a number of notable discoveries that have advanced the frontiers of the atmospheric sciences in recent years, and the LARS COV highlighted three areas that have advanced not only their own sub-discipline, but which have applications across different areas in atmospheric science and even beyond atmospheric science: a) The Arctic Oscillation; b) Carbon and Oxygen Cycles; and c) Climate Change, Cirrus Clouds and Radiative Transfer to Clouds. The Arctic Oscillation, an annular mode of the atmospheric circulation, has been linked in recent years to a variety of issues, ranging from the detection and diagnosis of global change to weather and climate forecasts in North America and Europe. ATM-supported investigators have played leading roles in the study of this annular mode, beginning with Wallace and Thompson's introduction of the term "Arctic Oscillation" (or "AO") in the late 1990s. Interdisciplinary research aimed at understanding the global carbon cycle is central to predicting future climate changes. GEO supported researchers have pioneered the use of high precision measurements of the O2/N2 ratio in air to study the biogeochemical cycles of carbon and oxygen. Using two independent techniques, mass spectrometry and interferometry, they have documented regional and global variations in O2/N2 and explored the use of this data to place constraints on the fluxes of CO2 and oxygen between the atmosphere, ocean, and terrestrial biosphere. The record to date has revealed significant interannual variability in the magnitude of the terrestrial biospheric sink for CO2. One of the most uncertain aspects of climate models is their treatment of clouds. Lindzen [ATM9813795] has made a discovery with potentially significant implications for global climate change scenarios. They find a strong inverse relation between cirrus cloud area and the underlying sea surface temperature (SST): the cirrus coverage, when normalized by a measure of the cumulus coverage, decreases about 22% for each degree (°C) increase in cloudy region's SST. The hypothesis put forward is that higher SST increases the cumulus precipitation efficiency, which, in turn, reduces cirrus detrainment. The finding suggests that the Earth has a natural adaptive infrared ‘iris’ that opens and closes the upper dry regions in order to control the Outgoing Longwave Radiation in response to SST changes, in a manner similar to which a human iris reacts to changing light levels. Substantial progress has been made toward understanding the influences of clouds on the radiation balance of the Earth. A major component of this progress has been improved understanding of light scattering by ice crystals in cirrus clouds. A leader in this development is Kuo-Nan Liou [ATM9907924], whose studies of the effects of ice clouds on radiative transfer established the basis for incorporating such transfer into cloud models.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

18

There are other related investigations are making it possible to represent cirrus clouds in climate models, to interpret field observations of radiative transfer, and to move toward better prediction of how radiative transfer might change in a future climate system. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES New depth profiling techniques for monazites by ion microprobe improved the spatial resolution of 208 Pb/232Th measurements by a factor of 100 (EAR-9806639). These results yield unprecedented age sensitivity for the uplift of the Himalaya, the greatest mountain massif on Earth. Reports of the Hadean detrital zircons from Western Australia, include the discovery of one as old as 4.4 Ga. This tiny crystal formed within 160 million years of the accretion of Earth and is the only sample known from the earliest history of the Earth. Its discovery and microanalysis was only possible because of cutting edge equipment funded by IF (EAR-9206456, 9902973; EAR-9806639). These results indicate the earliest silicic magmas, the presence of liquid water, and perhaps even oceans, i.e., a cool early Earth, at a time when many have hypothesized the existence of magma oceans. As a final example coupled 14C and 230Th measurements (EAR9712037, 9512334, EAR-9419210,) of microsamples of benthic coral to show that the ventilation rate of the N. Atlantic varied greatly during the last glaciation. These results indicate the role of the deep ocean in abrupt changes in climate at the 10-100 year scale. Other examples Hydrothermal vent structures, dubbed the “Lost City,” were discovered in December 2000 in the midAtlantic Ocean. These vent structures, including a massive 18-story vent, taller by far than any seen before, are very different from all others discovered across the world since the 1970s Analysis of data from a set of short-duration intra-cloud lightning flashes that last only 23 millionths of a second, illuminated a new class of lightning that is thousands of times faster than those previously observed. Recognition of the involvement of microbes in mineral precipitation and biogeochemical cycling has moved the disciplines of geochemistry and microbiology ever closer. Recent interdisciplinary experiments, conducted on salt crystals taken from the Permian Salado Formation in Southeastern New Mexico, have shown that some ancient crystals still contain viable micro-organisms trapped within tiny fluid inclusions.

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. Across the Directorate, results of GEO-supported research are being applied toward societal needs, and are stimulating improved understanding of the Earth system and prediction of its future states.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH LARS supports many atmospheric research programs that involve partnerships, both among multi-disciplinary groups and among international researchers. An especially relevant example is the US Weather Research Program (USWRP). The overarching objective of USWRP is to conduct fundamental and applied research that will lead to improvements in various aspects of weather forecasting, such as hurricane landfall and quantitative precipitation prediction. In addition to supporting research in the area of physical scientific research, USWRP seeks to identify societal impacts of weather and weather information, determine the types of weather products that users require, and better understand how these products are or might be used. The Climate Dynamics Program has participated in many valuable and productive partnerships over the past three years. Examples of these partnerships include collaboration between CDP and the NOAA Office of Global Programs to support the placement of two K-12 teachers on board the research vessel Ronald H. Brown as part of the upcoming EPIC field program [e.g. ATM-0082384, 0082391, 0002322]. The teachers will participate in the science being conducted on the ship, maintain a daily log, take photographs, interview scientist, and engage in dialogue on the special Eastern Pacific Investigation of Climate Processes in the Coupled Ocean-Atmosphere System (EPIC) Teacher At Sea website. Moreover, the experience will allow the teachers to translate their knowledge and enthusiasm to their students more effectively and completely. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES While Earth scientists have typically made measurements on the top 100 meters of the earth’s crust, an IF funded facility, IRIS, seeks to image at high resolution the structure and composition of the whole Earth. This image will form the basis for a new, physics-based description of the dynamics of the whole Earth. Moreover, using Internet technology, the data management program will make these state-of-the-art data available to anyone in the world promoting a powerful synergy of research and education. The scale of the facility, like the scale of the problem, is large encompassing a partnership of 96 institutions and hundreds of individual researchers and research projects. Another IF based partnership employs space based geodesy, which is opening a new era for understanding crustal motions within plate boundaries, plate convergence and continental mountain building in real-time. Work using IF funded (EAR-9910789) UNAVCO GPS instruments provide sufficient data density and accuracy that our understanding of these motions is no longer limited by the available kinematic data. Moreover the real time nature of these data allows for the first time

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

20

resolving the strain non-linearity and its implications for mechanisms and predictions of seismic hazard. Other examples The Paleoclimatology program supports a notable and ambitious REU project at Lake Tanganyika developing a program for training U.S. students, African faculty and students, and members of the local community on limnology and paleolimnology. NSF is working with NASA, the Dept. of Defense, and NOAA to establish a computer center for developing and testing sophisticated computer models for space weather specification and forecasting. With joint support from NSF, NASA, and the Air Force Office of Scientific Research, the Community Coordinated Modeling Center was initiated at Goddard Space Flight Center. NSF funds have been used for computer hardware at the center including a Beowulf cluster that has begun running a magnetohydrodynamic model of the magnetosphere. The U.S. Global Ocean Ecosystem Dynamics program (GLOBEC), supported by the NSF and NOAA, initiated a coordinated field investigation for the coastal Gulf of Alaska. The multidisciplinary research team is investigating the impact of climate variability on the complex linkages of the marine ecosystem and fishery production, particularly salmon, in the Northeast Pacific Ocean. The Hawaii Scientific Drilling Project (HSDP) is the culmination of more than ten years of scientific review, testing, and analysis directed toward the study of the planetary processes that have produced the Hawaiian Island chain. Scientists from the three lead universities are joined by an international team of earth-science researchers from nearly two dozen universities and research institutes. The project is designed around a drilling program that will collect a continuous sequence of samples from the now buried lava flows that form the Mauna Kea volcano.

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. Research and education are inextricably linked. Graduate-level education within most fields of science and engineering takes place primarily through conducting research that is supervised and directed by the faculty at Universities.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH The COV for LARS noted that most of the research supported through LARS goes towards the support of graduate students and is explicitly relevant to synergistic research and education processes. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES Most of the IF funded research goes to university based PI’s. The support of education through research assistantships, and student use of IF funded equipment and facilities is important and necessary for the training of new scientific talent. An essential component of graduate student training is access to state-of-the-art instrumentation. Other examples In addition, GEO supported research programs actively incorporate educational components. One example comes from the Oklahoma Weather Center (OWC) REU proposal. It is bringing 30 undergraduate students, over a three-year period, to Norman Oklahoma to participate in the OWC program. In another case, NSF funded an interdisciplinary team of 34 scientists, technicians and engineers to explore a newly discovered vent field in the Indian Ocean by collecting biological samples and samples of vent and smoker fluid and plumes, rocks and sediment samples from the seafloor, and by precisely mapping the area. Findings of new hydrothermal vent animals and ancient bacteria may help scientists better explain how and whether the fauna living at hydrothermal vents in the Atlantic and Pacific Oceans are genetically related. The research expedition was fully integrated with an educational component entitled "Dive and Discover," co-funded with the Woods Hole Oceanographic Institution and Ohio's Center of Science and Industry.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

22

GOAL 3 - TOOLS
Providing "broadly accessible, state-of-the-art information bases and shared research and education tools." NSF's performance is successful when, in the aggregate, results reported in the period demonstrate significant achievement for one or more of the following indicators:
• • • Shared use platforms, facilities, instruments, and databases that enable discovery and enhance the productivity and effectiveness of the science and engineering workforce; Networking and connectivity that take full advantage of the Internet and make SMET information available to all citizens; and Information and policy analyses that contribute to the effective use of science and engineering resources.

COMMITTEE

SUMMARY ASSESSMENT

-

Goal

3

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting two of the three performance indicators under NSF's Strategic Outcome Goal related to "Tools" and thus is considered to have overall successful performance under this goal for FY2001.

Summary
In all of the Divisions of the GEO Directorate, investments in “ broadly accessible, state-of-theart information bases and shared research and educational tools” form a significant core of the support for research and educational endeavors. NSF is playing and increasingly important role in providing the resources for the long-term observations of the national and global environment that are essential to understanding the evolution and dynamics of myriad linked Earth systems. Collaborations with US mission agencies and international partners leverage the investment of NSF in support of these tools for research, discovery, education and public information. In the Ocean Sciences, the research vessels of Academic Fleet, platforms for ocean drilling, buoys and seafloor observatories and space-based observational systems are an essential part of many of the research programs in the world oceans. In Earth Sciences, global networks of ground motion and geodetic sensors, linked in via the Internet, provide real-time monitoring of the world’s earthquake activity and crustal deformation that form the basis for research on the structure and dynamics of the solid Earth. Shared-use facilities for high pressure research and spectrographic analyses are an essential component of studies of the structure and properties of Earth materials. In Atmospheric Sciences surface, air and space based observational systems are essential for understanding the dynamics of weather and climate. Throughout all of the Divisions, the use of the Internet to collect data and support shared resources for data management and computation are leading to increased interactions between programs and institutions and enhanced access to information for scientists and the public.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

23

Goal 3 Tools - Indicator 1 Shared use platforms, facilities, instruments, and databases that enable discovery and enhance the productivity and effectiveness of the science and engineering workforce COMMITEE STATE M EN T

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. Geoscience research is supported by a number of large-scale research facilities that have been explicitly developed as community resources. Special programs within each of the Divisions of GEO coordinate and support the activities of these facilities as outlined in the Directorate’s Long Range Facilities Plan. The Academic Research Fleet and the Deep Sea Drilling Program supports mulitinstitutional and mulit-disciplinary research throughout the world’s oceans. NCAR supports observational and computational resources for atmospheric and climate research. IRIS and UNAVCO provide permanent and temporary geophysical observatories to collect data for research on the structure and dynamics of the solid Earth. GEO supports a variety of analytical facilities for chemical and physical analyses of water and Earth materials at individual institutions and consortia that are seeing increased use as community resources. The increased use of digital technology is leading to widespread sharing of resources for data collection and database management.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH The LARS programs are not charged specifically with providing shared use facilities, platforms, instruments and databases since these are separately provided through support via the University Corporation for Atmospheric Research (UCAR) and the Lower Atmospheric Observing Facilities Oversite Section (ULAFOS). However, many scientists create databases as a result of their research that are made available to other scientists (and to the public, if appropriate). The Climate Dynamics Program has specifically supported part of the development of the Community Climate System Model (CCSM). This community model is used in support of the scientific international and national assessments and projections of climate change as well as for a wide range of discoveries regarding climate change and variability. It is administered by NCAR, but developed through a community-wide effort involving a large number of University CDP-supported investigators. The Paleoclimate Program support (through ESH) and development of the major international data center for paleoclimatic information. The World Data Center for Paleoclimatology (WDCP) is housed at the National Geophysical Data Center of NOAA at Boulder, Colorado. Data sets include tree-rings, lake core records, ice core records, ocean sediment records and corals, developed in part by NSF-supported researchers who are required to send data developed under NSF sponsorship to the WDC. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES The IF program supports multi-user facilities across a range of activities in the Earth sciences. Fully 70% of IF funding goes for support of these multi-user facilities. For example, the IRIS program, made up of consortium of 96 research universities, with global partners, operates fixed and portable seismometers throughout the world. Data from this network, accessible to any interested party, has been the basis for articles in leading journals in the earth sciences and all science, such as Nature
Advisory Committee for Geosciences FY 2001 Performance Report Assessment 24

and Science. Another network with a global character is the University NAVSTAR consortium (UNAVCO), which operates a network of GPS stations. UNAVCO data were used to demonstrate the applicability of GPS data for determining absolute convergence rates of plates (EAR-9405501). Both IRIS and UNAVCO provide data to the community, including Internet distributed data. Multi-user analytical facilities, such as the University of Arizona AMS facility, are other examples of shared analytical facilities that have led to important discoveries in the earth sciences. IF-supported smaller facilities, such as mass spectrometers, have also been critical in major scientific discoveries in the earth sciences, generating a broad array of publications in leading journals. Although the IF program fiscally constitutes about 25% of the EAR budget, its impact on research activities projects much farther. By funding state-of-the-art instruments and support personnel, this program is the engine driving much of the research in the earth sciences and cosmochemistry, and even some defense sciences. Currently, researchers from all over the world oversubscribe instrumental time on each of the major facilities that are funded by the IF program. Analysis of ancient minerals from Western Australia that are more than 4 billion years old using the shared-use IMS-1270 ion microprobe at the Keck Foundation Center for Isotope Geochemistry at UCLA reveals an ancient ocean. The Center is supported by the Division of Earth Sciences as a national multi-user facility. Other examples A prototype small array of antenna elements has been constructed for testing at SRI in Menlo Park. The tests are to demonstrate the feasibility of constructing a large phased-array incoherent scatter radar that can easily be disassembled and moved to different locations.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

25

Goal 3 - Tools - Indicator 2 Networking and connectivity that take full advantage of the Internet and make SMET information available to all citizens COMMITEE STATE M EN T

The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. As with almost all areas of science and society, the Internet has become an integral part of the fundamental processes of data collection and communication in the Geosciences. The use of the Internet in the collection and distribution of data from global observational systems has been especially significant in the Geosciences. International deployments of seismometers and other geophysical sensors report in real time to centralized data collection centers from which researchers and the public can use the Internet to access the collated data. Similar systems provide for the collection and distribution of atmospheric and oceanographic data from permanent observatories and during temporary cruises and deployments. Internet access, supported by specialized selection, analysis and visualization software, provides scientists, students and the public with access to a rapidly increasing variety of multi-disciplinary datasets.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH There are many projects within LARS that provide results through the Internet. Certainly, the development of weather data that is available over the internet is an outcome of the research previously cited. One particular example that makes use of the Internet, and which was mentioned previously, is the development of the Community Climate System Model (CCSM) through a cooperative University/NCAR venture. Moreover, many of the simulations using this model also take place on the Climate Simulation Laboratory which is a dedicated climate modeling computing facility provided through UCAR and maintained at NCAR. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES Some of the data generated by facilities supported by the IF program, such as seismic data from IRIS and GPS data from UNAVCO, are seamlessly accessible through the Internet. On a smaller scale, some of the data generated by IF supported individual PI's are also accessible remotely, e.g. a database of crystal structures and properties. Other examples Through the WEB100 project, universities, research centers, and some businesses today have connections capable of transmitting data at 100 megabits per second (Mbps) or higher. Research has shown, however, that users rarely see performance greater than 3 Mbps. New WEB100 software, developed jointly by the National Center for Atmospheric Research (NCAR), the Pittsburgh Supercomputing Center, and the National Center for Supercomputing Applications, with funding from NSF, will allow users to take full advantage of available network bandwidth without the help of a networking expert. WEB100 researchers traced the problem of poor performance to software that governs the Transmission Control Protocol (TCP). Networking experts are able to overcome this limit by fine-tuning connections with adjustments to TCP. This type of “middleware” can help us use existing resources more efficiently.
Advisory Committee for Geosciences FY 2001 Performance Report Assessment 26

The GEO Advisory Committee does not consider it appropriate to rate the Directorate on this performance indicator. Although this indicator primarily relates to the activities of other NSF divisions, GEO supports many activities that inform policy makers and lead to more effective decision making. NSF supported projects contribute data and fundamental knowledge to inform significant policy areas such as climate change and global warming; nuclear test ban treaties; and international activities related to the exploration and exploitation of marine resources.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH The Climate Dynamics Program (CDP) and other programs in LARS support scientists who are engaged in the IPCC and U.S. National Assessment programs. The results of both of these assessments are used for policy analyses so that there is effective use of scientific resources. Beyond these scientific assessments with their specific policy-informing goal, there are specific examples of studies that provide policy analyses. One particular example from the Climate Dynamics Program [ATM 9522681] involves an analysis of climate-change abatement policies. Most quantitative studies of climate-change policy attempt to predict a greenhouse-gas reduction plan that will have the optimum balance of long-term costs and benefits. However, it was found that large uncertainties associated with the climate-change problem can make the policy prescriptions of this traditional approach unreliable. An adaptive strategy with mid-course corrections was able to avoid significant errors. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES Although the IF program does not support projects to perform policy analysis, it supports workshops and facilities that lead to greater dissemination of scientific knowledge and could indirectly affect policy analysis. Specific examples include support for the workshop on Mineral Physics and Earth Materials Research (EAR-9907269) and the GERM Workshops (EAR-0000998). Data from IF supported facilities also provide data and information that are used by outside groups in the development of policy decisions, such as the Global Seismographic Network’s contributions in the area of monitoring the Comprehensive Nuclear Test Ban Treaty. Other examples Hydrologic events, such as droughts or flooding of fresh water into saline estuaries, can cause substantial ecological changes on regional scales, and long-term hydrologic and land-use problems can impact life and society. One such environmental problem that has reached critical proportions is the accumulation of selenium in ponds and wetlands receiving irrigation drainage in the semi-arid western U.S. EAR has supported a geochemical investigation leading to a better understanding of the extent to which the selenium comes from sources associated with irrigation, and a way to track the success of remediation programs.
Advisory Committee for Geosciences FY 2001 Performance Report Assessment 27

NCAR researchers have shown that climate plays an important but by no means determining role in the growth of damaging floods in the U. S. in recent decades. Societal changes, much more than increased precipitation, spurred a steep rise in flood-damage costs over much of the past century. U.S. annual flood losses, adjusted for inflation, rose from $1 billion in the 1940s to $5 billion in the 1990s. Researchers in the Center for the Sustainability of semi-Arid Hydrology and Riparian Areas (SAHRA) carry out research within the context of an end-to-end integration of hydrologic issues, going from stresses (e.g. droughts, population growth, land-use change) to development of new knowledge and tools for understanding water and chemical cycles in semi-arid watersheds, to applications by decision makers. Innovative research aimed at managing urban water demand through pricing policies combines targeted surveys and pricing experiments with analysis of water use data that is explicitly linked to demographic data. The resulting disaggregated demand functions reflect the heterogeneity present in urban populations, and point to incentive-compatible pricing menus as a powerful tool to achieve policy goals.

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

28

E. USE OF MERIT REVIEW CRITERIA
1. Goal for Reviewers: NSF performance in implementation of the merit review criteria is successful when reviewers address the elements of both generic review criteria.

2. Goal for Program Officers:
NSF performance in implementation of the merit review criteria is successful when program officers address the elements of both generic review criteria when making their award decisions. CO M MI T EE STATE M EN T The GEO Advisory Committee considers that the GEO Directorate has been successful in meeting this performance indicator. All three divisions within GEO explicitly inform and direct reviewers to use the two merit review criteria. While the application of "criterion one" is well understood and consistently used by the review community, appropriate use of "criterion two" is still evolving. The Advisory Committee feels that GEO staff is making good progress in getting reviewers to consider both review criteria in their evaluations. In their reviews of the past three years of proposal processing, both the LARS and I&F COV reports make note of significant improvement, during the past year, of both reviewers responses and Program Officers attention to criterion two. This appears to result from an explicit effort on the part of the Directorate to insist on implementation of the balance between the two NSF review criteria.

Indicators from Committee of Visitors Reports LOWER ATMOSHPERIC RESEARCH The COV for LARS reviewed 153 proposal actions for FY 1999-2001 and noted that reviewers effectively used review criteria 1 and increasingly are explicitly used criteria 2 during the three-year period. There were differences across the programs reviewed, with the COV finding that in one program “…most of the proposals originating in 2001 do address these broader issues” and in another that “many reviewers did not address or only gave superficial answers to the broader impacts criterion.” In general, however, the COV was positive about the inroads made in reviewer use of criteria 2. Although the Program Officers were also not consistent in addressing the broader impacts of the proposals, it was noteworthy that the most recent Officer very explicitly addressed broader impacts in his highly structured written comments on each proposal. The COV for LARS noted an aspect of merit evaluation that is missing from most reviews is a discussion of past accomplishments resulting from NSF funded research. It seems clear that Program Officers are very aware of PI’s performance, and that they do indeed take past performance into account, when it is problematic. However, it would be good to explicitly include a discussion of these considerations in their review analysis. EARTH SCIENCES - INSTRUMENTATION AND FACILITIES The COV notes that in earlier years the primary emphasis was on the review criteria related to intellectual merit. However, in FY 01, it is abundantly clear that EAR/IF program officers, as well as NSF program officers in general, are working hard to address broader impact criteria. Because the Fastlane review page displays a "broader impact" text box, we have found that nearly all reviewers are addressing this issue to some degree whether the proposal has addressed it or not. Clearly, this

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

29

is an area that has dramatically improved very quickly, and is perhaps one of the unexpected benefits of Fastlane.

IS THE DIRECTORATE/OFFICE POSITIONED WELL TO ATTAIN NSF’S OUTCOME GOALS?
The GEO Directorate’s prospects for continuing to nurture important scientific achievements in the geosciences are excellent. GEO's commitment to a broad spectrum of fundamental science in diverse fields across the geosciences is expected to continue to pay rich dividends in terms of scientific discovery. The GEO-2000 report provides an exciting vision of a future in which NSF and the research activities of the GEO Directorate play a leading role in ensuring a habitable future for our planet. The Directorate is taking appropriate steps to implement that vision, including support for continuing initiatives such as Biocomplexity In The Environment (BE), Nanoscience and Engineering (NSE), and ITR, as well as planning for new science infrastructure and research in areas such as water cycle science. BE enables a rich, interdisciplinary approach to understanding the processes that control habitability of the Earth. NSE is at the cutting edge of the nanotechnology revolution for which Earth science can play a diversifying role. ITR is stimulating and bringing advances in computational science to bear on geoscience questions, and enabling significant new research in areas such as data assimilation. GEO-2000 recognizes that significant improvements in research infrastructure, as well as new research directions are critical for continued advances in geosciences. Prospects for enhanced linkages between geoscience research and applications in service to society are excellent. GEO works hard to ensure that results from research are migrated quickly into venues where others can utilize them for a variety of purposes. The Report of the COV for LARS makes it clear that the GEO Directorate and its supported projects have been very successful in developing partnerships with national and international mission agencies that optimize the transition from discovery to practice, especially in areas of climate modeling, hazard assessment and environmental monitoring. Examples such as the VORTEX program or the WEB100 project are expected to catalyze the discovery of new knowledge and technology that will be of direct benefit to society. The NSF science and technology center for the Sustainability of semiarid Hydrology and Riparian Areas (SAHRA) is playing an important role in bringing new knowledge to bear on water resources decision making in the Southwestern U.S. and other semi-arid regions. AC/GEO is confident that continued perseverance will result in a continued high level of performance with respect to this goal. The GEO Directorate encourages a broad, effective effort to use geoscience as a vehicle to improve the mathematics and science skills of all Americans. There is a strong, collaborative relationship between GEO and the EHR Directorate. This rapport helped to initiate the Digital Library for Earth System Education (DLESE), supported through both GEO and EHR/DUE, and seems likely to foster valuable cross-directorate efforts in the future. There is also a strong commitment to improving the diversity of the U.S. geoscience workforce. The synergism with of the diversity and educational efforts appears to a significant potential to accomplish this goal. Building on the widespread public interest in the Earth, its structure, evolution and dynamics, GEO is encouraging new and emerging programs to introduce a broad cross-section of Americans to the geosciences and the scientific process. Among the NSF Research Directorates, GEO has established a clear leadership role in education and human resources, by developing a successful education program within the Directorate (“Awards to Facilitate Geoscience Education”), by developing a diversity initiative within the Directorate (“Opportunities for Enhancing Diversity in the Geosciences”), and by sponsoring catalytic workshops at which large segments of the geoscience community have come together to methodically plan for the future of education in our field (for example, the “Portals to

Advisory Committee for Geosciences

FY 2001 Performance Report Assessment

30

the Future” workshop that laid the groundwork for the Digital Library for Earth System Education; the workshop on “Center for Ocean Sciences Education Excellence.”)