Transcript

2.
ASQ
Reliability
Division
English
Webinar
Series
One
of
the
monthly
webinars
on
topics
of
interest
to
reliability
engineers.
To
view
recorded
webinar
(available
to
ASQ
Reliability
Division
members
only)
visit
asq.org/reliability
To
sign
up
for
the
free
and
available
to
anyone
live
webinars
visit
reliabilitycalendar.org
and
select
English
Webinars
to
ﬁnd
links
to
register
for
upcoming
events
hGp://reliabilitycalendar.org/
webinars/

5.
| Los Alamos National Laboratory |
Focus on ReliabilityFocus on Reliability
 Definition of reliability:Definition of reliability:
“the probability that a system will continue to
perform its intended functions until a specified
point in time under encountered use conditions.”
Define boundaries of system
(peripherals, human interface)
Often exposure to
environmental conditions
Multiuse systems may have different
thresholds for working (most severe,
typical)
environmental conditions
may impact reliability
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 3
yp )

6.
| Los Alamos National Laboratory |
Individual vs Population Reliability
ility
ability
ystemReliabi
pulationReli
Age (months) Time into future (months)
Sy
Po
 Individual System Summary (IndRel): For a given
system with specified age, what is its reliability?
 Population Aggregate Summary (PopRel): For a Population Aggregate Summary (PopRel): For a
population of systems (each with possibly different
ages), what is the probability that a randomly chosen
system will work at the current or some future time?
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 4
system will work at the current or some future time?

7.
| Los Alamos National Laboratory |
Two Different SummariesTwo Different Summaries
 Relevance
– IndRel: for managing individual units, perhaps to
remo e them from the pop lation if the become tooremove them from the population if they become too
unreliable, or to send them in for scheduled
maintenance.
– PopRel: for managing the population and require aPopRel: for managing the population and require a
given performance level across the population at this or
some future points in time.
 Information needed
– Summary of results from testing various systems (both)
– An appropriate statistical model for the reliability given
age (both)
lplus
– the age demographics of the population of interest at
the current time (PopRel)
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 5

8.
| Los Alamos National Laboratory |
Calculation of PopRel
IndRelIndRel
Age
Demographics
ReliabilitySystem
For an individual system we
Age (months) Age (months)
For an individual system, we
can predict its reliability now
and into the future given its
current age
onReliability
Time into future (months)
Populatio
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 6
Time into future (months)

9.
| Los Alamos National Laboratory |
Calculation of PopRel (cont’d)
IndRelIndRel
Age
Demographics
ReliabilitySystem
Age (months) Age (months)
abilitySystemRelia
For each system in the population, we can determine its predicted
li bilit b d it t
Time into future (months) Time into future (months) Time into future (months)
S
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 7
reliability based on its current age

10.
| Los Alamos National Laboratory |
Calculation of PopRel (cont’d)Calculation of PopRel (cont d)
iabilitySystemReli
Now we use the estimates of all the individual predicted reliabilities to determine
Time into future (months) Time into future (months) Time into future (months)
PopRel
the overall reliability of the population
ReliabilityPopulation
Time into future (months)
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 8
Note: this could be calculated for any sub-population
Time into future (months)

11.
| Los Alamos National Laboratory |
Reliability summary questionsReliability summary questions
IndRel: For a given system with specified, what is its reliability?
PopRel: For a population of systems (each with possibly different ages),p p p y ( p y g )
what is the probability that a randomly chosen system will work at a
given point in time? Or what fraction of the parts will work at a given
point in time?
Questions: Which summary is more of interest,
1. If you own a single item? IndRely g
2. If you are own a collection of items used by your department?
3. If you work on maintaining the systems?
4 If id i h i t t l t h t
IndRel
PopRel
IndRel or PopRel
4. If you are considering purchasing new systems to supplement what
is currently available? PopRel
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 9

16.
| Los Alamos National Laboratory |
Population Reliability ResultsPopulation Reliability Results
ncy
PopRel
nReliability
Frequen
Population
Age (hours)
Time into future (hours)
Reliability
IndRel
Could we have predicted this poor
population reliability? SystemR
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 14
Age (hours)

17.
| Los Alamos National Laboratory |
Answering Questions – IndRel or PopRel
1. For a unit that is 100 hours old, what is the
probability that it will work?
2. What is the probability that a random unit will work
?now?
3 What is the probability of the unit I currently have3. What is the probability of the unit I currently have
working when I turn it on?
4. My team has 5 units which we use regularly. What
is the probability that a random unit from there will
k?
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 15
work?

18.
| Los Alamos National Laboratory |
PopRel for More Complex PopulationPopRel for More Complex Population
Overall
abilityPopulationRelia
Time into future (hours)
Model 1 Model 2 Model 3
Reliability
nReliability
nReliability
Population
Population
Population
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 16
Time into future (hours) Time into future (hours) Time into future (hours)

19.
| Los Alamos National Laboratory |
Frequentist Options for EstimationFrequentist Options for Estimation
 Estimate λ,β (and their covariance matrix) using
maximum likelihood
 IndRel: From this confidence intervals for reliability
are possible at all ages of the system
 PopRel:
a. Generate M draws from the bivariate normal
di t ib ti th d t bt i Mdistribution, use these draws to obtain M
estimates of λ,β and use to build an empirical
C.I. for PopRelp
b. Sample with replacement from the original data,
use this to obtain M estimates of λ,β ….
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 17

23.
| Los Alamos National Laboratory |
Modeling Reliability as a Function of Age
d Oth I f ti (U E )and Other Information (Usage or Exposure)
 For Example 2, reliability was estimated as a
function of the age of the systemfunction of the age of the system
– If a system is x months old today, then in a month
it will be (x+1) months old
 But what if reliability is a function of age and usage?
(eg. car reliability typically modeled with age and
mileage)mileage)
– If a car is 24 months old and has gone 30000
miles, what will these values be in 1 month?
– Historical usage pattern can be helpful for
prediction, but will introduce some additional
variability
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 21
variability.

28.
| Los Alamos National Laboratory |
PopRel for Missile population
Used historical
usage information
from both testedfrom both tested
samples and current
population
onReliabilityPopulatio
PopRel (assuming continued
same pattern of usage for
overall population)
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 26
Time into future (months)
p p )

29.
| Los Alamos National Laboratory |
Conclusions
 Understanding which summary is appropriate to answer which
question is key to good decision-making
– IndRel answers “For a given system with specified age (and
) h i i li bili ?usage), what is its reliability?
– PopRel answers “For a population of systems, what is the
probability that a randomly chosen system will work at the
current or some future time?current or some future time?
 What is needed?
– Summary of results from testing various systems [both]
A statistical model for the reliability given age and usage [both]– A statistical model for the reliability given age and usage [both]
plus
– The age (and usage) demographics of the population at the current
time [PopRel]
 Predicting the age of systems into the future is straightforward, but
additional assumptions about future usage of units in the population are
needed to obtain a sensible PopRel estimate
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 27

30.
| Los Alamos National Laboratory |
ReferencesReferences
1. Lu, L., Anderson-Cook, C.M. (2011) “Prediction of, , , ( )
Reliability of an Arbitrary System from a Finite
Population” Quality Engineering 23 71-83.
2. Lu, L., Anderson-Cook, C.M. (2011) “Using Age and
Usage for Prediction of Reliability of an ArbitraryUsage for Prediction of Reliability of an Arbitrary
System from a Finite Population” Quality and
Reliability Engineering International 27 179-190.
Operated by Los Alamos National Security, LLC for the U.S. Department of Energy's NNSA
UNCLASSIFIED
July 2013 | UNCLASSIFIED | 28