Sheepy
"[B]egin upon the precept ... that the things we see are to be weighed in the scale with what we know" (Meredith, The Egoist, 1879, project Gutenberg)
Research Current projects Donkeys! Risk Publications Recent Statistics & probability Other science Economics & finance Books and book chapters Other Teaching Financial Risk Management Miscellaneous Presentations Software SUYS
Contact:
School of Mathematics,
University of Bristol,
University Walk,
Bristol BS8 1TW

tel: +44 (0)117 9287782
fax: +44 (0)117 9287999
j.c.rougier@bristol.ac.uk

Find me:
Room 4.12, left out of the lift on the fourth floor of the main Maths building.

Treat me:
Coffee and (vegan) cake at Cafe Kino, now on Stokes Croft.

Whaley

Jonathan (Jonty) Rougier's homepage

I no longer work at the University, although I am an honorary Professor in the School of Mathematics. I am now working as an independent scientist, more details at rougierconsulting.com.

This page is no longer being updated.

Prof Peter Diggle's recent definition of Statistical Science:

"the intellectual engagement of statisticians with subject matter experts to advance our understanding of nature in its broadest sense"
(2015 Presidential Address, J.R. Statist. Soc A, 178(4), pp793-813).

Current roles:

Research/Activities

I do science in areas of high uncertainty. Here are my main research/activity areas.

  • Risk assessment for low-probability high-impact events. This is Small Complicated Data: it is crucial to recognize and treat selective missingness in our historical records of events, both natural and man-made.

  • Spatial statistics at global scale. This is Big Complicated Data, where the challenge is to find a good compromise between what we can compute, and what we would like to compute, and then compute it.

  • Statistical inference and prediction. I have found that—as a practising statistician—it is important to have a sound grasp of the theoretical and philosophical fundamentals of Statistics, and also of the history of our subject.

  • Statistical consulting. For fellow scientists, and a range of public, private, and third sector organizations. How to work with organisations to add value through data is a very interesting question.

Some current projects

  1. VOLCORE: Analysing ice and ocean cores to study global volcanism on long timescales. Funded by the Leverhulme Trust, PI Prof Steve Sparks. 2015-2019.

  2. GlobalMass: ERC award to Prof Jonathan Bamber. A data-driven approach to assessing global sea-level rise. 2016-2020. GlobalMass webpage

  3. SWEET: NERC large grant, PI Dan Lunt. Reconstructing the warmth and drivers of the early Eocene, and using this recondstruction to test a state-of-the-art climate model. 2017-2021. SWEET webpage

Exciting book!

   J.C. Rougier, R.S.J. Sparks, and L.J. Hill (eds), 2013, Risk and Uncertainty Assessment for Natural Hazards, Cambridge, UK: Cambridge University Press.

"This is an invaluable compendium for academic researchers and professionals working in the fields of natural hazards science, risk assessment and management and environmental science and will be of interest to anyone involved in natural hazards policy." I wrote that :)

Back to the top

Publications

Back to the top

I have organised my publications under several headings.

Recent (since 2018)

J.C. Rougier (2019). Confidence in risk assessments. Journal of the Royal Statistical Society, Ser. A, 182(3), 1081-1095. doi:10.1111/rssa.12445

J.C. Rougier (2019). P-values, Bayes factors, and sufficiency, The American Statistician, 73, supp1. doi:10.1080/00031305.2018.1502684. Part of the special issue Statistical Inference in the 21st Century: A World Beyond p < 0.05.

Z. Sha, J.C. Rougier, M. Schumacher, and J.L. Bamber (2019). Bayesian model-data synthesis with an application to global Glacio-Isostatic Adjustment, Environmetrics, 30(1), e2530. doi:10.1002/env.2530

L. Hawker, P. Bates, J. Neal, J.C. Rougier (2018). Perspectives on Digital Elevation Model (DEM) simulation for flood modelling in the absence of a high-accuracy open access global DEM. Frontiers in Earth Science, 6. doi:10.3389/feart.2018.00233

A. Zammit Mangion and J.C. Rougier (2018). A sparse linear algebra algorithm for fast computation of prediction variances with Gaussian Markov random fields, Computational Statistics and Data Analysis, 123, 116-130. doi:10.1016/j.csda.2018.02.001

L. Hawker, J.C. Rougier, J. Neal, P. Bates, L. Archer, and D. Yamazaki (2018). Implications of simulating global digital elevation models for flood inundation studies, Water Resources Research, 54(10), 7910-7928. doi:10.1029/2018WR023279

J.C. Rougier (2018). Comment on "Ensemble averaging and the curse of dimensionality", Journal of Climate, 31, 9015-9016. doi:10.1175/JCLI-D-18-0274.1. Author's response: 10.1175/JCLI-D-18-0416.1.

M. Schumacher, M. King, J.C. Rougier, Z. Sha, S.A. Khan, and J. Bamber (2018), A new global GPS dataset for testing and improving modelled GIA uplift rates, Geophysical Journal International, 214(3), 2164-2176. doi:10.1093/gji/ggy235

L.M. Western, J.C. Rougier, and I.M. Watson (2018), Decision theory-based detection of atmospheric natural hazards from satellite imagery using the example of volcanic ash. Quarterly Journal of the Royal Meteorological Society, 144, 581-587. doi:10.1002/qj.3230

J.C. Rougier, R.S.J. Sparks, and K.V. Cashman (2018), Regional and global under-recording of large explosive eruptions in the last 1000 years, Journal of Applied Volcanology, 7:1, doi:10.1186/s13617-017-0070-9

J.C. Rougier, R.S.J. Sparks, K.V. Cashman, and S.K. Brown (2018), The global magnitude-frequency relationship for large explosive volcanic eruptions, Earth and Planetary Science Letters, 482, 621-629. doi:10.1016/j.epsl.2017.11.015. Read the press release. Summary in LMS newsletter, pp27-31.

Older Statistics and Probability

I. Gollini and J.C. Rougier (2016). Rapidly bounding the exceedance probabilities of high aggregate losses. Journal of Operational Risk, 11(3), 97-116. doi:10.21314/JOP.2016.179

J.C. Rougier and A. Zammit Mangion (2016). Visualisation for large-scale Gaussian updates. Scandinavian Journal of Statistics, 43(4), 1153-1161. doi:10.1111/sjos.12234

A. Zammit Mangion, J.C. Rougier, N.W. Schoen, F. Lindgren, J.L. Bamber (2015). Multivariate spatio-temporal modelling for assessing Antarctica's present-day contribution to sea-level rise. Environmetrics, 26(3), 159-177. doi:10.1002/env.2323

J.C. Rougier and M. Goldstein (2014), Climate Simulators and Climate Projections, Annual Review of Statistics and Its Application, 1, 103-123. doi:10.1146/annurev-statistics-022513-115652

A. Zammit Mangion, J.C. Rougier, J.L. Bamber and N.W. Schoen (2014), Resolving the Antarctic contribution to sea-level rise: a hierarchical modelling framework, Environmetrics, 25(4), 245-264. doi:10.1002/env.2247

J.C. Rougier, M. Goldstein, and L. House (2013), Second-order exchangeability analysis for multi-model ensembles, Journal of the American Statistical Association, 108, 852-863. doi:10.1080/01621459.2013.802963

I. Scheel, P.J. Green, and J.C. Rougier (2011), A graphical diagnostic for identifying influential model choices in Bayesian hierarchical models, Scandinavian Journal of Statistics, 38(3), 529-550. doi:10.1111/j.1467-9469.2010.00717.x

J.C. Rougier (2010), Discussion of "A statistical analysis of multiple temperature proxies: Are reconstructions of surface temperatures over the last 1000 years reliable?" by McShane and Wyner, Annals of Applied Statistics, 5(1), 96-98. doi:10.1214/10-AOAS409

J.C. Rougier and M. Kern (2010), Predicting Snow Velocity in Large Chute Flows Under Different Environmental Conditions. Applied Statistics, 59(5), 737-760. doi:10.1111/j.1467-9876.2010.00717.x

J.C. Rougier, S. Guillas, A. Maute, A.D. Richmond (2009), Expert Knowledge and Multivariate Emulation: The Thermosphere-Ionosphere Electrodynamics General Circulation Model (TIE-GCM), Technometrics, 51(4), 414-424. doi:10.1198/TECH.2009.07123

M. Goldstein and J.C. Rougier (2009), Reified Bayesian Modelling and Inference for Physical Systems, Journal of Statistical Planning and Inference, 139(3), 1221-1239. doi:10.1016/j.jspi.2008.07.019 With discussion and rejoinder.

J.C. Rougier (2008), Efficient Emulators for Multivariate Deterministic Functions, Journal of Computational and Graphical Statistics, 17(4), 827-843. doi:10.1198/106186008X384032. R package OPE_0.8.tar.gz.

J.C. Rougier (2008), Discussion of 'Inferring Climate System Properties Using a Computer Model', by Sanso et al, Bayesian Analysis, 3(1), 45-56. doi:10.1214/08-BA301B

M. Goldstein and J.C. Rougier (2006), Bayes Linear Calibrated Prediction for Complex Systems, Journal of the American Statistical Association, 101 (no. 475), 1132-1143.

M. Goldstein and J.C. Rougier (2004), Probabilistic Formulations for Transferring Inferences from Mathematical Models to Physical Systems, SIAM Journal on Scientific Computing, 26(2), 467-487. doi:/10.1137/S106482750342670X

I. MacPhee, J.C. Rougier and G. Pollard (2004), Server Advantage in Tennis Matches, Journal of Applied Probability, 41(4), 1182-1186.

J.C. Rougier and M. Goldstein (2001), A Bayesian Analysis of Fluid Flow in Pipelines, Applied Statistics, 50(1), 77-93.

P.S. Craig, M. Goldstein, J.C. Rougier and A.H. Seheult (2001), Bayesian Forecasting for Complex Systems Using Computer Simulators, Journal of the American Statistical Association, 96, 717-729.

Older other science

T. Economou, D. Stephenson, J.C. Rougier, K. Mylne, and R. Neal (2016), On the use of Bayesian decision theory for issuing natural hazard warnings, Proceedings of the Royal Society, Series A, 472, 20160295, 19 pages. doi:10.1098/rspa.2016.0295

J.C. Rougier (2016), Ensemble averaging and mean squared error. Journal of Climate, 29, 8865-8870. doi:10.1175/JCLI-D-16-0012.1

J.C. Rougier, S. Sparks, and K. Cashman (2016), Global recording rates for large eruptions, Journal of Applied Volcanology, 5:11, 10 pages. doi:10.1186/s13617-016-0051-4

F. Pianosi, K. Beven. J. Freer, J.W. Hall, J.C. Rougier, D.B. Stephenson, and T. Wagener (2016), Sensitivity analysis of environmental models: A systematic review with practical workflow, Environmental Modelling and Software, 79, 214-232. doi:10.1016/j.envsoft.2016.02.008

M. Woodhouse, A. Hogg, J. Phillips, and J.C. Rougier (2015), Uncertainty analysis of a model of wind-blown volcanic plumes, Bulletin of Volcanology, October 77:83, 28 pages, doi:10.1007/s00445-015-0959-2

N. Schoen, A. Zammit-Mangion, J.C. Rougier, T. Flament, F. Rémy, S. Luthcke, and J.L. Bamber (2015), Simultaneous solution for mass trends on the West Antarctic Ice Sheet, The Cryosphere, 9, 805-819. doi:10.5194/tc-9-805-2015

A. Zammit Mangion, J.L. Bamber, N. Schoen, and J.C. Rougier (2015), A data-driven approach for assessing ice-sheet mass balance in space and time, Annals of Glaciology, 56, 175-183. doi:10.3189/2015AoG70A021

J.C. Rougier (2013), 'Intractable and unsolved': some thoughts on statistical data assimilation with uncertain static parameters, Phil. Trans R. Soc. A., 371, doi:10.1098/rsta.2012.0297

D.B. Stephenson, M. Collins, J.C. Rougier, and R.E. Chandler (2012), Statistical problems in the probabilistic prediction of climate change, Environmetrics, 23(5), 364-372. doi: 10.1002/env.2153

M. Collins, R.E. Chandler, P.M. Cox, J.M. Huthnance, J.C. Rougier, and D.B. Stephenson (2012), Quantifying future climate change, Nature Climate Change, 2, 403-409. doi:10.1038/nclimate1414

R.M. Gladstone, V. Lee, J.C. Rougier, A.J. Payne, H. Hellmer, A. Le Brocq, A. Shepherd, T.L. Edwards, J. Gregory, and S.L. Cornford (2012), Calibrated prediction of Pine Island Glacier retreat during the 21st and 22nd centuries with a coupled flowline model, Earth and Planetary Science Letters, 333-334, 191-199. doi:10.1016/j.epsl.2012.04.022

P.W. Fitzgerald, J.L. Bamber, J. Ridley and J.C. Rougier (2011), Exploration of parametric uncertainty in a Surface Mass Balance Model applied to the Greenland Ice Sheet, Journal of Geophysical Research, 117, F01021, doi:10.1029/2011JF002067

N.R. Edwards, D. Cameron, J.C. Rougier (2011), Precalibrating an intermediate complexity climate model, Climate Dynamics, 37, 1469-1482.

S. Guillas, J.C. Rougier, A. Maute, A.D. Richmond, and C.D. Linkletter (2009), Bayesian calibration of the Thermosphere-Ionosphere Electrodynamics General Circulation Model (TIE-GCM), Geoscientific Model Development, 2, 137-144. Available online.

M. Crucifix and J.C. Rougier (2009), On the use of simple dynamical systems for climate predictions: A Bayesian prediction of the next glacial inception. The European Physics Journal - Special Topics, 174(1), 11-31. doi:10.1140/epjst/e2009-01087-5

J.C. Rougier, D.M.H. Sexton, J.M. Murphy, and D. Stainforth (2009), Analysing the climate sensitivity of the HadSM3 climate model using ensembles from different but related experiments. Journal of Climate, 22(13), 3540-3557. doi:10.1175/2008JCLI2533.1

J.C. Rougier and D.M.H. Sexton (2007), Inference in Ensemble Experiments, Philosophical Transactions of the Royal Society, Series A, 365, 2133-2143. doi:10.1098/rsta.2007.2071

J.C. Rougier (2007), Probabilistic Inference for Future Climate Using an Ensemble of Climate Model Evaluations, Climatic Change, 81, 247-264. doi:10.1007/s10584-006-9156-9

J.C Rougier (2005), Probabilistic Leak Detection in Pipelines Using the Mass Imbalance Approach. Journal of Hydraulic Research, 43(5), 556-566.

M. van Oijen, J.C. Rougier and R. Smith (2005), Bayesian Calibration of Process-Based Forest Models: Bridging the Gap Between Models and Data, Tree Physiology, 25, 915-927.

Economics and Finance

S.C. Parker and J.C. Rougier (2007), The Retirement Behaviour of the Self-Employed in Britain, Applied Economics, 39(6), 697-713.

P.R. Holmes and J.C. Rougier (2005), Trading Volume and Contract Rollover in Futures Contracts, Journal of Empirical Finance, 12(2), 317-338.

S.C. Parker and J.C. Rougier (2001), Measuring Social Mobility as Unpredictability, Economica, 68, 63-76.

B. Hillier and J.C. Rougier (1999), Real Business Cycles, Investment Finance and Multiple Equilibria, Journal of Economic Theory, 86, 100-22.

J.C. Rougier (1997), A Simple Necessary Condition for Negativity in the Almost Ideal Demand System with the Stone Price Index, Applied Economics Letters, 4, 97-9.

J.C. Rougier (1996), An Optimal Price Index for Stock Index Futures Contracts, Journal of Futures Markets, 16, 189-99.

J.C. Rougier (1993), The Impact of Margin-Traders on the Distribution of Daily Stock Returns: The London Stock Exchange, Applied Financial Economics, 3, 325-8.

Books and book chapters

J.C. Rougier and M. Crucifix (2017), Uncertainty in climate science and climate policy, in L. Lloyd and E. Winsberg, eds, Climate Modeling: Philosophical and Conceptual Issues, Palgrave Macmillan, chapter 12, pages 361-380.

J.C Rougier (2014), Formal Bayes methods for model calibration with uncertainty, in K. Beven and J. Hall (eds), Applied Uncertainty Analysis for Flood Risk Management, Imperial College Press, chapter 5, pages 68-86.

J.C. Rougier, R.S.J. Sparks, and L.J. Hill (eds), 2013, Risk and Uncertainty Assessment for Natural Hazards, Cambridge, UK: Cambridge University Press.

  • L.J. Hill, R.S.J. Sparks, and J.C. Rougier, Risk assessment and uncertainty in natural hazards, ch 1, pp 1-18.
  • J.C. Rougier, Quantifying hazard losses, ch 2, pp 19-39.
  • J.C. Rougier and K.J. Beven, Model and data limitations: the sources and implications of epistemic uncertainty, ch 3, pp 40-63.

Non-peer-reviewed

K. Milner and J.C. Rougier (2014), "How to weigh a donkey in the Kenyan countryside", Significance, 11(4), 40-43. doi:10.1111/j.1740-9713.2014.00768.x

J. Murphy, R. Clark, M. Collins, C. Jackson, M. Rodwell, J.C. Rougier, B. Sanderson, D. Sexton and T. Yokohata (2011), Perturbed parameter ensembles as a tool for sampling model uncertainties and making climate projections, Proceedings of ECMWF Workshop on Model Uncertainty, 20-24 June 2011, 183-208. Available online.

J.C. Rougier, T.L. Edwards, M. Collins and D.M.H. Sexton (2011), Low-noise projections of complex simulator output: A useful tool when checking for code errors, Proceedings of ECMWF Workshop on Model Uncertainty, 20-24 June 2011, 209-220. Available online.

J.C. Rougier and L. Chen (2010), Comment on the paper by Diggle et al., Journal of the Royal Statistical Society, Series C, 59(2), 216.

R. Chandler, J.C. Rougier, and M. Collins (2010), Climate change, Significance, 7(1), 9-12.

J.C. Rougier (2009), Notes on statistical modelling for complex systems, ver. 0.5, unpublished. Available as a pdf file. Please note the version number: this document is still evolving.

J.C. Rougier (2008), Climate change detection and attribution, ISBA bulletin, 15(4), 3-6. Available on-line.

J.C. Rougier (2006), Comment on the paper by Haslett et al., Journal of the Royal Statistical Society, Series A, 169(3), 432-433.

J.C. Rougier (2005), Literate Programming for Creating and Maintaining Packages. R News, 5(1), 35-39.

J.C. Rougier (2004), Comment on the paper by Murphy et al. Nature did not want to publish this comment, but I think it says some useful things. Available as a pdf file.

J.C. Rougier (2001), Comment on the paper by Kennedy and O'Hagan, Journal of the Royal Statistical Society, Series B, 63, page 453.

J.C. Rougier (2001), What's the Point of `tensor'?, R News, 1(2), 26-27.

Back to the top

Miscellaneous

Selected presentations (since 2009)

  • Weather, climate, and climate simulations, Inuagural lecture 29 Feb 2016. Slides available (I made a minor change for clarity). Here is a recording.

  • Modelling the eruption processes of a large number of similar but not identical volcanoes, OxWaSP Seminar on Applied Bayesian Analysis, Warwick Jan 2015. Slides available. This is still work in progress.

  • Ensembles in weather forecasting and climate projection, Advances In Climate Theory, Brussels, Aug 2014.

  • Server advantages in tennis matches, Iain MacPhee day, Durham, April 2014. Slides available. This is a blackboard presentation of MacPhee et al, 2004.

  • "Intractable and unsolved": the challenge of data assimilation with uncertain static parameters, Intractability workshop, Bristol, April 2012. Slides available. This is really a talk about long-time-scale palaeoclimate reconstruction.

  • Nomograms for visualising relationships between three variables, UseR! 2011 invited talk. Slides available. Here is some beta code for producing the parallel scale nomograms used in the talk: parallelNomo.R. This is the picture you should get if you run the example: nomogramBMI.pdf.

    After the discussion at UseR! 2011 I appreciated that I had an extra degree of freedom, which I could use to set the righthand axis so that the typical donkey had a horizontal line on the nomogram. Then I put all the donkeys' lines on the plot, and finished it off with a couple of density functions, original and predicted. The results is not exactly 'less is more': donkDensity_19Aug.pdf.

    After seeing that line at the top of the 'not less is more' nomogram heading off to surprising lengths I created a parallel coordinate plot of the donkey data, using parallelCoord.R, which resulted in parallelCoord_26Aug.pdf. As Kate Milner noted, "that is an exceptionally long donkey" (128cm). And in fact she checked her notebooks and this length had been misrecorded: it was in fact 102cm. And what's the UseR! connection? it was over a beer at the mixer that David Nicolaides made me understand the value of this plot for screening.

  • Multivariate emulation for North American mid-Holocene temperature reconstructions, MPI-M, Hamburg, Mar 2011. Slides available. This is a longer version of the talk given at the Liverpool Marine Symposium, with a stronger focus on emulating large climate simulators (HadCM3, in our case). Note that the reconstruction at the end is purely illustrative.

  • Calibration and hypothesis testing for a model of avalanche behaviour, IHRR, Durham, Jan 2011. Slides available. Please note that this is a preliminary analysis and we are currently investigating a more sophisticated statistical model for the relationship between the HB parameters and the measurements.

  • Inference using large climate simulators: HadCM3 and North American Mid-Holocene temperature anomalies, Liverpool Marine Symposium, Jan 2011. Slides available. The slides for the talk at the MPI-M (Mar 2011) are more detailed.

  • Accounting for the limitations of quantitative models, SECaM, Exeter, Jan 2011. Slides available.

  • Stochastic dynamical modelling in Environmental Science, AMSTAT, Warwick, Oct 2010. See the slides for the Exeter Jan 2011 seminar.

  • What can pollen tell us about palaeo-climate?, ICAS, Leeds, Oct 2010. Slides available (more detailed).

  • Is Building Bigger and 'Better' Climate Change Models a Poor Investment?, CRASSH conference, Clare College Cambridge, 29 Sep 2010. text available, I was proposing the motion. Watch the debate.

  • Probabilistic frameworks, INI CLP workshop on probabilistic climate prediction, Exeter, Sep 2010. See the slide! Watch the presentation (multiple formats).

  • A new statistical framework for analysing multi-model ensembles, IMS 2010, Gothenburg, Aug 2010. Slides available.

  • A new statistical framework for analysing multi-model ensembles, 11th IMSC, Edinburgh, July 2010. Slides available.

  • What can pollen tell us about palaeo-biomes?, 11th IMSC, Edinburgh, July 2010. See the slides for the ICAS Oct 2010 seminar.

  • Assessing model limitations, Governing Through Uncertainty meeting, Bristol, May 2010. Slides available.

  • Complex systems: Accounting for model limitations, Research Students' Conference 2010, Warwick, April 2010. slides available.

  • Complex systems: Accounting for model limitations, St Andrews, Mar 2010. slides available.

  • Model limitations: Sequential data assimilation with uncertain static parameters, Edinburgh, Mar 2010. Slides available.

  • Uncertainty and risk in natural hazards, Nottingham, Nov 2009. Slides available.

  • Introduction to computer experiments, and the challenges of expensive models, RSS Statistical Computing Section, Bath, October 2009. Slides available.

  • Quantifying uncertainty in probability of exceedence (PE) curves, NERC/KTN workshop on Catastrophe modelling for natural hazard impact, Lloyd's, London, Oct 2009. Slides available and also R code for the pictures.

  • Emulator-based simulator calibration for high-dimensional data, JCGS session, JSM-2009, Washington DC, Aug 2009. Slides available.

  • The What, Why, and How of Multivariate Emulation, Spring Research Conference On Statistics in Industry and Technology, Vancouver, May 2009. Slides available.

  • Simple models for glacial cycles, Bath Institute for Complex Systems, Feb 2009. Slides available.

Software

R packages

  • calibrater. A package of useful functions for calibrating a computer simulator. (Used to be 'calibrate'.)
  • paranomo. Draw parallel-scale nomograms. Also contains the 'donkeys' dataset (see Donkeys).
  • slice. General purpose adaptive slice sampling, also contains mvqqplot, a multivariate qqplot function.

Other resources

Donkeys!

Joint work with Kate Milner.

Donkeys are extremely hard to weigh, but easy to measure with a measuring tape. Because weight is a important factor in health and in veterinary care, statistical models are used to predict weight on the basis of measured hearth girth and height. The Donkey Sanctuary sponsored Kate Milner to go to Kenya with a large weighing scales and collect data on donkeys. Together we are analysing the results, with the intention of producing an improved 'nomogram' (or similar) showing how to predict a Kenyan donkey's weight on the basis of its height and heart girth, and also age and condition.

Resources:


Setting Up Your Simulator

Setting Up Your Simulator (SUYS) is my procedure for the early stages of developing a computer simulator for a complicated system. Here is a the Abstract from the current draft.
"The parameters of a computer simulator are often poorly defined, and their ranges for a particular application can be mysterious. But the negative consequences of getting these ranges wrong, either too small or too large, endure through all subsequent uses. So 'setting-up', by which I mean the process of adjusting the individual ranges in the light of a few carefully-chosen observations, is a crucial first step. Happily there is a relatively straightforward process for setting-up, based on the notion of 'implausibility', and making use of simple calculations and visualisations. This process works much better if the analyst is able to proceed sequentially, through several waves of runs. The paper also considers the extension of this process to different types of simulator: simulators with large fields of parameters, stochastic simulators, and expensive-to-run simulators."

Back to the top

"The way you live today is the way you live your life."