Empirical Investigation on the Effect of the Number of Resamplings on the Distribution of Bootstrap Standard Error Using Response Time Data
Asian Journal of Probability and Statistics,
Page 220-230
DOI:
10.9734/ajpas/2022/v20i4451
Abstract
Aims: To investigate how the number of bootstrapping B affects the values returned by the bootstrap standard error of the arithmetic mean and the α-trimmed mean of response data using bootstrap confidence intervals (CI) at 95% level; carried out to fill up observed gap for study on standard error, the tool generally employed in assessing the long run accuracy of a given statistical estimator of θ.
Study Design: This was a parametric, empirical bootstrap simulation study.
Place and Duration of the Study: Departments of Computer Science and Statistics, Federal Polytechnic Oko, 2020/2021 session.
Methodology: Response time data were generated with student customers of mobile telephone network (mtn) Nigeria and stored in SPSS. A sample n = 51 responses was selected using “Select Cases” command to increase precision and minimize bias. Bootstrap simulation study was carried out using R programming language. Four approaches for estimating bootstrap confidence intervals were used. The interval coverage and the interval lengths were determined and compared for B = 20, 50, 100, 500, 1000, 5000, and 10000.
Results: The 95% CI for 0.2266338 (the estimated sample standard error of 10% trimmed mean) returned the best interval for our skewed data set; when B = 20; the CI for returned (0.2051, 0.2343) for the normal approach, (0.2082, 0.2371) for the basic, (0.2071, 0.2360) for the percentile and (0.2071, 0.2360) for the BCa method. As B increased to 5000, it returned (0.2259, 0.2277) for the normal approach, (0.2259, 0.2277) for the basic, (0.2260, 0.2277) for the percentile and (0.2261, 0.2279) for the BCa showing a shorter interval yet covering the estimate.
Conclusion: Thus for our response data study, increasing B in estimating standard error increases the chances of more precise and shorter confidence intervals rather than the chances for coverage.
Keywords:
- Bootstrap
- standard error
- trimmed mean
- number of bootstrapping
- response data
How to Cite
References
Dixon PM. Bootstrap resampling. In El-Shaarawi, AH, Piegorsch WW. (Eds.-in-Chief). The Encyclopedia of Environmetrics (pp. 1-9). John Wiley & Sons, Ltd.; 2006.
DOI:https://doi.org/10.1002/9780470057339.vab028
Efron B, Tibshirani R. Bootstrap methods for standard errors, confidence intervals and other measures of statistical accuracy. Statistical Science. 1986;1(1):54 -57:1177013815.
Davison AC, Hinkley DV. Bootstrap methods and their application. Cambridge Uni-versity Press. 1997; Available:statwww.epfl.ch/davison/BMA/
Davidson R, MacKinnon JG. Bootstrap tests: How many bootstraps? Econometric. Reviews. 2001;19(1):55–68.
DOI:https://doi.org/10.1080/07474930008800459
Wei J. The number of bootstrap replicates in bootstrap dickey-fuller unit root tests. Working. 2013;Paper 2013:8.
Available:www.statistics.uu.se
Rousselet G, Pernet C, Wilcox R. A practical introduction to the bootstrap: a versatile method to make inferences by using data-driven simulations; 2019. [preprint].
DOI:10.31234/osf.io/h8ft
Diez D. (n.d.). 95% confidence intervals under variety of methods.
Available:https://docs.google.com/spreadsheets/d/1MNOCwOo7oPKrDB1FMwDzsYzvLoK-IBqoxhKrOsN1M2A/edit?pli=1#gid=0
Hesterberg T. What teachers should know about the bootstrap: resampling in the undergraduate statistics curriculum; 2014.
Available:https://arxiv.org/pdf/1411.5279v1.pdf
Robert W. Hayden. Questionable claims for simple versions of the bootstrap. Journal of Statistics Education. 2019;27:3:208-215.
DOI: 10.1080/10691898.2019.1669507
Available:https://doi.org/10.1080/10691898.2019.1669507
Heathcote A, Popiel S, Mewhort D. Analysis of response time distributions: an example using the stroop task. Queen's University at Kingston Kingston, Ontario, Canada Psychological Bulletin. 1991;109(2): 340-347 .
Chernick MR, LaBudde RA. An introduction to bootstrap methods with applications to R. John Wiley & Sons, Inc., Hoboken, New Jersey and Canada; 2011.
Lampert E, Stahel W, Abbt M. Lognormal distributions across the sciences: Keys and clues. BioScience, 2001;51(5):341-352.
Rousselet G, Pernet C, Wilcox R. The percentile bootstrap: A primer with step-by-step instructions in R; 2021.
Available:https://doi.org/10.1177/2515245920911881
Rousselet GA, Wilcox RR. Reaction times and other skewed distributions: Problems with the mean and the median; 2019. [Preprint].
Available:https://doi.org/10.31234/osf.io/3y54r
Davison AC, Hinkley DV, Young GA. Recent developments in bootstrap methodology. Statistical Science. 2003;18(2):141–157.
© Institute of Mathematical Statistics; 2003.
Efron B. Better bootstrap confidence intervals. Tech. Rep. Stanford Univer. Dept. Statist; 1984.
Hejase AJ, Hejase HJ. Research methods a practical approach for business students. 2nd Edition, Masadir Inc., Philadelphia; 2013.
Wilcox RR. Robust estimation and hypothesis testing. 2nd Edition. Elsevier, Academic Press. 2005;30 Corporate Drive, Suite 400, Burlington, MA 01803, USA. ISBN: 0-12-751542-9.
Staudte RG, Shearther SJ. Robust Estimation and Testing. Wiley-Interscience Publication, John Wiley and Sons, Inc. New York; 1990. ISBN 0-471-85547-2.
Madsen RW, Moeschberger ML. Statistical concepts with applications to business and economics. Prentice Hall, Englewood Cliffs. New Jersey 07632; 1986. ISBN 0-13-844846-9,
Efron B, Tibshirani RJ. An introduction to the bootstrap. New York: Chapman & Hall/CRC; 1993.
Canty A. Package ‘boot’ 2021-05-03 09:04:02 UTC. Repository: CRAN.
Larget, B. Chapter 3 R Bootstrap Examples February 19, 2014 online.
Efron B. Better bootstrap confidence intervals. Journal of the American Statistical Association. 1987; 82:171200.
Lei S, Smith MR. Evaluation of several nonparametric bootstrap methods to estimate confidence intervals for software metrics. IEEE Transactions on Software Engineering. 2003;29:996-1004.
Glasserman P. Estimation and confidence interval. 403 Uris Hall, Columbia Bsiness School. Fall, B6014: Managerial Statistics; 2001.
Helwig NE. Bootstrap Confidence Intervals University of Minnesota (Twin Cities) Up.
-
Abstract View: 38 times
PDF Download: 12 times