
Research Article


Probability of Type I Error and Power of Some Parametric Test: Comparative Approach 

Enegesele Dennis,
Biu O. Emmanuel
and
Otaru O.A. Paul



ABSTRACT

Background and Objectives: Assumptions in statistics are mostly violated when testing hypotheses, hence, the use of inappropriate statistical tests results to invalid research conclusions. Most real life data are void of these assumptions resulting to difficulty in analysis using either parametric or nonparametric tests. The objective of the study is to examine the probability of type I error rate and the power of the parametric tests. Materials and Methods: To find out probability of type I error and power of some parametric tests such as; Bartlett’s, Cochran’s, Hartley’s and O’Brien test were taken under three conditions; normal and nonnormal distributions, equal and unequal sample variances and equal sample size. Results: Results showed that all tests were very robust when normality assumption was achieved. But when normality assumption was violated, Hartley’s and Cochran tests could not control the type I error applying chisquare and Gamma distribution. For power, Bartlett’s, Hartley’s and O’Brien tests were most powerful than Cochran test irrespective of the normality assumption and equality of variance. However, Cochran test is more robust than Hartley’s test when the distribution is chisquare while, the Hartley test is more robust when the distribution is gamma. Conclusion: It is concluded that care should be taken in the choice of an appropriate statistical test when assumption of normality is violated.





Copyright: © 2020. This is an open access article distributed under the terms of the creative commons attribution License, which permits unrestricted use, distribution and reproduction in any medium, provided the original author and source are credited.


INTRODUCTION
The analysis of variance (ANOVA) is the most powerful method for testing hypotheses when the assumptions of normality, homogeneity of variance and independence of errors are achieved^{1,2}. Statistical test results are greatly distorted when any of these assumptions are not met, leading to invalid inference^{3}. However, test of sample homogeneity of variance are often use in various application of statistical analysis prior to the use of analysis of variance. There are two classes for testing equality of variance, the parametric and nonparametric test, however, this study only considered parametric test. Classic parametric methods are based on certain assumptions so as to produce exact results; the assumptions underlying them (e.g., normality and homoscedasticity) must be fulfilled^{4}. Besides normality assumptions, all parametric tests assume random samples, independence within samples and mutual independence between samples^{5}. These assumptions are hardly satisfied when analyzing reallife data and thus violated in time series^{6}. There are two basic criteria for testing equality of variance, robustness and power.
Parametric tests are significant test which assume certain distribution of the data, interval level of measurement and homogeneity of variances when two or more samples are compared. Most significant tests are Levene test, Bartlett test, Jackknife test, Sharma test, Cochran test, Hartley test and O’Brien test^{7,8}. This study considered Bartlett test, Cochran test, Hartley test and O’Brien test for equality of variance in time series. Assuming the expected mean (μ) = 10 and variances are equal and unequal. A hypothesis to test for equality of variances corresponding to m samples is in the form:
where, the inequality at least for one pair of subscripts i_{1} i_{2}.
Bartlett’s test statistic is designed to test for equality of variances across groups against alternative that variances are unequal for at least two groups. The sampling distribution of the test is approximated by chisquare distribution with m1 degrees of freedom and random samples m are drawn from an independent normal populations^{9}. The test statistic is:
here, N is the total sample size, k is the number of groups, S_{p}^{2} is the pooled variance and S_{j}^{2} is the sample variance from the jth sample.
In Bartlett’s test, sample size of the groups need not be equal, however, sample size should be larger than 5^{10}. When comparing statistic for power and robustness, Bartlett’s test is most used in several experimental cases^{11}. The disadvantage of the test is the assumption that all population follows a normal distribution. The null hypothesis of equal variances is rejected if B is larger than the critical value.
Cochran test is computationally simpler than Bartlett’s test, it is used to test homogeneity of variances. The test is also affected by nonnormality^{12} and it is a good choice for checking homogenous variance if robustness and power against nonnormality is needed.
The test is defined as:
where, S_{i}^{2} is the sample variance of the ith group, k is the number of groups and df = k1; each of the k groups has n1 degree of freedom.
The hypothesis is rejected if C>C_{k,v} for a giving α, v = n1, n is number of observations per group. The null hypothesis is rejected concluding that the variances are heterogeneous at 5% level of significance. Cochran’s test performed well in power for equal sample^{11}. The test is also useful when the variance increases in succession by a constant ratio.
Hartley’s F_{max} utilizes only maximum and minimum variances of groups under test. The test is used in case of equal sample size. The test is defined as:
Where:
Fratio of the Hartley test is different from Fratio that is produced in ANOVA. If the variances are similar to each other, then the Fratio will be close to 1 otherwise the more the variances differ, the larger the Fratio will be. If the Fratio is very close to 1, it is safe to conclude that the data probably show equality of variance. If the Fratio is quite a bit larger than 1, the table of Fmax values is used so, as to determine the likelihood of obtaining the Fratio by chance^{6}. If the F_{max}>F_{max (k, n1)}, variances are heterogeneous.
This test is use to test homogeneity of variance. The null hypothesis states that observation under consideration comes from a population with the same variance^{13}. Original series is transformed such that the means of the transformed series reflect the variance of the original series^{14}. The transformation is given as:
where, n is the number of observation in ith group, _{i} is the mean of ith group, X_{ij} is the observation at ith row and jth column, SS_{i} is the sum of square of group i:
If all group has equal sample size:
where, N is the number of observation per group. When null hypothesis is true, this test statistic has approximately F_{k}_{−1, N−k} distribution.
In the literature, statistical test have different methods to test data and they also possesses some disadvantages. Bartlett’s and O’Brian test are disposed to violation of the normality assumption. Cochran’s and Hartley’s tests are relatively a good choice for checking equality of variance if robustness against nonnormality is needed^{15,16}.
The rationale for this study is to examine the probability of type I error rate and the power of the parametric tests considered in this study under three conditions when, (i) The data distributions are normal and nonnormal, (ii) The sample size were equal and (iii) The sample variance were equal and unequal.
MATERIALS AND METHODS
This study was carried out between MarchOctober, 2019 at the Department of Mathematics and Statistics, University of Port Harcourt, Port Harcourt, Nigeria. The study adopted design of Vorapongsathorn et al.^{8}.
Robustness and power: Robustness and power are two criteria used to detect the test for equality of variance under violation of assumption. Robustness is the ability to control type I error when there are small departures from assumption. Also, it is the capability of the test not to wrongly detect nonhomogeneous groups when the data is not normally distributed. Therefore, a statistical test is robust if departure of the empirical type I error ϕ from the normal level of significance (α) is not greater than the predetermined value^{8,15,17}. The study relied on the Cochran limit to test for robustness, which is:
• 
At 0.01 significance level, ϕ value is between 0.0070.015 
• 
At 0.05 significance level, ϕ value is between 0.040.06 
Thus, a statistical test is called robust when it’s empirical alpha values lies within the Cochran limit^{18}. Error rate could not be controlled by a test when any of the probability of type I error is below or exceed the Cochran limit. The power of a test is the probability of rejecting a null hypothesis when it should be rejected. It is the probability of not committing a type II error in a simulation experiments. This study computes power by subtracting the empirical probability of a type II error from 1. Type II error is an error made by wrongly accepting or failure to reject a false null hypothesis i.e.:
• 
Power = 1the empirical probability of a type II error = (1): 
The maximum total power of a test can have is 1 and the minimum is zero^{18}.
Computation: The data used in this study were generated by using R programme under different setting and three distributions namely; normal, gamma and chisquare distribution.
Normal distribution or Gaussian: If X is a continuous random variable which follows a normal distribution with mean μ and variance σ^{2}, then its p.d.f is given by:
Gamma distribution: If X is a random variable that follows a gamma distribution and α and β are the parameters, then:
The mean and variance of the Gamma distribution are αβ and αβ^{2}, respectively. The values of α = 2.5 and β = 0.6.
Chisquare distribution: Suppose X~χ^{2}_{k}, where k is the degree of freedom, then:
The mean and variance of the chisquare distribution are k and 2k, respectively^{18}.
Generation of groups of populations and proportion of sample variances: The population used in this study was generated in three groups with the same distribution as Normal, gamma and chisquare distribution. This study generated equal sample size of 45, 60 and 75, respectively. The three populations considered in the study have sample variances in each case that were in the ratios 1:1:1 (under H_{o}); 1:1:2 and 1:2:4 (under H_{1})^{1}. The theoretical alpha value for testing the equality of variance was defined as 0.01 and 0.05, respectively.
Normal, gamma and chisquare distribution at different combination of sample size for three populations were simulated and the empirical type 1 error and power of tests were investigated. In other to estimate the empirical type 1 error and power estimates, nominal 1 and 5% level was used with 5,000 simulations. The simulated data was used for computing Bartlett’s test, Cochran test, Hartley test and O’Brien test. The critical region of the respective tests statistic was compared with the values obtained. The values that rejected the null hypothesis were recorded and those that failed to reject the null hypothesis were also recorded for type II error. The probability of the type II error was subtracted from 1.0 so, as to get the power of the test. The computation of this process was repeated in all conditions.
RESULTS
Table 1 showed the empirical alpha values of statistical tests controlled by type 1 error for different distribution considered in the study at α = 0.01 and 0.05, respectively, when equality of variance was achieved. When normality condition was achieved, the various test statistic considered in the study were robust as the empirical alpha values of the statistical tests lies within the Cochran limit (0.0070.015 at 0.01 significant level and 0.040.06 at 0.05 significant level, respectively). When normality condition was violated and the distribution was chisquare distribution, Bartlett test and O’Brien test controlled type 1 error at α = 0.01 and 0.05, respectively (Robust) with an average sample size of 60. When the distribution was gamma, none of the tests could control the type 1 error for robustness at α = 0.05.
Table 1: 
Type 1 error for equal variance hypothesis of statistical tests and distributions 


Normal distribution 
Chisquare distribution 
Gamma distribution 
Nominal level 
Sample 

of significance 
sizes N_{i} 
B 
C 
H 
O 
B 
C 
H 
O 
B 
C 
H 
O 
0.01 
45,45,45 
0.007* 
0.010* 
0.007* 
0.007* 
0.006 
0.025 
0.004 
0.005 
0.007* 
0.025 
0.007* 
0.044 

60,60,60 
0.008* 
0.012* 
0.008* 
0.009* 
0.074* 
0.026 
0.002 
0.068 
0.008* 
0.026 
0.007* 
0.056 

75,75,75 
0.010* 
0.012* 
0.009* 
0.012* 
0.010* 
0.026 
0.003 
0.012* 
0.015* 
0.029 
0.009* 
0.067 
0.05 
45,45,45 
0.041* 
0.052* 
0.044* 
0.047* 
0.003 
0.127 
0.003 
0.045* 
0.031 
0.124 
0.034 
0.125 

60,60,60 
0.047* 
0.058* 
0.049* 
0.052* 
0.044* 
0.128 
0.001 
0.055* 
0.033 
0.132 
0.037 
0.223 

75,75,75 
0.053* 
0.060* 
0.058* 
0.059* 
0.058* 
0.128 
0.004 
0.059* 
0.762 
0.145 
0.047 
0.321 
B: Bartlett’s test, C: Cochran’s test, H: Hartley’s test, O: O’Brien’s test, *empirical alpha values of the statistical tests 
Table 2: 
Power of statistical tests for unequal variances (1:1:2) 
Nominal 

Normal distribution 
Chisquare distribution 
Gamma distribution 
level of 
Sample 

significance 
sizes N_{i} 
B 
C 
H 
O 
B 
C 
H 
O 
B 
C 
H 
O 
0.01 
45,45,45 
0.479 
0.482 
0.497 
0.478 
0.402 
0.390 
0.410 
0.417 
0.497 
0.377 
0.494 
0.356 

60,60,60 
0.699 
0.582 
0.866 
0.788 
0.500 
0.489 
0.500 
0.588 
0.697 
0.577 
0.594 
0.367 

75,75,75 
0.72 
0.682 
0.896 
0.800 
0.730 
0.576 
0.620 
0.590 
0.749 
0.580 
0.795 
0.678 
0.05 
45,45,45 
0.797 
0.712 
0.983 
0.854 
0.730 
0.749 
1.000 
0.600 
0.806 
0.585 
0.971 
0.845 

60,60,60 
0.897 
0.814 
0.981 
0.920 
0.700 
0.844 
1.000 
0.650 
0.887 
0.614 
0.969 
0.865 

75,75,75 
0.998 
0.911 
0.981 
0.992 
0.890 
0.946 
1.000 
0.720 
0.995 
0.898 
0.974 
0.888 
Critical 0.001.00, B: Bartlett’s test, C: Cochran’s test, H: Hartley’s test, O: O’Brien test 
Table 3: 
Power of statistical tests for unequal variances (1:2:4) 
Nominal 

Normal distribution 
Chisquare distribution 
Gamma distribution 
level of 
Sample 


significance 
sizes N_{i} 
B 
C 
H 
O 
B 
C 
H 
O 
B 
C 
H 
O 
0.01 
45,45,45 
0.960 
0.984 
0.998 
0.967 
1.000 
0.990 
1.000 
0.967 
0.999 
0.981 
0.996 
0.958 

60,60,60 
1.000 
0.984 
0.998 
0.994 
1.000 
0.989 
1.000 
0.985 
0.999 
0.980 
0.997 
0.989 

75,75,75 
1.000 
0.984 
0.998 
0.996 
1.000 
0.990 
1.000 
0.978 
1.000 
0.982 
0.997 
0.991 
0.05 
45,45,45 
0.998 
0.922 
0.989 
0.986 
1.000 
0.949 
1.000 
0.978 
0.996 
0.903 
0.982 
0.976 

60,60,60 
0.999 
0.921 
0.990 
0.990 
1.000 
0.947 
1.000 
1.000 
0.997 
0.902 
0.983 
0.987 

75,75,75 
0.999 
0.921 
0.990 
1.000 
1.000 
0.948 
1.000 
1.000 
0.998 
0.911 
0.987 
0.992 
Critical 0.001.00, B: Bartlett’s test, C: Cochran’s test, H: Hartley’s test, O: O’ Brien test 
Table 4: 
Generation of responses for the three distributions, equal sample size and unequal sample variances 
Distribution/ 

Under H_{1} 
level of 

Under H_{o} the ratio 

significance 
Sample size n_{i} 
of variance = 1:1:1 
Ratio of variance = 1:1:2 
Ratio of variance = 1:2:4 
Normal 
45, 45, 45 … 
X_{i}~N (μ, σ^{2}), ∀i 
X_{1}~N (μ, σ^{2}) 
X_{1}~N (μ, σ^{2}) 
α = 0.01 
60, 60, 60 … 
μ_{1} = μ∀i 
X_{2}~N (μ, σ^{2}) 
X_{2}~N (μ, 2σ^{2}) 

75, 75, 75 … 
σ_{i}^{2} = σ_{i}^{2} ∀i 
X_{3}~N (μ, 2σ^{2}) 
X_{3}~N (μ, 4σ^{2}) 
α = 0.05 
∀i (i = 1, 2, 3) 
H_{o} = σ_{1}^{2} = σ_{2}^{2} = σ_{3}^{2} = σ_{m}^{2} 
H_{1} = σ_{1}^{2}: σ_{2}^{2}: σ_{3}^{2} = σ_{1}^{2}: σ_{2}^{2}: 2σ_{3}^{2} 
H_{1} = σ_{1}^{2}: σ_{2}^{2}: σ_{3}^{2} = σ_{1}^{2}: 2σ_{2}^{2}: 4σ_{3}^{2} 


= 1:1:1 
=1:1:2 
=1:2:4 
Gamma 
45, 45, 45 … 
X_{i}~G (α, β) ∀i 
X_{1}~G (α, β) 
X_{1}~G (α, β) 
α = 0.01 
60, 60, 60 … 
μ_{1} = αβ ∀i 
X_{2}~G (α, β) 
X_{2}~G (α/2, 2β) 

75, 75, 75 … 
σ_{i}^{2} = αβ^{2} ∀i 
X_{3}~G (α/2, 2β) 
X_{3}~G (α/4, 4β) 
α = 0.05 
∀i (i = 1, 2, 3) 
H_{o} = σ_{1}^{2} = σ_{2}^{2} = σ_{3}^{2} = αβ^{2} 
H_{1} = σ_{1}^{2}: σ_{2}^{2}: σ_{3}^{2} = αβ^{2}: αβ^{2}: 2αβ^{2} 
H_{1} = σ_{1}^{2}: σ_{2}^{2}: σ_{3}^{2} = αβ^{2}: 2αβ^{2}: 4αβ^{2} 


= 1:1:1 
=1:1:2 
=1:2:4 
Chisquare 
45, 45, 45 … 
X_{i}~χ^{2} (α, β) 
X_{1}~χ^{2} (n), μ_{1} = n, σ_{1}^{2} = 2n 
X_{1}~χ^{2} (n), μ_{1} = n, σ_{1}^{2} = 2n 
α = 0.01 
60, 60, 60 … 
μ_{1} = n 
X_{2}~χ^{2} (n), μ_{2} = n, σ_{2}^{2} = 2n 
X_{2}~χ^{2} (2n), μ_{2} = 2n, σ_{2}^{2} = 4n 

75, 75, 75 … 
σ_{i}^{2} = 2n ∀i 
X_{3}~χ^{2} (2n), μ_{3} = 2n, σ_{3}^{2} = 4n 
X_{3}~χ^{2} (4n), μ_{3} = 4n, σ_{3}^{2} = 8n 
α = 0.05 
∀i (i = 1, 2, 3) 
H_{o} = σ_{1}^{2} = σ_{2}^{2} = σ_{3}^{2} = 2n 
H_{1} = σ_{1}^{2}: σ_{2}^{2}: σ_{3}^{2} = 2n:2n:4n 
H_{1} = σ_{1}^{2}: σ_{2}^{2}: σ_{3}^{2} = 2n:4n:8n 


= 1:1:1 
=1:1:2 
=1:2:4 
However, the sample size did not affect robustness of Bartlett and Hartley’s tests as their empirical alpha values of the statistical tests lies within the Cochran limit.
Furthermore, Table 2 showed the power of statistical tests for different distribution considered in the study at α = 0.01 and 0.05, respectively when variances are unequal (1:1:2). When the sample size was 45 for all the distribution, the power of all the tests were below 0.5 at α = 0.01. This implies that the tests could identify a faulty null hypothesis. However, when the sample size increased up to 70, the power of the tests for the different distribution improved significantly.
Table 3 showed the power of statistical tests for different distribution considered in the study at α = 0.01 and 0.05, respectively when variances are unequal (1:2:4). The results showed that Bartlett’s and Hartley’s tests had the maximum power of 1.0 for the different distributions irrespective of the sample size.
Finally, Table 4 showed that how the populations used in the study were generated in three different groups with the same distribution as normal, gamma and chisquare. The sample variances in each case for the population considered in the study were in the ratios 1:1:1 (under H_{o}); 1:1:2 and 1:2:4 (under H_{1}).
DISCUSSION
Bartlett’s, Cochran, Hartley’s and O’Brien tests were very robust when normality assumption was achieved at α = 0.01 and 0.05 irrespective of the sample size as the empirical alpha value lies with the Cochran limit. The result is in accordance with the findings of Hatchavanich^{17}. However, when normality assumption was violated and the distribution was chisquare, Bartlett’s and O’Brien tests could control the type 1 error rate (robust) when the sample size was 60 and 70, respectively at α = 0.01 and 0.05. The result does not support the findings of Sharma and kibria^{2}. According to their findings, Bartlett’s test was nonrobust when normality assumption was violated and the sample size was 30. In this study, the empirical alpha value for Bartlett’s test when the sample size was 60 and 70 and the distribution was chisquare (normality violated) are 0.074 and 0.010 at α = 0.01. The empirical alpha value for O’Brien test when the sample size was 70 is 0.012 (Table 1). This result is in accordance with the finding of Lee et al.^{5} when it was reported that the O’Brien test performed very robust as it could control the type I error rate across all population distributions, except for small sample size. Bartlett’s and Hartley’s test were the only tests that were robust when the population was gamma distribution at α = 0.01. When the nominal level of significance was 0.05 and the distribution was gamma, none of the statistical test considered in the study was robust as their respective empirical alpha value lies outside the Cochran limit of 0.0070.015 for α = 0.01 and 0.0040.006 for α = 0.05
The power of each statistical test for all distributions when variance ratio was 1:1:2 was less that 0.5 at α = 0.01. This indicated that the tests could detect faulty null hypotheses. Bartlett’s, test maintained good statistical power of 0.998 and 0.995, respectively when normality assumption was achieved and also when the population was gamma distribution with a sample size of 70 at α = 0.05. This result is in accordance with the finding of Hatchavanich^{17}. This study also revealed that Hartley’s test had the maximum power of 1.00 irrespective of sample size and variance ratio 1:1:2 when normality assumption was violated, but the distribution was chisquare at α = 0.05 (Table 2).
Finally, the power of each statistical test for all distributions considered in the study when variance ratio was 1:2:4 revealed that, even when normality assumption was violated, all the tests had power greater than 0.8 with an average sample size of 45 at α = 0.01 and 0.05, respectively (Table 3).
In this study, four parametric (Bartlett’s, Cochran’s, Hartley’s and O’Brien) tests for constant variance were considered and compared with respect to power and robustness. When normality assumption was achieved, all statistical tests were robust at α = 0.01 and 0.05, respectively. This result is in accordance with the findings of Vorapongsathorn et al.^{8}. However, when normality condition was violated and the populations was chisquare, the O’Brien tests statistic was more robust at α = 0.05 than the Cochran tests statistic considered in the literature when the average sample size is 45. Thus, this study recommends that care should be taken in choosing a statistical test when assumption of normality is violated.
CONCLUSION
This study showed that when distribution is normal and variance is equal, empirical type I error of Bartlett’s, Cochran, Hartley’s and O’Brien tests satisfy Cochran limits, thus, cochran test is more robust than Hartley’s test when the distribution is chisquare and Hartley’s test is more robust when the distribution is gamma. All tests were very robust when normality assumption was achieved, but when violated, Hartley’s and Cochran tests could not control the type I error for chisquare and gamma distribution , respectively. For power, Bartlett’s, Hartley’s and O’Brien tests were most powerful than Cochran test irrespective of the normality assumption and equality of variance.
SIGNIFICANCE STATEMENT
This study discovers the most powerful Bartlett’s, Hartley’s and O’Brien tests that can be beneficial for data which follows chisquare and gamma distribution. This study will help the researcher to uncover the critical areas of assumption violation applying other distributions and statistical tests for robustness and power.

REFERENCES 
1: Ruscio, J. and B. Roche, 2012. Variance heterogeneity in published psychological research. Methodology, 8: 111. CrossRef  Direct Link 
2: Sharma, D. and B.M.G. Kibria, 2013. On some test statistics for testing homogeneity of variances: A comparative study. J. Stat. Comput. Simul., 83: 19441963. Direct Link 
3: Kim, Y.J. and R.A. Cribbie, 2018. ANOVA and the variance homogeneity assumption: Exploring a better gatekeeper. Br. J. Math. Stat. Psychol., 71: 112. CrossRef  Direct Link 
4: Fox, J., 2008. Applied Regression Analysis and Generalized Linear Models. 2nd Edn., Sage, Thousand Oaks, C.A
5: Lee, H.B., G.S. Katz and A.F. Restori, 2010. A monte carlo study of seven homogeneity of variance tests J. Math. Stat., 6: 359366. CrossRef  Direct Link 
6: Zimmerman, D.W., 2004. A note on preliminary tests of equality of variances. Br. J. Math. Stat. Psychol., 57: 173181. CrossRef  Direct Link 
7: Filliben, J.J. and A. Heckert, 2000. Levene’s test for equality of variances. Online. http://www.nist.gov/itl/div898/handbook/eda/section3/eda358.htm.
8: Vorapongsathorn, T., S. Taejaroenkul and C. Viwatwongkasem, 2004. A comparison of type I error and power of Bartlett’s test, Levene’s test and Cochran’s test under violation of assumptions. Songklanakarin J. Sci. Technol., 26: 537547. Direct Link 
9: Montgomery, D.C., 1997. Design and Analysis of Experiments. 4th Edn., John Wiley and Sons, New York
10: Li, X., W. Qiu, J. Morrow, D.L. DeMeo, S.T. Weiss, Y. Fu and X. Wang, 2015. A comparative study of tests for homogeneity of variances with application to DNA methylation data. PloS One, Vol. 10, No. 12 CrossRef  Direct Link 
11: Boos, D.D. and C. Brownie, 2004. Comparing variances and other measures of dispersion. Stat. Sci., 19: 571578. Direct Link 
12: Lemeshko, B.Y. and S.B. Lemeshko, 2008. Power and robustness of criteria used to verify the homogeneity of means. Meas. Tech., 51: 950959. CrossRef  Direct Link 
13: Lemeshko, B.Y., S.B. Lemeshko and A.A. Gorbunova, 2010. Application and power of criteria for testing the homogeneity of variances. Part I. Parametric criteria. Meas. Tech., 53: 237246. CrossRef  Direct Link 
14: Mu, Z., 2006. Comparing the statistical tests for homogeneity of variances. M.Sc. Thesis, Department of Mathematics, East Tennessee State University, USA.
15: Wilcox, R.R., 2010. Fundamentals of Modern Statistical Methods: Substantially Improving Power and Accuracy. 2nd Edn., SpringerVerlag, New York
16: Field, A.P., J.N.V. Miles and Z.C. Field, 2012. Discovering Statistics Using R: And Sex and Drugs and Rock ‘n’ Roll. Sage, London
17: Hatchavanich, D., 2014. A comparison of type I error and power of Bartlett’s test, Levene’s test and O’Brien’s test for homogeneity of variance tests. S. Asian J. Sci., 3: 181194. Direct Link 
18: Lemeshko, B.Y. and V.M. Ponomarenko, 2006. Distributions of the statistics used for testing hypotheses of equal variances for nonnormal law error. Nauch. Vestnik NGTU, Vol. 23, No. 2.



