How to run a validation test

Contents:

• 1. Load executive control
• 2. Load dataset
• 3. Load desired validation test

Statistics

Statistical terminologies used in CerebUnit

Hypothesis Testing

Contents:

• Hypothesis testing about means (HtestAboutMeans)
• Hypothesis testing about medians (HtestAboutMedians)
• Hypothesis testing about proportions (HtestAboutProportions)

Test Statistics (Test Score)

Contents:

• Compute t-statistic (TScore)
• Compute z-statistic (ZScoreStandard)
• Compute z-statistic for Sign test (ZScoreForSignTest)
• Compute z-statistic for Two Sample Rank-Sum test (ZScoreForTwoSampleRankSumTest)
• Compute z-statistic for Wilcox Signed-Rank test (ZScoreForWilcoxSignedRankTest)
• Compute z-statistic for z-test on proportions as the categorical variable (ZScoreForProportionZTest)
• Compute chi^2-statistic for test on proportions as the categorical variable (Chi2Score)
• Compute test-statistic for Fisher Exact Test on proportions as the categorical variable (FisherExactScore)
• Compute test-statistic for McNemar-test on proportions as the categorical variable of discordant pairs (McNemarScore)
• Compute chi^2-statistic for chi^2 goodness-of-fit test on proportions of categories of a categorical variable (Chi2GOFScore)

Checks for Data Conditions (to determine appropriate testing)

Contents:

• Data condition for HT about means (NecessaryForHTMeans). Is t-Test valid?
• Data condition for HT about proportions (NecessaryForHTProportions). Is z-Test or \(\\chi^2\)-testvalid?

Measuring the quality of validation tests

Contents:

• Generating Mock Data files at random to evaluate validation tests (MockData)
• Test Metrics for evaluation of validation tests (TestMetrics)

How to measure quality of a validation test?

Contents:

• Create MockData Instance to generate mock data
• Load desired Validation Test
• Instantiate TestMetrics Object