Q. 1
Statistics
Difficulty: easy
(1 Mark)
In Bayesian statistical inference, what is Bayes' Theorem for continuous parameter $\theta$ and data $\mathbf{x}$ expressed as?
💡
Step-by-Step Explanation & Concept Rationale
Bayes' Theorem updates the prior probability distribution $\pi(\theta)$ with the observed data likelihood $L(\theta; \mathbf{x})$ to yield the posterior distribution $\pi(\theta \mid \mathbf{x}) \propto \text{Likelihood} \times \text{Prior}$.
Q. 2
Statistics
Difficulty: easy
(1 Mark)
What is a 'Conjugate Prior' in Bayesian probability theory?
💡
Step-by-Step Explanation & Concept Rationale
A prior is conjugate to the likelihood if the posterior distribution $\pi(\theta \mid \mathbf{x})$ belongs to the exact same parametric family as the prior $\pi(\theta)$ (e.g., Beta prior is conjugate to Binomial likelihood, yielding a Beta posterior).
Q. 3
Statistics
Difficulty: medium
(1 Mark)
If a Binomial likelihood $X \sim B(n, p)$ has a conjugate $\text{Beta}(\alpha, \beta)$ prior on $p$, what is the resulting posterior distribution $\pi(p \mid x)$?
💡
Step-by-Step Explanation & Concept Rationale
Multiplying the Beta prior $p^{\alpha-1}(1-p)^{\beta-1}$ by the Binomial likelihood $\binom{n}{x}p^x(1-p)^{n-x}$ yields $p^{(\alpha+x)-1}(1-p)^{(\beta+n-x)-1}$, which is exactly $\text{Beta}(\alpha + x, \beta + n - x)$.
Q. 4
Statistics
Difficulty: medium
(1 Mark)
What is the conjugate prior distribution for the mean $\mu$ of a Normal distribution $N(\mu, \sigma^2)$ when variance $\sigma^2$ is known?
💡
Step-by-Step Explanation & Concept Rationale
The Normal distribution is conjugate to a Normal likelihood for known variance: if prior is $N(\mu_0, \sigma_0^2)$, the posterior distribution of $\mu$ is also strictly Normal with precision equal to the sum of prior and data precisions.
Q. 5
Statistics
Difficulty: medium
(1 Mark)
What is the conjugate prior for the parameter $\lambda$ of a Poisson distribution?
💡
Step-by-Step Explanation & Concept Rationale
The Gamma distribution $\text{Gamma}(\alpha, \beta)$ is the conjugate prior for the Poisson rate $\lambda$. With $n$ observations summing to $\sum x_i$, the posterior is $\text{Gamma}(\alpha + \sum x_i, \beta + n)$.
Q. 6
Statistics
Difficulty: hard
(1 Mark)
What is Jeffreys' Prior in Bayesian statistics, and what is its defining invariance property?
💡
Step-by-Step Explanation & Concept Rationale
Harold Jeffreys (1946) derived non-informative priors proportional to the square root of the Fisher Information determinant, ensuring that transforming parameters (e.g., from variance to standard deviation) preserves mathematical consistency.
Q. 7
Statistics
Difficulty: easy
(1 Mark)
What is the Bayesian Point Estimator under Squared Error Loss $L(\theta, \hat{\theta}) = (\theta - \hat{\theta})^2$?
💡
Step-by-Step Explanation & Concept Rationale
Minimizing expected squared error loss $E[(\theta - \hat{\theta})^2 \mid \mathbf{x}]$ yields the conditional expectation (Posterior Mean) $\hat{\theta} = \int \theta \pi(\theta \mid \mathbf{x}) d\theta$.
Q. 8
Statistics
Difficulty: medium
(1 Mark)
What is the Bayesian Point Estimator under Absolute Error Loss $L(\theta, \hat{\theta}) = |\theta - \hat{\theta}|$?
💡
Step-by-Step Explanation & Concept Rationale
Minimizing expected absolute error loss $E[|\theta - \hat{\theta}| \mid \mathbf{x}]$ yields the 50th percentile (Posterior Median) of the posterior distribution.
Q. 9
Statistics
Difficulty: medium
(1 Mark)
What is the Maximum A Posteriori (MAP) estimator?
💡
Step-by-Step Explanation & Concept Rationale
The MAP estimator is the parameter value that maximizes the posterior density function, corresponding to optimal Bayesian decision under 0-1 (all-or-nothing) loss.
Q. 10
Statistics
Difficulty: hard
(1 Mark)
What is a 'Highest Posterior Density' (HPD) Credible Interval in Bayesian analysis?
💡
Step-by-Step Explanation & Concept Rationale
An HPD interval is the optimal Bayesian credible set: it encompasses $1-\alpha$ posterior probability while ensuring every point inside has density higher than any point outside, resulting in the minimum interval length.
Q. 11
Statistics
Difficulty: medium
(1 Mark)
How does a Bayesian $95\%$ Credible Interval fundamentally differ from a Frequentist $95\%$ Confidence Interval in philosophical interpretation?
💡
Step-by-Step Explanation & Concept Rationale
Bayesian inference treats the parameter $\theta$ as a random variable with a posterior probability distribution conditioned on the observed data, enabling direct probabilistic statements about the parameter itself.
Q. 12
Statistics
Difficulty: hard
(1 Mark)
What is the Metropolis-Hastings (MH) algorithm in Markov Chain Monte Carlo (MCMC)?
💡
Step-by-Step Explanation & Concept Rationale
Metropolis-Hastings generates a stationary Markov chain whose equilibrium distribution is exactly the target posterior $\pi(\theta)$, enabling Bayesian sampling without computing the intractable normalizing denominator $\int L(\theta)\pi(\theta)d\theta$.
Q. 13
Statistics
Difficulty: hard
(1 Mark)
What is 'Gibbs Sampling' in multi-parameter Bayesian MCMC?
💡
Step-by-Step Explanation & Concept Rationale
Gibbs sampling updates one parameter at a time from its full univariate conditional distribution, accepting every step ($100\%$ acceptance rate) and avoiding manual tuning of proposal widths.
Q. 14
Statistics
Difficulty: hard
(1 Mark)
What does the Gelman-Rubin convergence diagnostic statistic ($\hat{R}$ / Potential Scale Reduction Factor) measure in MCMC?
💡
Step-by-Step Explanation & Concept Rationale
The Gelman-Rubin $\hat{R}$ compares within-chain and between-chain variances across multiple chains initialized from dispersed starting points: values near $1.00$ indicate that all chains have converged and mixed thoroughly.
Q. 15
Statistics
Difficulty: medium
(1 Mark)
What is 'Effective Sample Size' (ESS) in MCMC posterior analysis?
💡
Step-by-Step Explanation & Concept Rationale
Because successive MCMC states are autocorrelated, $N$ iterations contain less independent information than $N$ i.i.d. draws. The ESS quantifies the effective number of independent draws for computing posterior standard errors.
Q. 16
Statistics
Difficulty: easy
(1 Mark)
What is 'Covariance Stationarity' (Weak Stationarity) in Time Series Analysis?
💡
Step-by-Step Explanation & Concept Rationale
Weak (second-order) stationarity requires constant mean, constant finite variance, and autocovariances $\gamma_k$ that depend solely on the lag separation $k$ rather than the absolute time index $t$.
Q. 17
Statistics
Difficulty: medium
(1 Mark)
What is a 'Random Walk' process $Y_t = Y_{t-1} + \epsilon_t$ (where $\epsilon_t \sim \text{WN}(0, \sigma^2)$)?
💡
Step-by-Step Explanation & Concept Rationale
A random walk has a unit root ($|\phi| = 1$), non-constant variance $\text{Var}(Y_t) = t\sigma^2$, and persistent non-decaying shocks, making it non-stationary.
Q. 18
Statistics
Difficulty: medium
(1 Mark)
What is 'Spurious Regression' in time series econometrics (Granger & Newbold 1974)?
💡
Step-by-Step Explanation & Concept Rationale
Regressing one random walk on another unrelated random walk produces spurious correlation: standard t-ratios diverge to $\pm \infty$ and Durbin-Watson statistic $d \to 0$, creating the illusion of a strong relationship.
Q. 19
Statistics
Difficulty: hard
(1 Mark)
What is 'Cointegration' (Robert Engle & Clive Granger 1987)?
💡
Step-by-Step Explanation & Concept Rationale
Cointegrated series drift together over time in a stable long-run equilibrium relationship ($u_t \sim I(0)$), preventing spurious regression and enabling Vector Error Correction Modeling (VECM).
Q. 20
Statistics
Difficulty: medium
(1 Mark)
What is the Augmented Dickey-Fuller (ADF) Test used for in time series modeling?
💡
Step-by-Step Explanation & Concept Rationale
The ADF test estimates $\Delta Y_t = \alpha + \beta t + \gamma Y_{t-1} + \sum_{i=1}^p \delta_i \Delta Y_{t-i} + \epsilon_t$. If the t-statistic is more negative than the non-standard Dickey-Fuller critical values, $H_0$ (unit root) is rejected.
Q. 21
Statistics
Difficulty: hard
(1 Mark)
What is the Null Hypothesis of the KPSS (Kwiatkowski-Phillips-Schmidt-Shin) Test, and how does it contrast with the ADF test?
💡
Step-by-Step Explanation & Concept Rationale
KPSS reverses the null hypothesis: $H_0$ is trend/level stationarity. Combining ADF and KPSS (confirmatory analysis) robustly verifies whether a series is genuinely stationary or unit-root non-stationary.
Q. 22
Statistics
Difficulty: easy
(1 Mark)
In an Autoregressive model of order 1 ($AR(1)$): $Y_t = \phi Y_{t-1} + \epsilon_t$, what is the condition for weak stationarity?
💡
Step-by-Step Explanation & Concept Rationale
For an $AR(1)$ process to be stationary and causal, the autoregressive root must lie outside the unit circle in the complex plane, which translates to the real condition $|\phi| < 1$.
Q. 23
Statistics
Difficulty: medium
(1 Mark)
In the Box-Jenkins methodology for time series modeling, what are the theoretical shapes of the Autocorrelation Function (ACF) and Partial Autocorrelation Function (PACF) for a stationary $AR(p)$ process?
💡
Step-by-Step Explanation & Concept Rationale
For an $AR(p)$ process: the ACF tails off (exponential decay or damped sinusoid), while the PACF cuts off sharply after lag $p$, which uniquely identifies the autoregressive order $p$.
Q. 24
Statistics
Difficulty: medium
(1 Mark)
What are the theoretical ACF and PACF patterns for a Moving Average process of order $q$ ($MA(q)$)?
💡
Step-by-Step Explanation & Concept Rationale
For an $MA(q)$ process: the ACF truncates to exactly zero for all lags $k > q$, while the PACF decays smoothly (tails off) toward zero.
Q. 25
Statistics
Difficulty: easy
(1 Mark)
In an $\text{ARIMA}(p, d, q)$ model, what does the parameter $d$ represent?
💡
Step-by-Step Explanation & Concept Rationale
The parameter $d$ indicates the number of times the raw series is differenced to remove stochastic trends: $d=1$ means first difference $\Delta Y_t = Y_t - Y_{t-1}$; $d=2$ means second difference.
Study Stream Progress:
Showing 25 of 90 Questions (28%)
Jump to:
Ready to Test Your Retention & Speed?
Now that you have reviewed the study questions and rationales, test yourself in our interactive 1-by-1 practice engine or take the full official timed mock exam.