The Minimum Description Length (MDL) principle is an information theoretic approach to inductive inference that originated in algorithmic coding theory. In this approach, data are viewed as codes to be compressed by the model. From this perspective, models are compared on their ability to compress a data set by extracting useful information in the data apart from random noise. The goal of model selection is to identify the model, from a set of candidate models, that permits the shortest description length (code) of the data. Since Rissanen originally formalized the problem using the crude ‘two-part code ’ MDL method in the 1970s, many significant strides have been made, especially in the 1990s, with the culmination of the development of the refined ‘universal code’ MDL method, dubbed Normalized Maximum Likelihood (NML). It represents an elegant solution to the model selection problem. The present paper provides a tutorial review on these latest developments with a special focus on NML. An application example of NML in cognitive modeling is also provided.

This paper proposes a Bayesian method to set tolerance or specification limits on one or more responses and obtain optimal values for a set of controllable factors. The existence of such controllable factors (or parameters) that can be manipulated by the process engineer and that affect the responses is assumed. The dependence between the controllable factors and the responses is assumed to be captured by a regression model fit from experimental data, where the data is assumed to be available. The proposed method finds the optimal setting of the control factors (parameter design) and the corresponding specification limits for the responses (tolerance control) in order to achieve a desired posterior probability of conformance of the responses to their specifications. Contrary to standard approaches in this area, the proposed Bayesian approach uses the complete posterior predictive distribution of the responses, thus the tolerances and settings obtained consider implicitly both the mean and variance of the responses and the uncertainty in the regression model parameters. 1