Variable selection methods and model selection approaches are valuable statistical tools, which are indispensable for almost any statistical modeling question. This review considers first the use of information criteria for model selection. Such criteria provide an ordering of the considered...