Most cookbook techniques such as ridge regressions, cross-validation, etc have a Bayesian interpretation as a prior on the parameter.
Bayesian techniques allow you to use all the data available.
That said, sometimes they are computationally expensive, and it's better to approximate them by using a test set.