[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Error decomposition and model complexity.
- Subject: Error decomposition and model complexity.
- From: Huaiyu Zhu <zhuh@santafe.edu>
- Date: Mon, 31 Aug 1998 14:01:23 -0600 (MDT)
- In-reply-to: <Pine.SOL.3.95.980828151834.27145D-100000@ultra02>
- Reply-to: Huaiyu Zhu <zhuh@santafe.edu>
The following paper has been submitted to Neural Computation:
http://www.santafe.edu/~zhuh/draft/edmc.ps.gz
Error Decomposition and Model Complexity
Huaiyu Zhu
Bayesian information geometry provides a general error decomposition
theorem for arbitrary statistical models and a family of information
deviations that include Kullback-Leibler information as a special case.
When applied to Gaussian measures it takes the classical Hilbert space
(Sobolev space) theories for estimation (regression, filtering,
approximation, smoothing) as a special case. When the statistical and
computational models are properly distinguished, the dilemmas of
over-fitting and ``curse of dimensionality'' disappears, and the optimal
model order disregarding computing cost is always infinity.
Cited papers that have not appeared in print can be obtained through the
web page below.
--
Huaiyu Zhu Tel: 1 505 984 8800 ext 305
Santa Fe Institute Fax: 1 505 982 0565
1399 Hyde Park Road mailto:zhuh@santafe.edu
Santa Fe, NM 87501 http://www.santafe.edu/~zhuh/
USA ftp://ftp.santafe.edu/pub/zhuh/