{"id":71554,"date":"2018-03-09T23:16:12","date_gmt":"2018-03-09T23:16:12","guid":{"rendered":"https:\/\/www.deberes.net\/tesis\/sin-categoria\/learning-with-feed-forward-neural-networks-three-schemes-to-deal-with-the-bias-variance-trade-off\/"},"modified":"2018-03-09T23:16:12","modified_gmt":"2018-03-09T23:16:12","slug":"learning-with-feed-forward-neural-networks-three-schemes-to-deal-with-the-bias-variance-trade-off","status":"publish","type":"post","link":"https:\/\/www.deberes.net\/tesis\/matematicas\/learning-with-feed-forward-neural-networks-three-schemes-to-deal-with-the-bias-variance-trade-off\/","title":{"rendered":"Learning with feed-forward neural networks: three schemes to deal with the bias\/variance trade-off"},"content":{"rendered":"<h2>Tesis doctoral de <strong> Enrique Romero Merino <\/strong><\/h2>\n<p>1. An algorithm for sequential approximation with fnns, named sequential approximation with optimal coefficients and interacting frequencies (saocif). most of the sequential approximations proposed in the literature select the new frequencies (the non-linear weights) guided by the approximation of the residue of the  partial approximation. We propose a sequential algorithm where the  new frequency is selected taking into account its interactions with the previously selected ones. The interactions are discovered by means of their optimal coefficients (the linear weights). A number of heuristics can be used to select the new frequencies. The aim is   that the same level of approximation may be achieved with less hidden units than if we only try to match the residue as best as possible. In terms of the bias\/variance decomposition, it will be possible to obtain simpler models with the same bias. The idea behind saocif can be extended to approximation in hilbert spaces, maintaining orthogonal-like properties. In this case, the importance of the interacting frequencies lies in the expectation of increasing the rate of approximation. Experimental results show that the idea of interacting frequencies allows to construct better approximations than matching the residue.  2. A study and comparison of different criteria to perform feature   selection (fs) with multi-layer perceptrons (mlps) and the sequential backward selection (sbs) procedure within the wrapper approach. Fs procedures control the bias\/variance decomposition by means of the input dimension, establishing a clear connection with   the curse of dimensionality. Several critical decision points are studied and compared. First, the stopping criterion. second, the data set where the value of the loss function is measured. finally, we also compare two ways of computing the saliency (i.E., The relative importance) of a feature: either first train a network and then remove temporarily every fe<\/p>\n<p>&nbsp;<\/p>\n<h3>Datos acad\u00e9micos de la tesis doctoral \u00ab<strong>Learning with feed-forward neural networks: three schemes to deal with the bias\/variance trade-off<\/strong>\u00ab<\/h3>\n<ul>\n<li><strong>T\u00edtulo de la tesis:<\/strong>\u00a0 Learning with feed-forward neural networks: three schemes to deal with the bias\/variance trade-off <\/li>\n<li><strong>Autor:<\/strong>\u00a0 Enrique Romero Merino <\/li>\n<li><strong>Universidad:<\/strong>\u00a0 Polit\u00e9cnica de catalunya<\/li>\n<li><strong>Fecha de lectura de la tesis:<\/strong>\u00a0 30\/11\/2004<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h3>Direcci\u00f3n y tribunal<\/h3>\n<ul>\n<li><strong>Director de la tesis<\/strong>\n<ul>\n<li>Ren\u00e9 Alqu\u00e9zar Mancho<\/li>\n<\/ul>\n<\/li>\n<li><strong>Tribunal<\/strong>\n<ul>\n<li>Presidente del tribunal: Jos\u00e9 Luis Balcazar navarro <\/li>\n<li>gustavo Deco (vocal)<\/li>\n<li>sarunas Raudys (vocal)<\/li>\n<li>cecilio Angulo bahon (vocal)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tesis doctoral de Enrique Romero Merino 1. An algorithm for sequential approximation with fnns, named sequential approximation with optimal coefficients [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"footnotes":""},"categories":[1890,2528,126,15596],"tags":[79284,155880,71269,15865,54653,155881],"class_list":["post-71554","post","type-post","status-publish","format-standard","hentry","category-ciencia-de-los-ordenadores","category-inteligencia-artificial","category-matematicas","category-politecnica-de-catalunya","tag-cecilio-angulo-bahon","tag-enrique-romero-merino","tag-gustavo-deco","tag-jose-luis-balcazar-navarro","tag-rene-alquezar-mancho","tag-sarunas-raudys"],"_links":{"self":[{"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/posts\/71554","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/comments?post=71554"}],"version-history":[{"count":0,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/posts\/71554\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/media?parent=71554"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/categories?post=71554"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/tags?post=71554"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}