{"id":115655,"date":"2018-03-11T10:44:14","date_gmt":"2018-03-11T10:44:14","guid":{"rendered":"https:\/\/www.deberes.net\/tesis\/sin-categoria\/enriching-unstructured-media-content-about-events-to-enable-semi-automated-summaries-compilations-and-improved-search-by-leveraging-social-networks\/"},"modified":"2018-03-11T10:44:14","modified_gmt":"2018-03-11T10:44:14","slug":"enriching-unstructured-media-content-about-events-to-enable-semi-automated-summaries-compilations-and-improved-search-by-leveraging-social-networks","status":"publish","type":"post","link":"https:\/\/www.deberes.net\/tesis\/ciencia-de-los-ordenadores\/enriching-unstructured-media-content-about-events-to-enable-semi-automated-summaries-compilations-and-improved-search-by-leveraging-social-networks\/","title":{"rendered":"Enriching  unstructured media content about events to enable semi-automated summaries, compilations, and  improved search by leveraging social networks"},"content":{"rendered":"<h2>Tesis doctoral de <strong> Thomas Steiner <\/strong><\/h2>\n<p>Enriching unstructured media content about events to enable semi-automated summaries, compilations, and improved search by leveraging social networks  (i) mobile devices and social networks are omnipresent  mobile devices such as smartphones, tablets, or digital cameras together with social networks enable people to create, share, and consume enormous amounts of media items like videos or photos both on the road or at home. Such mobile devices\u00c2\u00bfby pure definition\u00c2\u00bfaccompany their owners almost wherever they may go. In consequence, mobile devices are omnipresent at all sorts of events to capture noteworthy moments. Exemplary events can be keynote speeches at conferences, music concerts in stadiums, or even natural catastrophes like earthquakes that affect whole areas or countries. At such events\u00c2\u00bfgiven a stable network connection\u00c2\u00bfpart of the event-related media items are published on social networks both as the event happens or afterwards, once a stable network connection has been established again.  (ii) finding representative media items for an event is hard  common media item search operations, for example, searching for the official video clip for a certain hit record on an online video platform can in the simplest case be achieved based on potentially shallow human-generated metadata or based on more profound content analysis techniques like optical character recognition, automatic speech recognition, or acoustic fingerprinting. More advanced scenarios, however, like retrieving all (or just the most representative) media items that were created at a given event with the objective of creating event summaries or media item compilations covering the event in question are hard, if not impossible, to fulfill at large scale. The main research question of this thesis can be formulated as follows.  (iii) research question  \u00abcan user-customizable media galleries that summarize given events be created solely based on textual and multimedia data from social networks?\u00bb  (iv) contributions  in the context of this thesis, we have developed and evaluated a novel interactive application and related methods for media item enrichment, leveraging social networks, utilizing the web of data, techniques known from content-based image retrieval (cbir) and content-based video retrieval (cbvr), and fine-grained media item addressing schemes like media fragments uris to provide a scalable and near realtime solution to realize the abovementioned scenario of event summarization and media item compilation.  (v) methodology  for any event with given event title(s), (potentially vague) event location(s), and (arbitrarily fine-grained) event date(s), our approach can be divided in the following six steps.  1) via the textual search apis (application programming interfaces) of different social networks, we retrieve a list of potentially event-relevant microposts that either contain media items directly, or that provide links to media items on external media item hosting platforms.  2) using third-party natural language processing (nlp) tools, we recognize and disambiguate named entities in microposts to predetermine their relevance.  3) we extract the binary media item data from social networks or media item hosting platforms and relate it to the originating microposts.  4) using cbir and cbvr techniques, we first deduplicate exact-duplicate and near-duplicate media items and then cluster similar media items.  5) we rank the deduplicated and clustered list of media items and their related microposts according to well-defined ranking criteria.  6) in order to generate interactive and user-customizable media galleries that visually and audially summarize the event in question, we compile the top-n ranked media items and microposts in aesthetically pleasing and functional ways.<\/p>\n<p>&nbsp;<\/p>\n<h3>Datos acad\u00e9micos de la tesis doctoral \u00ab<strong>Enriching  unstructured media content about events to enable semi-automated summaries, compilations, and  improved search by leveraging social networks<\/strong>\u00ab<\/h3>\n<ul>\n<li><strong>T\u00edtulo de la tesis:<\/strong>\u00a0 Enriching  unstructured media content about events to enable semi-automated summaries, compilations, and  improved search by leveraging social networks <\/li>\n<li><strong>Autor:<\/strong>\u00a0 Thomas Steiner <\/li>\n<li><strong>Universidad:<\/strong>\u00a0 Polit\u00e9cnica de catalunya<\/li>\n<li><strong>Fecha de lectura de la tesis:<\/strong>\u00a0 20\/05\/2014<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h3>Direcci\u00f3n y tribunal<\/h3>\n<ul>\n<li><strong>Director de la tesis<\/strong>\n<ul>\n<li>Joaquim Gabarr\u00f3 Vall\u00e9s<\/li>\n<\/ul>\n<\/li>\n<li><strong>Tribunal<\/strong>\n<ul>\n<li>Presidente del tribunal: ricardo Baeza yates <\/li>\n<li>daniel Gayo   avello (vocal)<\/li>\n<li>  (vocal)<\/li>\n<li>  (vocal)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tesis doctoral de Thomas Steiner Enriching unstructured media content about events to enable semi-automated summaries, compilations, and improved search by [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"footnotes":""},"categories":[1890,1892,30372,15596],"tags":[228688,88324,16549,228687],"class_list":["post-115655","post","type-post","status-publish","format-standard","hentry","category-ciencia-de-los-ordenadores","category-ensenanza-con-ayuda-de-ordenador","category-lenguajes-algoritmicos","category-politecnica-de-catalunya","tag-daniel-gayo-avello","tag-joaquim-gabarro-vallas","tag-ricardo-baeza-yates","tag-thomas-steiner"],"_links":{"self":[{"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/posts\/115655","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/comments?post=115655"}],"version-history":[{"count":0,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/posts\/115655\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/media?parent=115655"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/categories?post=115655"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.deberes.net\/tesis\/wp-json\/wp\/v2\/tags?post=115655"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}