{"id":3692,"date":"2026-11-09T10:42:34","date_gmt":"2026-11-09T09:42:34","guid":{"rendered":"https:\/\/ics.science.upjs.sk\/adui\/?p=3692"},"modified":"2026-11-09T10:44:38","modified_gmt":"2026-11-09T09:44:38","slug":"the-genesis-of-world-models-and-predictive-architectures","status":"publish","type":"post","link":"https:\/\/ics.science.upjs.sk\/adui\/en\/2026\/11\/09\/the-genesis-of-world-models-and-predictive-architectures\/","title":{"rendered":"The genesis of world models and predictive architectures"},"content":{"rendered":"\r\n<p class=\"wp-block-paragraph\">How can machines learn meaningful representations from data without requiring expensive human annotations?<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">This talk explored <strong>self-supervised learning<\/strong>\u2014a paradigm shift that enabled AI systems to learn from vast amounts of unlabeled data, much like humans learn through observation by building an internal <strong>world model<\/strong>.<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">The focus was primarily on <strong>BYOL<\/strong> (<em>Bootstrap Your Own Latent<\/em>), a method that trained neural networks to discover useful patterns by comparing different views of the same data point. Unlike traditional approaches that required carefully labeled examples, BYOL learned by predicting how the same entity appeared under different transformations.<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">Beyond images, the lecture discussed how these ideas extended to diverse domains:<\/p>\r\n\r\n\r\n\r\n<ol class=\"wp-block-list\">\r\n\r\n<li><strong>Analyzing social networks and community structures<\/strong> (densely connected subnetworks) using <strong>BGRL<\/strong>.<\/li>\r\n\r\n\r\n\r\n<li><strong>Understanding neural recordings and biological signals<\/strong> through <strong>MYOW<\/strong>.<\/li>\r\n\r\n\r\n\r\n<li><strong>Integrating multiple data modalities<\/strong> (text, images, and audio) via <strong>BEAST<\/strong>.<\/li>\r\n\r\n<\/ol>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">These techniques opened possibilities for any field with abundant unlabeled data\u2014from social media analysis and behavioral patterns to scientific discovery\u2014highlighting opportunities for applying these methods to <strong>computational social science<\/strong>, network analysis, and other data-rich domains across disciplines.<\/p>\r\n\r\n\r\n\r\n<h3 class=\"wp-block-heading\">Event Course and Discussion<\/h3>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">Following the lecture, a passionate open discussion took place. The main topics revolved around finding the right balance between automation, process efficiency, output quality, and essential human expertise, as well as practically connecting advanced models to real-world research problems.<\/p>\r\n\r\n\r\n<img fetchpriority=\"high\" decoding=\"async\" src=\"https:\/\/ics.science.upjs.sk\/adui\/wp-content\/uploads\/sites\/10\/2026\/11\/ilob-podujat-prednaska-Valko-13102026-SK-opr-1-203x300.png\" alt=\"\" width=\"609\" height=\"900\" class=\"alignnone size-medium wp-image-3693\" srcset=\"https:\/\/ics.science.upjs.sk\/adui\/wp-content\/uploads\/sites\/10\/2026\/11\/ilob-podujat-prednaska-Valko-13102026-SK-opr-1-203x300.png 203w, https:\/\/ics.science.upjs.sk\/adui\/wp-content\/uploads\/sites\/10\/2026\/11\/ilob-podujat-prednaska-Valko-13102026-SK-opr-1.png 420w\" sizes=\"(max-width: 609px) 100vw, 609px\" \/>","protected":false},"excerpt":{"rendered":"<p>How can machines learn meaningful representations from data without requiring expensive human annotations? This talk explored self-supervised learning\u2014a paradigm shift that enabled AI systems to learn from vast amounts of&hellip;<\/p>\n","protected":false},"author":31,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[68,3,66],"tags":[],"class_list":["post-3692","post","type-post","status-publish","format-standard","hentry","category-actual-en","category-actual","category-https-ics-science-upjs-sk-adui-en-category-actual"],"_links":{"self":[{"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/posts\/3692","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/users\/31"}],"replies":[{"embeddable":true,"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/comments?post=3692"}],"version-history":[{"count":2,"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/posts\/3692\/revisions"}],"predecessor-version":[{"id":3698,"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/posts\/3692\/revisions\/3698"}],"wp:attachment":[{"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/media?parent=3692"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/categories?post=3692"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ics.science.upjs.sk\/adui\/wp-json\/wp\/v2\/tags?post=3692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}