{"id":1223,"date":"2023-07-26T11:59:22","date_gmt":"2023-07-26T11:59:22","guid":{"rendered":"https:\/\/www.sas-lab.deib.polimi.it\/?p=1223"},"modified":"2023-07-26T14:39:29","modified_gmt":"2023-07-26T14:39:29","slug":"data-driven-optimization-techniques-2","status":"publish","type":"post","link":"https:\/\/www.sas-lab.deib.polimi.it\/?p=1223","title":{"rendered":"Data-Driven Optimization Techniques"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"1223\" class=\"elementor elementor-1223\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-4e1822f elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"4e1822f\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-c4d9f97\" data-id=\"c4d9f97\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7f4489a elementor-widget elementor-widget-page-title\" data-id=\"7f4489a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"page-title.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\n\t\t<div class=\"hfe-page-title hfe-page-title-wrapper elementor-widget-heading\">\n\n\t\t\t\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">\n\t\t\t\t\t\t\t\t\n\t\t\t\tData-Driven Optimization Techniques  \n\t\t\t<\/h2 > \n\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-21539e6 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"21539e6\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-b8a70cd\" data-id=\"b8a70cd\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-9895bec elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"9895bec\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-66 elementor-top-column elementor-element elementor-element-6d1e23d\" data-id=\"6d1e23d\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-c5cfc37 elementor-widget elementor-widget-text-editor\" data-id=\"c5cfc37\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>In many scientific, engineering, and industrial contexts, we are faced with optimization problems where the objective function and constraints (if present) are not given via closed-form mathematical expressions, i.e., they are\u00a0<i>black-box<\/i>. Instead, they are only accessible by running expensive evaluations, e.g., experiments and\/or simulations. These problems arise in applications such as complex systems design, and control, where the target systems contain different and interacting physical mechanisms (electrical, mechanical, biological, analog\/digital interfaces, etc.). To find the best (feasible) solution to this class of optimization problems, existing approaches try to trade off between\u00a0<i>exploitation\u00a0<\/i>(using information on the current best to improve on it), and\u00a0<i>exploration\u00a0<\/i>(acquiring information around the search space to find better solutions). In the recent years, there has been a rise of model-based approaches in which a surrogate model is built from the samples taken so far, which is then used to choose the next sampling point. However, the most popular methods in the state-of-the-art are still faced with practical problems such as iteration-based optimization performance and computational burden.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-33 elementor-top-column elementor-element elementor-element-7dcf9f1\" data-id=\"7dcf9f1\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-25ae566 elementor-widget__width-auto elementor-pagination-position-outside elementor-widget elementor-widget-image-carousel\" data-id=\"25ae566\" data-element_type=\"widget\" data-e-type=\"widget\" data-settings=\"{&quot;navigation&quot;:&quot;dots&quot;,&quot;slides_to_show&quot;:&quot;1&quot;,&quot;effect&quot;:&quot;fade&quot;,&quot;autoplay&quot;:&quot;yes&quot;,&quot;pause_on_hover&quot;:&quot;yes&quot;,&quot;pause_on_interaction&quot;:&quot;yes&quot;,&quot;autoplay_speed&quot;:5000,&quot;infinite&quot;:&quot;yes&quot;,&quot;speed&quot;:500}\" data-widget_type=\"image-carousel.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-image-carousel-wrapper swiper\" role=\"region\" aria-roledescription=\"carousel\" aria-label=\"Image Carousel\" dir=\"ltr\">\n\t\t\t<div class=\"elementor-image-carousel swiper-wrapper\" aria-live=\"off\">\n\t\t\t\t\t\t\t\t<div class=\"swiper-slide\" role=\"group\" aria-roledescription=\"slide\" aria-label=\"1 of 3\"><figure class=\"swiper-slide-inner\"><img decoding=\"async\" class=\"swiper-slide-image\" src=\"https:\/\/www.sas-lab.deib.polimi.it\/wp-content\/uploads\/2023\/07\/sm-model.png\" alt=\"Set Membership model from sampled points\" \/><\/figure><\/div><div class=\"swiper-slide\" role=\"group\" aria-roledescription=\"slide\" aria-label=\"2 of 3\"><figure class=\"swiper-slide-inner\"><img decoding=\"async\" class=\"swiper-slide-image\" src=\"https:\/\/www.sas-lab.deib.polimi.it\/wp-content\/uploads\/2023\/07\/sm-evol-768x653.png\" alt=\"Evolution of Set Membership model with increasing samples\" \/><\/figure><\/div><div class=\"swiper-slide\" role=\"group\" aria-roledescription=\"slide\" aria-label=\"3 of 3\"><figure class=\"swiper-slide-inner\"><img decoding=\"async\" class=\"swiper-slide-image\" src=\"https:\/\/www.sas-lab.deib.polimi.it\/wp-content\/uploads\/2023\/07\/distribution-pts.png\" alt=\"Samples distribution from a constrained optimization run\" \/><\/figure><\/div>\t\t\t<\/div>\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t<div class=\"swiper-pagination\"><\/div>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-50cb8bb elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"50cb8bb\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-2c5321b\" data-id=\"2c5321b\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-451dca7 elementor-widget elementor-widget-text-editor\" data-id=\"451dca7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>At SAS-Lab, we conduct research on black-box (otherwise referred as\u00a0<i>global<\/i>\u00a0or\u00a0<i>data-driven<\/i>) optimization techniques which are iteration-efficient, and computationally light. We use Set Membership approaches to build a simple surrogate model of the underlying objective and constraint functions, and formulate an algorithm that automatically trades-off between exploitation, exploration, and safety with respect to constraint\/s satisfaction. This has resulted in the Set Membership Global Optimization (SMGO), with competitive iteration-based optimization performance, guaranteed convergence properties, and much lighter computational burden compared to the state of the art. SMGO has been used in challenging case studies, and is available as an\u00a0<a style=\"transition: background-color 0.5s ease 0s, color 0.5s ease 0s;\" href=\"https:\/\/uk.mathworks.com\/matlabcentral\/fileexchange\/122827-set-membership-global-optimization\"><span style=\"font-weight: bold;\"><u>open-source toolbox<\/u><\/span><\/a>\u00a0in MATLAB File Exchange.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6971bb2 elementor-widget elementor-widget-text-editor\" data-id=\"6971bb2\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>References<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0bcefee publication-list elementor-widget elementor-widget-shortcode\" data-id=\"0bcefee\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"shortcode.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-shortcode\"><div class=\"teachpress_pub_list\"><form name=\"tppublistform\" method=\"get\"><a name=\"tppubs\" id=\"tppubs\"><\/a><\/form><div class=\"teachpress_message_error\"><p>Sorry, no publications matched your criteria.<\/p><\/div><\/div><\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-7cee3d4 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"7cee3d4\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-84cb973\" data-id=\"84cb973\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap\">\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Simultaneous learning and optimization for problems with black-box objectives and constraints.<\/p>\n<p> <a class=\"more-link\" href=\"https:\/\/www.sas-lab.deib.polimi.it\/?p=1223\">Read more<\/a><\/p>","protected":false},"author":7,"featured_media":1222,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_header_footer","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[],"class_list":{"0":"post-1223","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-research-topic"},"_links":{"self":[{"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/1223","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1223"}],"version-history":[{"count":13,"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/1223\/revisions"}],"predecessor-version":[{"id":1238,"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/1223\/revisions\/1238"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/media\/1222"}],"wp:attachment":[{"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1223"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1223"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sas-lab.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1223"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}