{"id":727,"date":"2016-09-16T12:00:00","date_gmt":"2016-09-16T12:00:00","guid":{"rendered":"https:\/\/michaelkamp.org\/?p=727"},"modified":"2016-09-16T12:00:00","modified_gmt":"2016-09-16T12:00:00","slug":"communication-efficient-distributed-online-learning-with-kernels-3","status":"publish","type":"post","link":"https:\/\/michaelkamp.org\/?p=727","title":{"rendered":"Communication-Efficient Distributed Online Learning with Kernels"},"content":{"rendered":"<p><div class=\"tp_single_publication\"><span class=\"tp_single_author\">Michael Kamp, Sebastian Bothe, Mario Boley, Michael Mock: <\/span> <span class=\"tp_single_title\">Communication-Efficient Distributed Online Learning with Kernels<\/span>. <span class=\"tp_single_additional\"><span class=\"tp_pub_additional_in\">In: <\/span> Frasconi, Paolo;  Landwehr, Niels;  Manco, Giuseppe;  Vreeken, Jilles (Ed.): <span class=\"tp_pub_additional_booktitle\">Machine Learning and Knowledge Discovery in Databases, <\/span><span class=\"tp_pub_additional_pages\">pp. 805\u2013819, <\/span><span class=\"tp_pub_additional_publisher\">Springer International Publishing, <\/span><span class=\"tp_pub_additional_year\">2016<\/span>.<\/span><\/div><!--more--><\/p>\n<h2 class=\"tp_abstract\">Abstract<\/h2><p class=\"tp_abstract\">We propose an efficient distributed online learning protocol for low-latency real-time services. It extends a previously presented protocol to kernelized online learners that represent their models by a support vector expansion. While such learners often achieve higher predictive performance than their linear counterparts, communicating the support vector expansions becomes inefficient for large numbers of support vectors. The proposed extension allows for a larger class of online learning algorithms\u2014including those alleviating the problem above through model compression. In addition, we characterize the quality of the proposed protocol by introducing a novel criterion that requires the communication to be bounded by the loss suffered.<\/p>\n<h2 class=\"tp_links\">Links<\/h2><p class=\"tp_abstract\"><ul class=\"tp_pub_list\"><li><i class=\"fas fa-file-pdf\"><\/i><a class=\"tp_pub_list\" href=\"http:\/\/michaelkamp.org\/wp-content\/uploads\/2020\/03\/Paper467.pdf\" title=\"http:\/\/michaelkamp.org\/wp-content\/uploads\/2020\/03\/Paper467.pdf\" target=\"_blank\">http:\/\/michaelkamp.org\/wp-content\/uploads\/2020\/03\/Paper467.pdf<\/a><\/li><\/ul><\/p>\n<h2 class=\"tp_bibtex\">BibTeX (<a href=\"https:\/\/michaelkamp.org?feed=tp_pub_bibtex&amp;key=kamp2016communication\">Download<\/a>)<\/h2><pre class=\"tp_bibtex\">@inproceedings{kamp2016communication,\r\ntitle = {Communication-Efficient Distributed Online Learning with Kernels},\r\nauthor = {Michael Kamp and Sebastian Bothe and Mario Boley and Michael Mock},\r\neditor = {Paolo Frasconi and Niels Landwehr and Giuseppe Manco and Jilles Vreeken},\r\nurl = {http:\/\/michaelkamp.org\/wp-content\/uploads\/2020\/03\/Paper467.pdf},\r\nyear  = {2016},\r\ndate = {2016-09-16},\r\nurldate = {2016-09-16},\r\nbooktitle = {Machine Learning and Knowledge Discovery in Databases},\r\npages = {805--819},\r\npublisher = {Springer International Publishing},\r\nabstract = {We propose an efficient distributed online learning protocol for low-latency real-time services. It extends a previously presented protocol to kernelized online learners that represent their models by a support vector expansion. While such learners often achieve higher predictive performance than their linear counterparts, communicating the support vector expansions becomes inefficient for large numbers of support vectors. The proposed extension allows for a larger class of online learning algorithms\u2014including those alleviating the problem above through model compression. In addition, we characterize the quality of the proposed protocol by introducing a novel criterion that requires the communication to be bounded by the loss suffered.},\r\nkeywords = {communication-efficient, distributed, dynamic averaging, federated learning, kernel methods, parallelization},\r\npubstate = {published},\r\ntppubtype = {inproceedings}\r\n}\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-727","post","type-post","status-publish","format-standard","hentry","category-publications"],"_links":{"self":[{"href":"https:\/\/michaelkamp.org\/index.php?rest_route=\/wp\/v2\/posts\/727","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michaelkamp.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michaelkamp.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michaelkamp.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michaelkamp.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=727"}],"version-history":[{"count":0,"href":"https:\/\/michaelkamp.org\/index.php?rest_route=\/wp\/v2\/posts\/727\/revisions"}],"wp:attachment":[{"href":"https:\/\/michaelkamp.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=727"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michaelkamp.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=727"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michaelkamp.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=727"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}