{"id":399,"date":"2015-10-11T22:27:06","date_gmt":"2015-10-12T03:27:06","guid":{"rendered":"https:\/\/sites.bu.edu\/data\/?page_id=399"},"modified":"2021-07-07T14:09:45","modified_gmt":"2021-07-07T18:09:45","slug":"learning-with-budgets","status":"publish","type":"page","link":"https:\/\/sites.bu.edu\/data\/research\/learning-with-budgets\/","title":{"rendered":"Resource Efficient Machine Learning (Budgeted ML)"},"content":{"rendered":"

Machine learning applications often requires achieving high prediction accuracy under certain budget constraint. In automated medical diagnosis each medical test carries a monetary cost and the aim is to correctly diagnose any given patient based on a sequence of tests while keeping an expected budget. In search engines the speed of producing search results is often just as important as the quality of the results. Given a budget in terms of CPU time, the goal is to have a ranking algorithm that produces accurate ranking results within the budget. <\/span><\/p>\n

Learning under resource constraints departs from the traditional machine learning setting and introduces new exciting challenges. For instance, features are accompanied by costs (e.g. extraction time in search engines or true monetary values in medical diagnosis) and their amortized sum is constrained at test-time.
\n<\/span><\/p>\n

This introduces a new trade-off between prediction accuracy<\/strong> and prediction cost<\/strong>. Studying this tradeoff is an inherent challenge that needs to be investigated in a principled fashion in order to invent practically relevant machine learning algorithms.\u00a0<\/span><\/p>\n

\n

Publications:<\/span><\/p>\n

Selective Classification Based on One-Sided Prediction<\/a>, AISTATS 2021<\/p>\n

Budget Learning by Bracketing<\/a>, AISTATS 2020<\/p>\n

Adaptive Classification for Prediction under a Budget<\/a>, NIPS 2017<\/p>\n

Adaptive Neural Networks for Fast Test-Time Prediction<\/a>, ICML 2017<\/p>\n

Sequential Dynamic Decision Making with Deep Neural Nets on a Test-Time Budget<\/a>, arxiv preprint<\/p>\n

Structured Prediction on a Budget<\/a>, AAAI 2017<\/p>\n

Pruning Random Forests for Prediction on a Budget<\/a>, NIPS 2016<\/p>\n

Efficient Learning by Directed Acyclic Graph For Resource Constrained Prediction<\/a>, NIPS 2015<\/span><\/p>\n

Cheap Bandits<\/a>, ICML 2015<\/p>\n

Feature-Budgeted Random Forest<\/a>, ICML 2015<\/p>\n

Model Selection by Linear Programming<\/a>, ECCV 2014<\/p>\n

An LP for Sequential Learning Under Budgets<\/a>, AISTATS 2014<\/p>\n

Fast Margin-based Cost-Sensitive Classification<\/a>, ICASSP 2014<\/p>\n

Multistage Learning under Budget Constraints<\/a>, AISTATS 2013 (Oral)<\/p>\n

Multi Stage Classifier Design<\/a>, ACML 2012<\/p>\n","protected":false},"excerpt":{"rendered":"

Machine learning applications often requires achieving high prediction accuracy under certain budget constraint. In automated medical diagnosis each medical test carries a monetary cost and the aim is to correctly diagnose any given patient based on a sequence of tests while keeping an expected budget. In search engines the speed of producing search results is […]<\/p>\n","protected":false},"author":9351,"featured_media":0,"parent":410,"menu_order":1,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/pages\/399"}],"collection":[{"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/users\/9351"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/comments?post=399"}],"version-history":[{"count":21,"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/pages\/399\/revisions"}],"predecessor-version":[{"id":908,"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/pages\/399\/revisions\/908"}],"up":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/pages\/410"}],"wp:attachment":[{"href":"https:\/\/sites.bu.edu\/data\/wp-json\/wp\/v2\/media?parent=399"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}