Literature DB >> 30705579

Submodular Maximization via Gradient Ascent: The Case of Deep Submodular Functions.

Wenruo Bai1, William S Noble2,3, Jeff A Bilmes1,3.   

Abstract

We study the problem of maximizing deep submodular functions (DSFs) [13, 3] subject to a matroid constraint. DSFs are an expressive class of submodular functions that include, as strict subfamilies, the facility location, weighted coverage, and sums of concave composed with modular functions. We use a strategy similar to the continuous greedy approach [6], but we show that the multilinear extension of any DSF has a natural and computationally attainable concave relaxation that we can optimize using gradient ascent. Our results show a guarantee of max 0 < δ < 1 ( 1 - ϵ - δ - e - δ 2 Ω ( k ) ) with a running time of O(n 2 /ϵ 2 ) plus time for pipage rounding [6] to recover a discrete solution, where k is the rank of the matroid constraint. This bound is often better than the standard 1 - 1/e guarantee of the continuous greedy algorithm, but runs much faster. Our bound also holds even for fully curved (c = 1) functions where the guarantee of 1 - c/e degenerates to 1 - 1/e where c is the curvature of f [37]. We perform computational experiments that support our theoretical results.

Entities:  

Year:  2018        PMID: 30705579      PMCID: PMC6351064     

Source DB:  PubMed          Journal:  Adv Neural Inf Process Syst        ISSN: 1049-5258


  3 in total

1.  P3 & beyond: move making algorithms for solving higher order functions.

Authors:  Pushmeet Kohli; M Pawan Kumar; Philip H S Torr
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2009-09       Impact factor: 6.226

2.  Choosing non-redundant representative subsets of protein sequence data sets using submodular optimization.

Authors:  Maxwell W Libbrecht; Jeffrey A Bilmes; William Stafford Noble
Journal:  Proteins       Date:  2018-02-01

3.  Choosing panels of genomics assays using submodular optimization.

Authors:  Kai Wei; Maxwell W Libbrecht; Jeffrey A Bilmes; William Stafford Noble
Journal:  Genome Biol       Date:  2016-11-15       Impact factor: 13.583

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.