Point Location and Active Learning: Learning Halfspaces Almost Optimally

Given a finite set X ⊂ R d and a binary linear classifier c: R d → {0, 1}, how many queries of the form c(x) are required to learn the label of every point in X? Known as point location, this problem has inspired over 35 years of research in the pursuit of an optimal algorithm. Building on the prior work of Kane, Lovett, and Moran (ICALP 2018), we provide the first nearly optimal solution, a randomized linear decision tree of depth Õ(dlog(|X|)), improving on the previous best of Õ(d 2 log(|X|)) from Ezra and Sharir (Discrete and Computational Geometry, 2019). As a corollary, we also provide the first nearly optimal algorithm for actively learning halfspaces in the membership query model. En route to these results, building on the work of Carlen, Lieb, and Loss (J. Geometric Analysis 2004), as well as Dvir, Saraf, and Wigderson (STOC 2014), we prove a novel characterization of Barthe's Theorem (Inventiones Mathematicae, 1998) of independent interest. In particular, we show that X may be transformed into approximate isotropic position if and only if there exists no k-dimensional subspace with more than a k/d-fraction of X, and provide a similar characterization for exact isotropic position. The below is an extended abstract. The full work can be found at https: //arxiv. org/abs/2004. 11380.

Authors

• Max Hopkins
• Daniel M. Kane
• Shachar Lovett
• Gaurav Mahajan

Keywords

• Decision trees
• Complexity theory
• Computational modeling
• Labeling
• Standards
• Reliability theory
• Computational geometry
• Active Learning
• Local Point
• Finite Set
• Linear Classifier
• Machine Learning
• Dimensionality Reduction
• Related Problems
• Sources Of Error
• Hyperplane
• Large Margin
• Combinatorial Problem
• Orthonormal Basis
• Inference Procedure
• Probability Parameter
• Arbitrary Set
• Arbitrary Distribution
• Weak Learners
• Inference Scheme
• Homogeneous Case
• Fraction Of Points
• Orthogonal Subspace
• Outgoing Edges
• point location
• learning theory
• halfspaces
• vector scaling