DMCA
The Single Pixel GPS: Learning Big Data Signals from Tiny Coresets
| Citations: | 1 - 1 self |
BibTeX
@MISC{Feldman_thesingle,
author = {Dan Feldman and Cynthia Sung and Daniela Rus},
title = {The Single Pixel GPS: Learning Big Data Signals from Tiny Coresets},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
We present algorithms for simplifying and clustering patterns from sensors such as GPS, LiDAR, and other devices that can produce high-dimensional signals. The algorithms are suitable for handling very large (e.g. terabytes) streaming data and can be run in parallel on networks or clouds. Applications include compression, denoising, activity recognition, road matching, and map generation. We encode these problems as (k, m)-segment mean problems. Formally, we provide (1 + ε)-approximations to the k-segment and (k, m)-segment mean of a d-dimensional discretetime signal. The k-segment mean is a k-piecewise linear function that minimizes the regression distance to the signal. The (k, m)-segment mean has an additional constraint that the projection of the k segments on R d consists of only m ≤ k segments. Existing algorithms for these problems take O(kn 2) and n O(mk) time respectively and O(kn 2) space, where n is the length of the signal. Our main tool is a new coreset for discrete-time signals. The coreset is a smart compression of the input signal that allows computation of a (1 + ε)-approximation to the k-segment or (k, m)-segment mean in O(n log n) time for arbitrary constants ε, k, and m. We use coresets to obtain a parallel algorithm that scans the signal in one pass, using space and update time per point that is polynomial in log n. We provide empirical evaluations of the quality of our coreset and experimental results that show how our coreset boosts both inefficient optimal algorithms and existing heuristics. We demonstrate our results for extracting signals from GPS traces. However, the results are more general and applicable to other types of sensors.
Keyphrases
big data signal segment mean single pixel gps tiny coresets d-dimensional discretetime signal gps trace high-dimensional signal smart compression inefficient optimal algorithm k-piecewise linear function arbitrary constant map generation road matching parallel algorithm k-segment mean new coreset input signal activity recognition regression distance main tool additional constraint discrete-time signal update time segment mean problem experimental result empirical evaluation
