TRANSFORMERS: Robust spatial joins on non-uniform data distributions

• Published in: 2016 IEEE 32nd International Conference on Data Engineering (ICDE) pp. 673 - 684
• Main Authors: Pavlovic, Mirjana, Heinis, Thomas, Tauheed, Farhan, Karras, Panagiotis, Ailamaki, Anastasia
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-05-2016
• Subjects: Axons; Layout; Robustness; Runtime; Spatial databases; Switches; Time measurement
• DOI: 10.1109/ICDE.2016.7498280

Spatial joins are becoming increasingly ubiquitous in many applications, particularly in the scientific domain. While several approaches have been proposed for joining spatial datasets, each of them has a strength for a particular type of density ratio among the joined datasets. More generally, no single proposed method can efficiently join two spatial datasets in a robust manner with respect to their data distributions. Some approaches do well for datasets with contrasting densities while others do better with similar densities. None of them does well when the datasets have locally divergent data distributions. In this paper we develop TRANSFORMERS, an efficient and robust spatial join approach that is indifferent to such variations of distribution among the joined data. TRANSFORMERS achieves this feat by departing from the state-of-the-art through adapting the join strategy and data layout to local density variations among the joined data. It employs a join method based on data-oriented partitioning when joining areas of substantially different local densities, whereas it uses big partitions (as in space-oriented partitioning) when the densities are similar, while seamlessly switching among these two strategies at runtime. We experimentally demonstrate that TRANSFORMERS outperforms state-of-the-art approaches by a factor of between 2 and 8.