Compile- and run-time approaches for the selection of efficient data structures for dynamic graph analysis

Abstract

Graphs are used to model a wide range of systems from different disciplines including social network analysis, biology, and big data processing. When analyzing these constantly changing dynamic graphs at a high frequency, performance is the main concern. Depending on the graph size and structure, update frequency, and read accesses of the analysis, the use of different data structures can yield great performance variations. Even for expert programmers, it is not always obvious, which data structure is the best choice for a given scenario. In previous work, we presented an approach for handling the selection of the most efficient data structures automatically using a compile-time approach well-suited for constant workloads. We extend this work with a measurement study of seven data structures and use the results to fit actual cost estimation functions. In addition, we evaluate our approach for the computations of seven different graph metrics. In analyses of real-world dynamic graphs with a constant workload, our approach achieves a speedup of up to 5.4× compared to basic data structure configurations. Such a compile-time based approach cannot yield optimal results when the behavior of the system changes later and the workload becomes non-constant. To close this gap we present a run-time approach which provides live profiling and facilitates automatic exchanges of data structures during execution. We analyze the performance of this approach using an artificial, non-constant workload where our approach achieves speedups of up to 7.3× compared to basic configurations.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,592

External links

  • This entry has no external links. Add one.
Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

  • Only published works are available at libraries.

Similar books and articles

Feasible Graphs and Colorings.Douglas Cenzer & Jeffrey Remmel - 1995 - Mathematical Logic Quarterly 41 (3):327-352.
Qualitative approaches to empirical legal research.Lisa Webley - 2010 - In Peter Cane & Herbert M. Kritzer (eds.), The Oxford Handbook of Empirical Legal Research. Oxford University Press.
Sense data: The sensible approach.Manuel García-Carpintero - 2001 - Grazer Philosophische Studien 62 (1):17-63.
Data fusion with probabilistic conditional logic.Jens Fisseler & Imre Fehér - 2010 - Logic Journal of the IGPL 18 (4):488-507.

Analytics

Added to PP
2017-01-14

Downloads
11 (#1,130,421)

6 months
2 (#1,192,610)

Historical graph of downloads
How can I increase my downloads?

Citations of this work

No citations found.

Add more citations

References found in this work

No references found.

Add more references