GiViP: Giraph Visual Profiling
Analyzing large-scale graphs provides valuable insights in different application scenarios,including social networking, crime detection, content ranking, and recommendations. While many graph processing systems working on top of distributed infrastructures have been proposed to deal with big graphs, the task of profiling their massive computations remains time consuming and error-prone. GiViP is a visual profiler for distributed graph processing systems based on a Pregel-like computation model. GiViP captures the huge amount of messages exchanged throughout a computation and provides a powerful user interface for the visual analysis of the collected data. GiViP can be used to detect anomalies related to the computation and to the infrastructure, such as slow computing units, anomalous message patterns, unbalanced graph partitions, and links with high latency. A demonstration video and the source code of GiVip, running on the platform Apache Giraph, is publicly available in the official Web page.
Publications
- Alessio Arleo, Walter Didimo, Giuseppe Liotta, Fabrizio Montecchiani: Profiling distributed graph processing systems through visual analytics. Future Generation Computer Systems. Vol. 87, pp. 43-57 (2018)
- Alessio Arleo, Walter Didimo, Giuseppe Liotta, Fabrizio Montecchiani: GiViP: A Visual Profiler for Distributed Graph Processing Systems. Graph Drawing 2017: 256-271