Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
An Efficient Distributed Graph Engine for Deep Learning on Graphs
DescriptionTraditional graph-processing algorithms have been widely used in Graph Neural Networks (GNNs). Current approaches to graph processing in deep learning face two main problems. Firstly, easy-to-use deep learning libraries lack support for widely used graph processing algorithms and do not provide low-level APIs for building distributed graph processing algorithms. Secondly, existing graph processing libraries are not user-friendly for deep learning researchers. This paper presents an efficient and easy-to-use graph engine that incorporates distributed graph processing into deep-learning ecosystems. We develop a distributed graph storage system with an efficient batching technique to minimize communication overhead incurred by Remote Procedure Calls between computing nodes. We propose an optimized method for distributed computation of Single Source Personalized PageRank (SSPPR) using the Forward Push algorithm based on lock-free parallel maps. Experimental evaluations demonstrate significant improvement, with up to three orders of magnitude in SSPPR throughput, of our graph engine compared with the tensor-based implementation.
Event Type
Workshop
TimeMonday, 13 November 20233:54pm - 4:18pm MST
Location704-706
Artificial Intelligence/Machine Learning
Graph Algorithms and Frameworks
W