大規(guī)模圖神經網絡系統(tǒng)架構剖析

1、 揚帆起航AliGraph: 大規(guī)模圖神經網絡系統(tǒng)架構剖析Analysis of Large-scale GNN System Architecture Based on AliGraphContents 目錄01 AliGraph平臺簡介02 系統(tǒng)架構與核心技術AliGraph平臺簡介AliGraph Overview01PAI：阿里巴巴機器學習平臺Platform of Artificial Intelligence in AlibabaPAI機器學習平臺特性Features of PAI/product/learn一站式機器學習平臺數(shù)據處理，特征加工 模型訓練，在線預測SOTA機器學習算

2、法經典機器學習 阿里自研算法 兼顧離線&實時精心優(yōu)化的深度學習引擎阿里內部大規(guī)模任務打磨PAI-Tensorflow引擎彈性模型預測服務簡化模型部署負擔 支持擴縮容，降低成本什么是圖神經網絡Introduction of GNNGNN低維向量空間G = (V, E V=VertexE=EdgeNeura, Network實踐中的挑戰(zhàn)Challenges in Practice數(shù)據不規(guī)則稀疏性，非結構化，屬性 同構，異構，有向，無向Data Cleaner規(guī)模巨大千億邊、百億點 樣本指數(shù)級膨脹百TB級萬CPU時計算難擴展圖算子種類變化多 無法結合深度學習用戶期望：一體化解決方案Users Exp

3、ect Solutions from Data to Model for GNNAPPGNN AlgorithmsGraph & TensorEngineGraph DataLarge-scale ,Homogeneous ,Heterogeneous,AttributedAliGraph：云上的“圖+深度學+”平臺A GNN Platform on Alibaba Cloud支持PB級 源于實際 生產的復雜圖數(shù)據企業(yè)級Industry Level簡潔的IDEI便于從原始 數(shù)據構建業(yè)務模型端到端End to End滿足決速發(fā)展的研究與 實際生產應用的結合產與研For Research and

4、Production系統(tǒng)架構與核心技術System Architecture and Key Technologies02GNN編程范式GNN Programming Paradigmhop=1hop=21. Sampling2. Vectorization3. Aggregate4. CombineVertex IdVertex AttributesEdge AttributesEdge IdAggregate outputVertex outputV1V2E1E2V0一體化系統(tǒng)實現(xiàn)An Integrated System Implementation for GNNServer 0Serv

5、er Server 2Server nTensor EngineGraph EngineData BridgePythonGraph QuerySamplerTensorFlow & PyTorchAggregatorCombinerLarge-scaleHeterogeneousAttributedGNNRPCFriendlyFlexibleRobustEffective簡潔的用戶接口Laconic User Interface點擊相似高效的圖構建過程Effective Graph BuildingSERVER iData QueueData QueueData QueueLoca lPRO

6、CESSING THREADPROCESSING THREADPROCESSING THREADData QueueData QueueData QueuePROCESSING THREADPROCESSING THREADPROCESSING THREADLOADING THREADRPCRPCLoca lLOADING THREADLOADING THREADRPCRPCSERVER jLOADING THREADBatch ReadingBatch ReadingPartitioningPartitioningPartitioningPartitioningBatch ReadingBa

7、tch ReadingGraph ParsingGraph ParsingGraph ParsingGraph ParsingGraph ParsingGraph ParsingUpdate StorageUpdate StorageUpdate StorageUpdate StorageUpdate StorageUpdate Storage多跳采樣加速機制Cache to Empower Multi-Hop Graph Sampling可擴展的算子類型Flexible and Pluggable OperatorsUser nterfaceDistribute RuntimeDistribute StorageProgramming nterfaceProgramming nterfaceOperatorOperatorOperatorOperator系統(tǒng)數(shù)據System Perfo