云計(jì)算技術(shù)與架構(gòu)前瞻

Copyright 2010 Platform Computing Corporation. All Rights Reserved. Proprietary and Confidential: Platform Computing Corporation 云計(jì)算技術(shù)與架構(gòu)前瞻 Presented by: Fubo Zhang Copyright 2010 Platform Computing Corporation. All Rights Reserved. 2 Proprietary and Confidential: Platform Computing Corporation 云計(jì)算的市場(chǎng)前景 云計(jì)算的現(xiàn)狀 云計(jì)算的技術(shù)、架構(gòu)發(fā)展趨勢(shì) 內(nèi)容提要 Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved. 3 3 1979: CFD Contributions to the 767 High-Speed Wing Design Cab Design Engine/Airframe Integration Inlet Design Wing-Body Fairing Design Nacelle Design Much CFD penetration. Opportunities exist for higher accuracy and expanded complexity Some CFD penetration. Opportunities exist for large increases in design process speed and application CFD penetration opportunity Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved. 4 4 2005: CFD Contributions to the 787 High-Speed Wing Design Cab Design Engine/Airframe Integration Inlet Design Inlet Certification Exhaust System Design Cabin Noise Community Noise Wing-Body Fairing Design Vertical Tail and Aft Body Design Design For Stability & Control High-Lift Wing Design APU Inlet And Ducting ECS Inlet Design APU and Propulsion Fire Suppression Nacelle Design Thrust Reverser Design Design for FOD Prevention Aeroelastics Much CFD penetration. Opportunities exist for higher accuracy and expanded complexity Some CFD penetration. Opportunities exist for large increases in design process speed and application Icing Air Data System Location Connexion Antenna Vortex Generator Placement Planform Design Buffet Boundary Wake Vortex Alleviation Reynolds Number Corrections for Loads and S&C Flutter Control Failure Analysis Wind Tunnel Corrections Design For Loads Wing Tip Design Wing Controls Avionics Cooling Interior Air Quality Engine Bay Thermal Analysis CFD penetration opportunity Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved. 5 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 6 6 Gartner View of Private Cloud Market 可升 級(jí) 的 共享 自 動(dòng) 化 彈 性 計(jì) 算 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 7 7 451 Group View of the Cloud Market 管理 自 動(dòng) 化 安全 存 儲(chǔ) Copyright 2010 Platform Computing Corporation. All Rights Reserved. 8 8 Forrester View on Cloud Computing Platforms Copyright 2010 Platform Computing Corporation. All Rights Reserved. 9 Proprietary and Confidential: Platform Computing Corporation 云 計(jì) 算 實(shí)現(xiàn) 的 3 條路徑 Time Scope of sharing 2003 2015 2009 Client/Server Silos Workgroup / LOB VM Cluster 同構(gòu)服務(wù)器的整合 有限的應(yīng)用 基于 VM的管理功能 網(wǎng)格 靜態(tài)資源、動(dòng)態(tài)調(diào)度 基于策略的調(diào)度 Enterprise Public & Private Cloud 9 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 10 Proprietary and Confidential: Platform Computing Corporation 公共云 - What do we believe? ESX Virtual Machine Virtual Machine Virtual Machine Virtual Machine Virtual Machine Virtual Machine 物理機(jī) PC cloud User 手機(jī) 移動(dòng)上網(wǎng) 3G 上網(wǎng)機(jī) Internet 接入上網(wǎng) Workstation VIP 接入 10 虛擬機(jī) User User Copyright 2010 Platform Computing Corporation. All Rights Reserved. 11 Proprietary and Confidential: Platform Computing Corporation 公共云 - What do I believe? 11 PC cloud 1. 上網(wǎng)筆記本等終端設(shè)備 2. 臺(tái)式電腦、筆記本將會(huì)被淘汰 3. 虛擬 PC服務(wù)運(yùn)營(yíng)商將會(huì)替代 MS和 google Data Bank 1. 解決數(shù)據(jù)、信息安全的最終解決方案 2. 衍生許多種數(shù)據(jù)服務(wù)， 比如醫(yī)療健康，個(gè)人企業(yè)信用征詢(xún)，個(gè)人數(shù)據(jù)銀行 Many SPs 1. PC SP 2. Storage SP 3. Game SP 4. Many SAAS SPs 5. Many other SPs Copyright 2010 Platform Computing Corporation. All Rights Reserved. 12 Proprietary and Confidential: Platform Computing Corporation Platform ISF HPC Apps Test & Dev Analytics LSF, Symphony, LSF, Symphony, Private cloud management software 私有云 Java JBoss, Tomcat, Copyright 2010 Platform Computing Corporation. All Rights Reserved. 13 Proprietary and Confidential: Platform Computing Corporation 1. 數(shù)據(jù)中心體系很復(fù)雜， 系統(tǒng)的維護(hù)和管理難度大 2. IT成本高，資源占用多，配置峰值資源需求 = 浪費(fèi)資源 3. 系統(tǒng)穩(wěn)定性、可靠性低。人工服務(wù)為主，高成本、低滿(mǎn)意度 4. IT傳統(tǒng)模式不能適應(yīng)業(yè)務(wù)部署速度的需求 （至少 2個(gè)月） 地理上分布的用戶(hù) 根據(jù)應(yīng)用靜態(tài)分配 IT資源 Supply and Demand Not Aligned Web eCommerce Intranet ERP CRM BI Dev/QA Email 今天 IDC 數(shù)據(jù)中心的挑 戰(zhàn) Copyright 2010 Platform Computing Corporation. All Rights Reserved. 14 Proprietary and Confidential: Platform Computing Corporation 云 計(jì) 算（虛 擬 化） 帶 來(lái)的好 處 1. 資源虛擬化，從而實(shí)現(xiàn)全局共享 節(jié)省投資 2. SOA 框架使得 IT能對(duì)業(yè)務(wù)需求提供快速部署， 時(shí)間從原來(lái)的幾個(gè)月縮短到半天 提高了業(yè)務(wù)支撐能力 3. 一體化管理打破了原來(lái) IT煙囪式業(yè)務(wù)系統(tǒng)管理，使得系統(tǒng)維護(hù)人員的效率大大提高 運(yùn)維效率提高 4. 消除單點(diǎn)故障造成的穩(wěn)定、可靠性問(wèn)題 提高系統(tǒng)穩(wěn)定性和可靠性 5. 幫助 IT投資風(fēng)險(xiǎn)和決策 Smart IT 6. 節(jié)能減排 綠色 IT Copyright 2010 Platform Computing Corporation. All Rights Reserved. 15 Proprietary and Confidential: Platform Computing Corporation 實(shí)現(xiàn) 云 計(jì) 算（虛 擬 化）的困 難 1. 沒(méi)有成熟的產(chǎn)品和方案讓運(yùn)營(yíng)商有直觀(guān)的理解。 2. 各個(gè)廠(chǎng)商都在推、強(qiáng)調(diào)自己的云計(jì)算概念和產(chǎn)品，像盲人摸象，無(wú)法讓用戶(hù)有個(gè)全局的認(rèn)識(shí)。 3. 現(xiàn)有 IT系統(tǒng)的改動(dòng)成本和風(fēng)險(xiǎn) 4. 傳統(tǒng)業(yè)務(wù)系統(tǒng)虛擬化改造 5. 少有成功案例可以借鑒 6. 組織管理和人們的認(rèn)識(shí)需要提高 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 16 Proprietary and Confidential: Platform Computing Corporation Platform在 實(shí)現(xiàn) 云 計(jì) 算方面的 優(yōu)勢(shì) 1. Platform已經(jīng)有了自己的云計(jì)算產(chǎn)品 ISF - IAAS 2. Platform的云計(jì)算產(chǎn)品是建立在許多用戶(hù)的需求上的， 如 JP Morgen, CityBank, Amazon, Alatum 3. 我們幫助用戶(hù)實(shí)現(xiàn)小步快跑的策略， 降低 IT系統(tǒng)的改動(dòng)成本和風(fēng)險(xiǎn) 4. 我們本地有近 200名研發(fā)團(tuán)隊(duì)來(lái)協(xié)助用戶(hù)的業(yè)務(wù)系統(tǒng)虛擬化改造 5. Platform已有幾個(gè)云計(jì)算成功案例 6. Platform可提供業(yè)務(wù)培訓(xùn)和成功用戶(hù)案例考察 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 17 Proprietary and Confidential: Platform Computing Corporation Java Cloud: Fortune 500 FS Companies App Server App 1 App Server Platform ISF 煙囪式的 業(yè)務(wù) 系 統(tǒng)導(dǎo) 致了系 統(tǒng) 部署 時(shí)間長(zhǎng) ，資源利用率低下， IT管理 維護(hù) 成本高 Virtual Servers Self-Service Portal 100s Java 應(yīng) 用 軟 件運(yùn)行在 1000s UNIX SMP 服 務(wù) 器 App Server App 2 App Server App N App 1 App 2 App N 挑 戰(zhàn) 資 源池方案： Linux, Xen/KVM 和 storage； 自服 務(wù) 管理 , 調(diào) 度自 動(dòng) 化，管理一體化 系 統(tǒng) 部署的 時(shí)間 從幾天 縮 短到幾分 鐘 沒(méi)有雙機(jī) 備 份 低成本 解決方案 Benefits 環(huán) 境 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 18 Proprietary and Confidential: Platform Computing Corporation SaaS Cloud: Fetch Technologies Platform ISF CUST A CUST B CUST C CUST X 由于手 動(dòng) 部署 業(yè)務(wù) 系 統(tǒng) ，無(wú)法 滿(mǎn) 足日益增 長(zhǎng) 的 業(yè)務(wù)需求 簡(jiǎn)單 的用 戶(hù) 系 統(tǒng) 配置的改 變 ，需要幾個(gè)小 時(shí) 乃至幾天 200 virtual servers in production and test/dev using VMware 利用私有云的技 術(shù) Platform ISF自 動(dòng) 管理和部署系 統(tǒng) 滿(mǎn) 足了客 戶(hù)業(yè)務(wù)擴(kuò)張 的需求 減少了 認(rèn)為 的中 間環(huán)節(jié) ，提高了工作效率 實(shí)現(xiàn) 了 Service on Demand 解決方案 Benefits 環(huán) 境 挑 戰(zhàn) Copyright 2010 Platform Computing Corporation. All Rights Reserved. 19 Proprietary and Confidential: Platform Computing Corporation IaaS Cloud: SingTel 在人工操作的方式下， 管理和維護(hù)出租的計(jì)算機(jī)、計(jì)算用戶(hù)使用情況和計(jì)費(fèi)非常的不方便 Xen, VMware, Hyper-V, and physical blades on 2,400 cores providing public cloud services 挑 戰(zhàn) 利用私有云的技術(shù) Platform ISF自動(dòng)管理和部署系統(tǒng) 多快好省的為用戶(hù)提供各種服務(wù) 通過(guò)自動(dòng)化管理， 降低了維護(hù)費(fèi)用 提升了市場(chǎng)競(jìng)爭(zhēng)力 解決方案 Benefits 環(huán) 境 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 20 Proprietary and Confidential: Platform Computing Corporation HPC Cloud: CERN 系統(tǒng)無(wú)法為用戶(hù)提供靈活的資源配置，需要等待很長(zhǎng)的時(shí)間 RHEL, KVM, Xen, Hyper-V for widely diverse set of scientific applications on x86 commodity boxes 挑 戰(zhàn) 利用私有云的技術(shù) Platform ISF自動(dòng)管理和部署系統(tǒng) 在固有的資源上， 開(kāi)發(fā)了更多的服務(wù)項(xiàng)目 ； 對(duì)一些應(yīng)用系統(tǒng)的運(yùn)行效率提高了一倍多 降低成本， 提高資源利用率 通過(guò)自動(dòng)化管理， 降低了維護(hù)費(fèi)用 解決方案 Benefits 環(huán) 境 User B Workload Manager Workload Manager User A User A User B Platform LSF Platform ISF Copyright 2010 Platform Computing Corporation. All Rights Reserved. 21 Proprietary and Confidential: Platform Computing Corporation 3 個(gè) 層 次的云 計(jì) 算服 務(wù) 2014/9/16 21 Each level provides a higher level of service abstraction & may use lower level(s) 服務(wù)器， 網(wǎng)絡(luò)，存儲(chǔ)按需分配 e.g., Amazon EC2, S3 IaaS (Infrastructure as a Service，基礎(chǔ)架構(gòu)即服務(wù) ) APIs for developing new Cloud apps e.g., Google App Web PaaS (Platform as a Service，平臺(tái)即服務(wù) ) 應(yīng)用軟件對(duì)最終用戶(hù)按需分配 e.g., S SaaS (Software as a Service，軟件即服務(wù) ) Copyright 2010 Platform Computing Corporation. All Rights Reserved. 22 Proprietary and Confidential: Platform Computing Corporation 云 計(jì) 算體系架構(gòu) 服務(wù)調(diào)度和管理引擎 云計(jì)算平臺(tái) VM中間構(gòu)建 IAAS 調(diào)度分配引擎 資源池 IAAS 服務(wù)管理 SAAS PAAS 服務(wù)系統(tǒng) IAAS 服務(wù)平臺(tái) 服務(wù)應(yīng)用系統(tǒng) 云計(jì)算門(mén)戶(hù) IDC 服務(wù) Copyright 2010 Platform Computing Corporation. All Rights Reserved. 23 Proprietary and Confidential: Platform Computing Corporation Placement Engine Policy 9/16/2014 23 Placement Engine 1) Application Topology DB App Serv er App Serv er App Serv er Web Serv er Web Serv er 2) Resource Hierarchy 3) Network Access Cost Matrix (Available Bandwidth / Dynamic Utilization) DC Rack Group Rack Group Rack Group Rack Rack Tier 1 Tier 2 Tier 3 Rack Rack Rack Rack DC1 DC2 DC3 DC1 DC2 DC3 Rack1 Rack2 Rack3 R2 R2 R3 Output: - Initial Placement - Run-Time Management - Defragmentations& Migration Offering 1 300 Offering 2 200 Offering 3 400 Jan Dec Contract #123 Contract #444 Contract #677 Contract #677 Contract #888 Contract # 888 #999 Contract # 78934 Contract # 768689 Contract #55 Contract # 889 DC / 4) Previous reservations committed & Account Quotas 5) C-language plug-in placement policy: vem_policy_init() vem_policy_fin() vem_policy_distribute() vem_policy_place() vem_policy_housekeep() vem_policy_status() vem_policy_info() Copyright 2010 Platform Computing Corporation. All Rights Reserved. 24 Proprietary and Confidential: Platform Computing Corporation 基于 資 源可用狀 態(tài) 的分配策略 Packing（填滿(mǎn)） 應(yīng)用程序在盡量少的物理服務(wù)器上運(yùn)行 每個(gè)被使用的服務(wù)器利用率最大化，減少資源碎片，減少能源消耗。 Striping（分散） 應(yīng)用程序分散在盡可能多的物理服務(wù)器上運(yùn)行 減少機(jī)器故障帶來(lái)的影響，提高應(yīng)用程序的運(yùn)行效率 Load-Aware（基于負(fù)載） 新的應(yīng)用程序總是運(yùn)行在負(fù)載最輕的物理服務(wù)器上 獲得更高的應(yīng)用程序運(yùn)行效率 HA-Aware（基于高可靠性配置） 將支持高可靠性（ HA）的服務(wù)器資源分配給關(guān)鍵業(yè)務(wù) 提供更高的資源可用性 Energy-Aware（節(jié)能） 根據(jù)節(jié)能指數(shù)和數(shù)據(jù)中心熱點(diǎn)運(yùn)行應(yīng)用程序 減少能源消耗 Affinity-Aware（基于關(guān)聯(lián)程度） 將任務(wù)分配到與關(guān)鍵資源關(guān)聯(lián)度最高的服務(wù)器上，例如將任務(wù)分配到與存儲(chǔ)系統(tǒng)直連的服務(wù)器上 保證應(yīng)用程序運(yùn)行效率 Server Model-Aware（基于服務(wù)器類(lèi)型） 根據(jù)服務(wù)器類(lèi)型分配資源 盡可能利用性能好的、昂貴的資源，是投資回報(bào)最大化 Topology-Aware（基于網(wǎng)絡(luò)拓?fù)洌?盡量使用連接到同一個(gè)交換機(jī)、背板、刀片中心的服務(wù)器運(yùn)行用戶(hù)任務(wù) 提高應(yīng)用程序運(yùn)行效率 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 25 Proprietary and Confidential: Platform Computing Corporation PTM Framework Application-Aware 調(diào) 度 ISF Master Application Orchestrator KVM Hypervisor Resource Group Deploy & Monitor VMs Monitor Get historical usage Grow/Shrink Vmware Hypervisor Resource Group Physical Linux Resource Group Application Performance Manager ICM PVMO PTM Call ISF or send Alert 1 3 2 需求 : 動(dòng)態(tài)的調(diào)整業(yè)務(wù)應(yīng)用對(duì)資源的需求改變，而無(wú)須修改應(yīng)用的中間件 輸入： 1.系統(tǒng)負(fù)載參數(shù) (cpu, mem) 2.集成的應(yīng)用軟件效率管理系統(tǒng) 3.需求的調(diào)度策略 Copyright 2010 Platform Computing Corporation. All Rights Reserved. 26 Proprietary and Confidential: Platform Computing Corporation Add custom attributes about hosts from 3rd party tools via API Attributes can be used in scheduling & placement policies Useful to organize hosts by location, energy efficiency, model types, lease dates Supports both static and dynamic attribute updates 資產(chǎn) 管理與 監(jiān) 控 Asset DB Resource Updater Monitoring DB ISF CMDB API Copyright 2010 Platform Computing Corporation. All Rights Reserved. 27 Proprietary and Confidential: Platform Computing Corporation 資源使用數(shù)據(jù)用來(lái)做計(jì)費(fèi)和能力規(guī)劃 Rate Definition Usage Data Reserved Amount & Time On-Demand Amount & Time CPU Usage Mem Usage By Account By Application Def By User By Resource Group Platform ISF HPC Application Reporting App JBOSS App External Billing System Other Data Copyright 2010 Platform Computing Corporation. All Rights Reserved. 28 Proprietary and Confidential: Platform Computing Corporation 存 儲(chǔ) 的集成 10G 10TB Storage Containers 5G 100G 5TB 20TB 2G 10G Storage Adaptor ISF Master 25G 50G 適配器來(lái)發(fā)現(xiàn)存儲(chǔ)的內(nèi)容和生成存儲(chǔ)的資源池 用戶(hù)使用存儲(chǔ)資源就如同使用一個(gè)服務(wù)的定義 系統(tǒng)可以預(yù)約存儲(chǔ)資源 系統(tǒng)啟動(dòng)適配器來(lái)生成存儲(chǔ)的分配空間 工作流和后置配置步驟用來(lái)連接存儲(chǔ)服務(wù)器 Storage Manager APIs (EMC, NetApp) High Performance Mid-range storage Low-end storage Copyright 2010 Platform Computing Corporation. All Rights Reserved. 29 Proprietary and Confidential: Platform Computing Corporation 網(wǎng)絡(luò)集成 ISF Physical Device IP Pool Management LB Adapter FW Adapter SW Adapter Network Device Adapter IP Pool 1 IP Pool N Physical Device Physical Device Physical Device Physical Device External Pool Router Adapter Network Adapter Copyright 2010 Platform Computing Corporation. All Rights Reserved. 30 Proprietary and Confidential: Platform Computing Corporation 企 業(yè) 私有云 West Coast Data Center East Coast Data Center Europe Data Center ISF Market Place Broker Enterprise Messaging Infrastructure / JMS Enterprise DB Infrastructure Remote Proxy Leverage EGO capabilities to distribute ISF services across multiple nodes and provide centralized