IBM公司ESB、WEBSPHERE、SOA技術(shù)交流

1、ESB設(shè)計(jì)與最佳實(shí)踐,陸正武 IBM Certificated SOA Architect luzw,東風(fēng)汽車有限公司,2,議程,ESB 、SOA與WebSphere的關(guān)系 什么時(shí)候需要用到ESB ESB架構(gòu)標(biāo)準(zhǔn)實(shí)踐 ESB設(shè)計(jì)原則實(shí)踐 IBM關(guān)于建立東風(fēng)有限統(tǒng)一的ESB的建議方案 IBM ESB的獨(dú)特優(yōu)勢(shì) IBM ESB案例分享,ESB、SOA和WebSphere的關(guān)系,4,As Patterns Have Evolved, So Has IBM,應(yīng)用之間點(diǎn)對(duì)點(diǎn)的連接 實(shí)現(xiàn)簡(jiǎn)單、基本的信息交互和數(shù)據(jù)傳遞,傳統(tǒng)架構(gòu) 基于消息傳遞的模式,通過HUB模式實(shí)現(xiàn)應(yīng)用之間的整合 很容易管理大量的連接和系

2、統(tǒng),過渡架構(gòu) 企業(yè)應(yīng)用整合,通過企業(yè)服務(wù)總線實(shí)現(xiàn)服務(wù)的整合集中和流程實(shí)現(xiàn) 借助標(biāo)準(zhǔn)的接口靈活地連接，實(shí)現(xiàn)真正的隨需應(yīng)變,先進(jìn)構(gòu)架 面向服務(wù)體系架構(gòu) SOA,IT構(gòu)架的演變 The next stage of integration,5,一種充分利用開放標(biāo)準(zhǔn)，將軟件資產(chǎn)展現(xiàn)為服務(wù)的結(jié)構(gòu) 提供軟件資產(chǎn)標(biāo)準(zhǔn)的展現(xiàn)和交互途徑 在開發(fā)其他應(yīng)用的時(shí)候，可以將獨(dú)立的軟件資產(chǎn)封裝為一個(gè)一個(gè)的“積木” 更注重應(yīng)用之間的裝配而不是實(shí)現(xiàn)細(xì)節(jié),什么是SOA？為什么采用SOA？,封裝可以實(shí)現(xiàn)重用 采用獨(dú)立的實(shí)現(xiàn)接口描述，容易整合各種應(yīng)用 由于明確定義了應(yīng)用系統(tǒng)間的接口，容易實(shí)現(xiàn)應(yīng)用流程模型就象搭積木！,6,關(guān)鍵概念,S

3、OA通過明確的定義和松散藕荷來提升系統(tǒng)間的彈性: Service：服務(wù) 任何事情都可以是一個(gè)服務(wù), 一個(gè)實(shí)現(xiàn)了唯一功能的自包容的實(shí)體 Service 交互 外部用戶調(diào)用服務(wù) 服務(wù)可以彼此交互，調(diào)用操作和交換數(shù)據(jù) Service交互可以是間接的 Service 編排 通過調(diào)用服務(wù), 可以編排實(shí)現(xiàn)業(yè)務(wù)流程 Service 發(fā)現(xiàn) 一個(gè)注冊(cè)的服務(wù)可以在構(gòu)建時(shí)或者運(yùn)行時(shí)被發(fā)現(xiàn),7,Service Interaction,企業(yè)服務(wù)總線(ESB)概念經(jīng)常用來表示服務(wù)互相交互的機(jī)制，它提供 了通信的基礎(chǔ)架構(gòu) 企業(yè)服務(wù)總線應(yīng)當(dāng)提供: 一致的、位置透明的、協(xié)議獨(dú)立的手段來實(shí)現(xiàn)交互 一致的、位置透明的交互意味服務(wù)消

4、費(fèi)者和提供者之間可以是間接的 無論何種通信服務(wù)，應(yīng)提供端到端的連通保證,8,什么是Enterprise Service Bus？,An Enterprise Service Bus is a core component of a Services Oriented Architecture 它連接和集成企業(yè)和組織的IT infrastructure, across many locations, 支持不同的transport services, and 它可以自動(dòng)路由消息并且提供系統(tǒng)級(jí)的功能，如：消息的格式自動(dòng) 轉(zhuǎn)換, and 必須是基于標(biāo)準(zhǔn)的規(guī)范, and 這些必須是安全的、可靠的，并且在

5、高負(fù)荷的情況下可管理,9,ESB應(yīng)該有哪些服務(wù)？,傳輸服務(wù) 安全、可靠的數(shù)據(jù)傳輸 永久性/非永久性 同步/異步 仲裁服務(wù) 路由 格式轉(zhuǎn)換 事件服務(wù) 事件發(fā)現(xiàn)和發(fā)布 Publish / Subscribe,An Enterprise Service Bus (ESB) is a flexible connectivity infrastructure for integrating applications and services.,An ESB powers your SOA by reducing the number, size, and complexity of interfaces

6、.,10,業(yè)務(wù)創(chuàng)新和優(yōu)化,業(yè)務(wù)用面板,IT 對(duì)流程的支持,SOA 參考架構(gòu),11,IBM軟件助您實(shí)現(xiàn)整合計(jì)算,信息,流程,人員,軟件資產(chǎn)管理和整合開發(fā)平臺(tái),12,SOA參考框架下WebSphere產(chǎn)品線,IT 服務(wù)管理,業(yè)務(wù)創(chuàng)新和優(yōu)化服務(wù),業(yè)務(wù)應(yīng)用程序服務(wù),開發(fā)服務(wù),合作伙伴服務(wù),應(yīng)用程序和信息資產(chǎn),連接性服務(wù),流程服務(wù),信息服務(wù),交互服務(wù),Business Modeler,WebSphere,工具,Rational,Business Monitor,WebSphere,Tivoli,工具,Portal,WebSphere,Workplace,IBM,Information Integrato

7、r,BI Server Foundation,WebSphere,WebSphere,WebSphere,WebSphere,Application Server,Partner Gateway,MQ,WebSphere,Message Broker,WebSphere,Tivoli,Intelligent Orchestrator,Tivoli,Monitoring,Tivoli,Access Manager,Information Integrator,WebSphere,Business Integration Adapters,WebSphere,WebSphere,ESB,WebSp

8、here,Process Server,Integration Developer,WebSphere,DataPower,什么時(shí)候需要用 ESB,14,什么時(shí)候需要用 ESB,ESB 網(wǎng)關(guān) recommendation DataPower SOA Appliance for any external services to protect against XML threats 中介 between non-standards based systems and standards based systems 支持動(dòng)態(tài)更改提供者 (routing, replacement, load bal

9、ancing, protocol changes) Including versioning Minimize changes to requestors 支持請(qǐng)求者與提供者之間協(xié)議和數(shù)據(jù)格式不同時(shí)的交互 Adding new requestors who are not an exact match with provider Common security, management, monitoring enforcement,15,ESB架構(gòu)模式核心原則,ESB inter-connects requester and provider Interactions are decouple

10、d Supports key SOA principle separation of concerns ESB provides Service Virtualization of Identity via routing Interaction via conversion Interface via transformation ESB also enables Aspect Oriented Connectivity Security Management Logging Auditing Described in a whitepaper by Greg Flurry ,ESB,ESB

11、架構(gòu)實(shí)踐,17,1. 確定參考架構(gòu),ESB涉及多平臺(tái)，多項(xiàng)目 Usually spearheaded by a corporate Architecture team or Infrastructure team Needs participation and agreement from Networking, Security, Application Development, and Operations A Reference Architecture is a key document and process for securing this agreement across al

12、l stakeholders 核心架構(gòu)、設(shè)計(jì)和管控決策 可選的技術(shù)路線和設(shè)計(jì)模式 提供常見場(chǎng)景和使用實(shí)踐,18,定義接口和連接標(biāo)準(zhǔn),ESB功能全面，大多數(shù)企業(yè)不會(huì)使用到所有功能 You need to decide what connectivity options to allow both internally and externally 確定總線上實(shí)現(xiàn)哪些功能及gateways 和 adapters Gateways are access points for bridging on and off the bus Can be used as policy enforcement p

13、oints Adapters are mechanisms for bringing information onto or off of the bus 確定采用哪種標(biāo)準(zhǔn)路線 Emphasize industry standards for external (partner) communication 確定所支持的常見數(shù)據(jù)表示 Canonical message formats allow for shared transformation mediations,19,Expanded view of the ESB,20,以ESB為中心的邏輯模型,Outside ESB Busines

14、s Logic (Business Services) ESB does contain integration logic or connectivity logic Criteria: semantics versus syntax; aspects Loosely coupled to ESB Security and Management Policy Decision Point outside the ESB ESB can be Policy Enforcement Point,Tightly coupled to ESB Service Registry Registry a

15、Policy Decision Point for ESB ESB a Policy Enforcement Point for Registry But, Registry has a broader scope in SOA Tooling required for ESB Development Administration Configures ESB via Service Registry,ESB,Management Services,Security,Management,Application Services,Information,Process,Interaction,

16、Access,Business App,Partner,Registry,Development Services,21,2. 定義公共術(shù)語表,ESB沒有統(tǒng)一的術(shù)語 Vendors and clients are variable in their definition of what is part of the ESB and terminology IBM has varying terminology in our ESB products Patterns work has its own terminology 構(gòu)建ESB/SOA時(shí)非常重要的一點(diǎn)就是建立統(tǒng)一的術(shù)語表,22,使用規(guī)范

17、還是標(biāo)準(zhǔn)？,A specification outlines APIs/data/formats from one or more vendors working together Proposed by vendors to address a gap Often supported by some vendors software Usually submitted to a standards body More companies get involved, specification changes, sometimes merged with competing specifica

18、tions Goes through multiple drafts and reviews Standard is agreed to by the standards bodys committee members and is declared a version x standard Standards bodies vary by process, rigor, respect and adoption rate And specific standards vary wrt to adoption,23,3. Apply criteria on whether to use a s

19、tandard or specification,是否很好地描述了我們的需求? 標(biāo)準(zhǔn)是否覆蓋了我們的需求? 是否需要在不同平臺(tái)上的互操作性和可移植性? 采用的到底是標(biāo)準(zhǔn)還是規(guī)范，標(biāo)準(zhǔn)和規(guī)范的成熟度如何? 是否支持所有的供應(yīng)商平臺(tái)，版本是否具有連續(xù)性? 采用的標(biāo)準(zhǔn)是否支持WS-I? 我們的供應(yīng)商是否也支持? 是否需要采用最新版本的標(biāo)準(zhǔn)? 如果供應(yīng)商系統(tǒng)不支持現(xiàn)有標(biāo)準(zhǔn)，只支持早期的規(guī)范，如何移植? 是否可以增加一層標(biāo)準(zhǔn)的API，以保護(hù)你的代碼? 采用的標(biāo)準(zhǔn)和規(guī)范是否比我們所需要的更復(fù)雜?,24,4. 從企業(yè)基礎(chǔ)架構(gòu)中分離出業(yè)務(wù)邏輯,基本設(shè)計(jì)原則：需要分離考慮： Business logic doe

20、s not belong in mediations ESB 架構(gòu)于業(yè)務(wù)邏輯之上 - the business logic may put information into headers Example: business logic determines whether a customer deserves priority treatment, sets a flag in the header, the ESB routes to highest performing provider 分離業(yè)務(wù)邏輯和應(yīng)用程序邏輯 Use BPEL and choreography for that

21、instead,25,5. 采用基于模式的研究方法,Enterprise Integration Patterns (Hohpe) has a set of 60+ patterns that cover common messaging and EI situations Includes an abstract notation for representing the patterns Using this notation allows you to decide on the content and flow of the mediations without having impl

22、ementation considerations drive the process 幫助實(shí)現(xiàn)多個(gè)ESB產(chǎn)品之間耦合的配置 方便查找應(yīng)用程序之間的公共部分 在大多數(shù)ESB工具中容易實(shí)現(xiàn) (WMB, WESB, DataPower) Use the IBM Patterns for e-Business to map out your ESB topologies,26,EIP Patterns Organization,Application,Application,Message,Channel,Routing,Translation,Endpoint,Systems Management

23、,27,The SOA/ESB Design Pattern (P4eB),Demilitarized Zone,Web Services Gateway,Partner Zone,Enterprise Secure Zone,Enterprise Service Bus,Enterprise Service Bus Gateway,Back-end Resource Gateway,Domain Firewall,Inter-Enterprise Zone,Protocol Firewall,Network Infrastructure,28,6. 確定服務(wù)提供者查找方法論 ESB 需要提供

24、者的源頭,An ESB must send the message to one or more provider endpoints 在可選的提供者之間作出選擇 Options for managing endpoint lookup Not recommended No endpoint lookup (fixed addresses) Change endpoint administratively on the ESB servers Provider must keep track of all ESB servers which can call it IP spraying or

25、 load balancing between ESB and providers Limited to IP, providers maybe outside of your domain Endpoint(s) lookup from a registry 使用Cache，而不是直接向注冊(cè)庫 Providers update the registry with new endpoints Separates ESB from the providers 允許無縫增加新的providers 和ESB服務(wù)器,29,(6) Message is transformed and routed to

26、 the selected endpoint.,Message,(1) A Message is received,ESB Mediation,(2) Invokes a selection mediation.,(3) Retrieve requestor information,(4) Retrieves candidate providers information,Message,(5) Executes matching algorithm to identify the provider service for requestor service,Message,Service,D

27、ynamic selection,WSRR support WESB 6.0.2 mediation primitive Port Type match WMB SupportPac Port Type match General metadata retrieval DP and higher firmware,7. 使用 Service 注冊(cè)表,30,8. 確定Services版本方法,Option 1: 利用兼容的schema設(shè)計(jì)實(shí)現(xiàn) Option 2: 在ESB中實(shí)現(xiàn)多版本的. Option 3: 利用ESB在不同版本之間進(jìn)行轉(zhuǎn)換,31,Services Version

28、ing Approaches,32,9. 設(shè)置端到端的 QOS指導(dǎo)方針,在SOA中，性能方面的考慮比其他非SOA的應(yīng)用復(fù)雜得多 Need to include mediations and transports in performance budgets More shared resources to consider 需要了解每個(gè)service的負(fù)載及應(yīng)用程序中介的負(fù)擔(dān) 對(duì)SOA流程端到端的監(jiān)控計(jì)劃 采用可選的技術(shù)，如DP 和 WebSphere XD 來管理 QOS,33,10. 設(shè)立公共安全策略,ESB是共享資源，安全策略更為重要 This is a least-common den

29、ominator from which you can expand Security must be holistic Each enterprise has its own balance of risk and countermeasures but ultimately must support the business model for information protection & user access 定義端到端的安全模型 Document existing security practices, policies and requirements Perform a ri

30、sk assessment to document vulnerabilities and countermeasures to address known risks What are the legal issues involved? Are there requirements where policies are(/should be) being enforced? Is a manual procedure (code review) for application development the control point? 確定安全策略及策略控制點(diǎn),34,11. Determ

31、ine Ownership of the ESB,The question of who owns the ESB(s) often nearly stops many ESB projects 網(wǎng)絡(luò)組? 核心架構(gòu)組? 項(xiàng)目組管理 ESBs? 大多數(shù)案例中，中央集權(quán)的管理是成功的 在ESB中只部分需要共享的WEB資源 If centralization is impossible, then a central team should control federation,ESB設(shè)計(jì)原則實(shí)踐,36,1. 確定規(guī)范或不規(guī)范消息模型,在ESB中建議采用一致規(guī)范的消息模型. If any reque

32、ster or provider does not understand the canonical message (Hohpe), then the canonical message is transformed into the message format of the requester or provider. This transformation may be done by ESB or one the requester or provider. 如果沒有規(guī)范的消息模型，ESB就成了點(diǎn)對(duì)點(diǎn)的集成 Which increases cost to add new reques

33、tors and providers.,37,When do you adopt a standard or a specification? Industry Standards and XML Schema issues,ESB 采用工業(yè)標(biāo)準(zhǔn)的規(guī)范格式 在需要集成供應(yīng)商和客戶的系統(tǒng)時(shí)更需要采用工業(yè)標(biāo)準(zhǔn) 不同行業(yè)有自己的行業(yè)標(biāo)準(zhǔn) Some popular ones HL7 for healthcare, ACORD for insurance 有些客戶需要擴(kuò)展某些標(biāo)準(zhǔn) Many industry schemas leverage XML Schema elements that are no

34、t (yet) well supported by Web service environments/tools Most common examples are and xsd:choice Vendor support for these complex schema elements is varied in some cases proprietary or not fully supported Try to avoid those if you can JAX-RPC has limited schema support - JAX-WS 2.0 / JAXB 2.0 will s

35、upport full set of schema elements In our products JAX-RPC supported by WAS 5.0.2 6.1 so limited support WAS 6.0 and above, you can plug in JAX-B and/or custom serializers Web services feature pack will support JAX-WS and JAX-B WebSphere ESB and WPS have limited support,38,利用Adapters集成現(xiàn)有系統(tǒng),An ESB mu

36、st allow access to existing Enterprise Information Systems Adapters typically used, and may or may not be part of the ESB Technology 技術(shù)適配器 Application 應(yīng)用適配器 Legacy 遺留系統(tǒng)適配器 適配器與ESB的位置關(guān)系: Outside of the ESB, and inside the EIS domain Outside the ESB, and the EIS domain On the boundary of the ESB Insid

37、e the ESB Adapters兩個(gè)關(guān)鍵技術(shù)點(diǎn) Communication protocol Message format,39,2. 確定哪個(gè)應(yīng)用程序需要適應(yīng)總線,Who is responsible for building adapters on to the bus is a governance issue. It is frequently driven by ownership, power, and funding considerations. It may be influenced by the technical considerations Options: ES

38、B declares canonical messages and all requestors and providers adapt to the canonical format. ESB adapts all providers (or a limited set) to a canonical format. Requestors adapt to canonical format. ESB adapts requestors (usually legacy requestor) to canonical or provider specific format. ESB adapts

39、 directly from a provider format to a specific requestor format (basically point to point).,40,3. 僅當(dāng)需要的時(shí)候才用可靠性和事務(wù)處理功能,QoS includes not only performance but reliability measures as well Use reliable delivery sparingly Relatively high performance penalty Limited to some transports or standards 少用事務(wù) 利用

40、 services 而不是本地調(diào)用,41,4. 將基本信息放在消息頭中，而不是消息體中,Place infrastructure logic such as security, logging levels, client application identify in a header which is separate from the body of a message ESBs are designed to support separation of infrastructure processing from service logic and are frequently opt

41、imized to use headers. Its better to use headers which are protocol independent to allow header information to seamlessly flow across the various protocols the bus supports. No header mapping is required as the bus converts to a new protocol Included in SOAP is separation of the header from the body

42、 When designing your own message formats, have a header section and a body section,42,5. ESB聯(lián)邦設(shè)計(jì),基本上每個(gè)大型ESB項(xiàng)目都會(huì)遇到ESB聯(lián)邦 Multiple products used for ESB functionality Multiple sites dictate multiple product installations Organizational, Corporate or political boundaries may dictate the boundary of an E

43、SB ESB聯(lián)邦最佳解決方案是采用gateway Routing requests to the appropriate ESB (local or remote) Handling special security requirements across boundaries Providing logging and auditing requirements across boundaries Dealing with technology differences in transport or format,43,ESB 聯(lián)邦,WESB,WMB,HTTP Backbone WS-Sec

44、urity,MQ Backbone Transport Security,XI50 Gateway,站點(diǎn) 1,站點(diǎn)2,IBM關(guān)于建立東風(fēng)有限統(tǒng)一的ESB的建議方案,45,IBM ESB簡(jiǎn)介,標(biāo)準(zhǔn)的企業(yè)服務(wù)總線：WebSphere ESB 高級(jí)的企業(yè)服務(wù)總線：WebSphere Message Broker 企業(yè)服務(wù)總線Gateway：DataPower,46,WebSphere ESB 架構(gòu),C+ Client,.Net Client,WebSphere ESB,WebSphere Application Server,Tivoli Access Manager,DB2 Universal D

45、atabase,Edge Components,Java and C/C+ Web Services Client,Clients:,Messaging:,JMS 1.1,MQ interoperability,Mediation Function,Web Services:,WebSphere Adapter Support,XSLT,Message Router,Message Logger,DB Lookup,WS-*,SOAP/ HTTP,UDDI Registry 3.0,SOAP/ JMS,Lightweight Java Client coming,WebSphere Integ

46、ration Developer,SCA Programming Model:,SDO,SCA,47,WebSphere Application Server,Increased capabilities / automation,Business Process,ESB,A world-class J2EE foundation providing industry-leading levels of availability, scalability, and performance.,WebSphere Process Server,For customers who want a hi

47、gher level solution to design, automate and manage composite applications and operational business processes. Built on WebSphere ESB.,WebSphere ESB,A new product that delivers an Enterprise Service Bus. Provides Web Services connectivity and data transformation. Built on WebSphere Application Server

48、.,Subset,Superset,WebSphere ESB的位置,48,WebSphere ESB and WebSphere Message Broker,ESB: WebSphere ESB,Advanced ESB: WebSphere Message Broker,Customers face a range of ESB requirements. As a result, any given project might require an ESB or an Advanced ESB OR BOTH.,Web Services connectivity and data tr

49、ansformation,Web Services,JMS,WebSphere MQ,HTTP,XML,WebSphere Adapters,JMS,TIBCO Rendezvous,Web Services,Weblogic JMS,WebSphere MQ,TIBCO EMS JMS,HTTP,SonicMQ JMS,Biztalk,MQe,Tuxedo,Real-time IP,FTP,Multicast,MQTT,XML,COBOL Copybook,EDI-X.12,ACORD,EDI-FACT,ebXML,AL3,HIPAA,HL7,SWIFT,FIX,Custom Formats

50、,Word/Excel/PDF,Plus the following:,WebSphere Adapters,Universal connectivity and data transformation,核心版,高級(jí)版,49,SOA 利器 WebSphere DataPower,IBM 和 DataPower 利用專用的耐久性SOA設(shè)備 為SOA實(shí)施提供優(yōu)異的性能與硬件安全性 重新定義了中間件的界限，擴(kuò)大了SOA的基礎(chǔ)。,簡(jiǎn)化 SOA 專用的 SOA 設(shè)備，部署、管理及維護(hù)更加簡(jiǎn)便，降低成本； 保護(hù) SOA 集中化管理、豐富的安全策略，更高的可靠性，有力保障系統(tǒng)安全； 加速 SOA 無與倫比的

51、 XML 處理能力，大幅提高系統(tǒng)處理速度和吞吐量；,50,DataPower 典型應(yīng)用場(chǎng)景,保護(hù)對(duì)外的 Web 服務(wù) 支持合作伙伴、客戶安全地訪問記錄的后端系統(tǒng) 傳統(tǒng)系統(tǒng)集成 把大型機(jī)或傳統(tǒng)應(yīng)用連接到 Web 服務(wù)SOA HUB 式的中介服務(wù) 在應(yīng)用和 Web 服務(wù)間有效地轉(zhuǎn)換、路由、記錄消息 加速動(dòng)態(tài)的 Web 站點(diǎn) 加快 XML-HTML 渲染，用于動(dòng)態(tài)內(nèi)容生成,51,東風(fēng)汽車有限公司ESB建議方案,企業(yè)組ESB 部門/應(yīng)用級(jí)ESB ESB Gateway,52,企業(yè)級(jí)ESB典型方案,Enterprise Service Bus（MB）,交互服務(wù),Web頁面,內(nèi)部流程服務(wù),Web頁面,DM

52、S,召回系統(tǒng),SAP,OA,Adapter,SOAP/JMS/IIOP,SOAP/JMS/IIOP,SOAP/JMS/IIOP,SOAP/JMS/IIOP,SOAP/JMS/IIOP,新車銷售系統(tǒng),SOAP/JMS/IIOP,Enterprise Service Bus（MB/WESB）,SCM系統(tǒng),WEB展現(xiàn),53,WPS Cluster,開發(fā)與部署架構(gòu),WebSphere Message Broker,Broker Domain,WebSphere Message Broker,Broker Domain,ESB Cluster,User App,v6 Config Manager,Config Manager Proxy,User App,Config Manager Proxy,開發(fā),Adapter,MQ,JMS,HTTP/SOAP,WebSphere Process Server,Node Agent,WebSphere Process Server,Node Agent,IBM ESB的獨(dú)特優(yōu)勢(shì),55,為什么不采用傳統(tǒng)架構(gòu)，而是采用ESB總線方案,采用傳統(tǒng)架構(gòu)可以實(shí)現(xiàn)系統(tǒng)交互 自行開發(fā)定義系統(tǒng)間數(shù)據(jù)接口和應(yīng)用接口 采用總線的優(yōu)勢(shì) 利用開放標(biāo)準(zhǔn)，將軟件資產(chǎn)展現(xiàn)為服務(wù)