Building a Global EAI Architecture with BizTalk Server and

Document Sample
Building a Global EAI Architecture with BizTalk Server and Powered By Docstoc
					Building a Global EAI
Architecture with BizTalk
Server and XML Web Services


Eric Van Bever
Principal Application Architect
MS EMEA HQ
The Evolution of Integration
                                                                                                    Pervasive
                                                                                                   Integration
                                           future EAI technology

                       EAI technology maturity today                      Business Process Integration

                                                                       Web Services Integration
 Integration Needs




                                                                   User Interface Integration




                                                                                                                 Code Writing
                                                           Transaction Integration

                                                       Data Integration

                                            Security Integration

                     Network Integration



                                                           Time
                UDDI                            SAP                Great
              Web Service D&B         BizTalk              BizTalk Plains
                                                                            Northwind
                       Web Service
 Passport                                                                    Traders
Web Service                          Adventure Works        Gold Cycles




                                                                            Lakes
                Cycles                                 Contoso              & Sons
                Central                               Marketplace




                                                  Warehouse
                                                                             Picker


   Customers and Employees
    Architectural Overview
    Integration engine for hub/spoke or publish/subscribe

     Application A           Application B            Application C                       O
                                 Application Adapter            Technology Adapter        r
                                                                                   Business
                                                                                   Processc
                                 Receive Services
                                                                                    B h
S                                                                           Web     i e
E
C
U
          BizTalk Server 2002
             HTTP


              BizTalk
                         SMTP      MSMQ

                                 Routing Services
                                                 MQSeries     File
                                                                          Service
                                                                                    z s
                                                                                    T t
                       Messaging Bus
             Declarative Routing      Content Based        Publish/Subscribe

                                                                                    z r
R
I
T
                          Messaging
                             Transformation Services
         Cost effectively integrate applications a                                  l
              XML                EDI                 Flat            Custom
Y                                                                                         t
             within and between organizationsk i
                                 Delivery Services

        Tracking Editor Messaging Mapper Application Administration
                                                                                          o
                                Desk                  Designer                            n
    Application Adapter
     Application D            Application E           Application F
  From Corporate Message Mess
  Programmatic Integration is expensive
$1 of Application Spending    $5-$20 of Integration Spending

                                                  Accounting

                                                    Cust
                                                   Service

                                                  Operations

                                                    ERP
                                                  Package

                                                   Mobile
                                                   Server

                                                    Web
                                                    Dept
Gartner: 10/01
From Corporate Message Mess
Point to Point Integration is Complex



Customers                         Operations




                           Web
Participating
                Internet   Dept
                                   My Bank     Accounting
    Bank




                                    Cust
Merchant                           Service
To Corporate Message Bus
                                         Routing?
Integration engine : where is the world going?
                                         Transactions?
                                                               Security?
                                                               Business Processes?
                                                               Referrals?
                                                               Reliable Messaging?
                                                      Operations
Customers
                                                               Services
                                                    XML Web Binary attachments?
                                                               Transformations?
                                             XML               WSDL - UDDI
                                                    – SOAP – …..


Participating                    Web                                            Accounting
    Bank        Internet         Dept
                                              Multi Transport Message Routing
                                          Validation, Transformation, Encryption…

                                        Orchestration, Transactions and State Mgmt …
                                                           Cust
Merchant                                                  Service
                           Auditing &        Registry &
                            Tracking                          Monitoring        Deployment
                                              Security
To Corporate Message Bus
Integration engine : where is the world going? Distributed
                                                                                  Physical
                                                                                Hub & Spoke



Customers                                                 BizTalk
                                                       Operations
                                                             Server
                                                             Group                   Flat
                                                                                    Logical
  BizTalk
Participating                    Web
                                                                                     Bus
                                                                                 Accounting
   Server
    Bank        Internet         Dept
   Group                                      Multi Transport Message Routing
                                          Validation, Transformation, Encryption…

                                        Orchestration, Transactions and State Mgmt …
                                                           Cust
Merchant                                                  Service
                           Auditing &        Registry &
                            Tracking                          Monitoring         Deployment
                                              Security
The conceptual model for this process is illustrated below :
1.The Replenishment System generates order requests which are subsequently entered
into the ERP System.
2.The ERP system then creates a purchase order (PO) corresponding to each request
and sends the PO to the appropriate supplier.
3.The supplier then sends back an acknowledgment that it received the PO.
4.Once the ERP system receives the acknowledgment, the Replenishment System
needs to be updated to reflect that the request has been accepted.

                                               rs_request_out           2
                                               MSMQ
                      1
                          XML       Manual                                  Manual
                                    Process                                 Process
                                1                                                     2    ERP System
                                                           ERP System
      Replenishment
      Replenishment                                                                       Supplier
         System
         System                        BSS_Replenishment

        ASP/COM+                                                            Manual
                                              SQL Server                            3
                                                                            Process
                                    Manual
                                    Process                             4
                      4
                .\private$\rs_request_out

                                             Queue                   BizTalk          Orchestration
Replenishment
                        MSMQ                Receive                 Messaging
   System                                                                                 Begin
                                            Function


                                                                                      Receive New
                                                                     BizTalk             Order
                                               AIC                  Messaging

            <NW_Request_RS>                                                Save Correlation   COM+
RS---4       05/28/20025404.91         4568 12300                   7
             <Request RS_RequestID="4" RequestDate="2002-05-28T17:23:49.590" Total="5404.91"> Object
419                                                                              Info
               <LineItem LineItemID="29" ProductID="1" Quantity="7"
RS---4        \\machinename\erpshare\OrderIn
             05/28/20025404.91         4568 12301                   6
                 Price="419" SKU="4568 12300" Name="19 Inch Monitor" />
21.95                                                    BizTalk
               <LineItem LineItemID="30" ProductID="2" Quantity="6"         Send Order to
RS---4           Price="21.95"         4568 12301"      Messaging   1
             05/28/20025404.91SKU="4568 12304 Name="Optical Mouse" />            ERP
299.95         <LineItem Order
                    New LineItemID="31" ProductID="3" Quantity="1"
...                   Receive
                 Price="299.95" SKU="4568 12304" Name="Laser Printer" />
    ERP                                                                     Receive Order
                                   ...                                           Ack
              \\machinename\erpshare\OrderAckOut
             </Request>
            </NW_Request_RS>
                                                         BizTalk           Send Order Ack
                                       File Receive
                                                        Messaging               to RS
                       Order Ack         Function
                         Drop

                                                       .\private$\ReceiveRequestAck        End
                                                            (unique per instance)

                                      AIC                         MSMQ
To Corporate Message Bus



                       Corporate Bus



BizTalk Server                           BizTalk Server
    Router                                   Router


      Department Bus                   Department Bus
 Portal Integration
                                                                        CMS




                                                                                  Load Balancer
                   CMS
                    CMS
    SPS
Environment
                             Site
                                                                        CMS
from Intranet
 Deployment
                          Deployment
                                                  SQL
                  SQL      Manager




                                                                                                             Internet
                                                            Firewall
  Content Production or Staging                                         CMS




                                                                                                  Firewall
                SAP                    Firewall

                                                  BizTalk
                Siebel                                                 SPS
                                                                       Index

                 …                                                     SPS
                                                                       Search
                                                                                Production
To Corporate Message Highway
New Opportunities


                                                              Huge
Customers                                 BizTalk          Opportunity
                                          Server                For
                                          Group             Business
                                                           Intelligence

  BizTalk
Participating              Web                    Cust
                                    Operations              Accounting
   Server
    Bank        Internet   Dept                  Service
   Group



Merchant
                           Mobile      ERP        Portal     Message
                           Server    Package     Package      Broker
To Corporate Message Highway
New Opportunities


                                      BizTalk ServerGroup
 SWIFT                                       BizTalk
                                                 +
                                             Server
                                  Financial Services Accelerator
                                             Group
                                               (FSA)

Participating              Web                     Cust
                                     Operations             Accounting
    Bank        Internet   Dept                   Service




Merchant
                           Mobile       ERP        Portal    Message
                           Server     Package     Package     Broker
  To Corporate Message Highway
  Reduce Time, Effort and Cost of Integration
$1 of Application Spending      $1-$2 of Integration Spending

                                                    Accounting

                                                     Cust
                                                    Service

                                                    Operations

                                                      ERP
                                                    Package

                                                     Mobile
                                                     Server

                                                      Web
                                                      Dept
Gartner: 10/01
Adapters & Accelerators
Adapters!
Why Should I Worry?
•   Provide non-intrusive
    connectivity to
    existing systems
•   Reduce
    implementation and
    maintenance cost
    versus coding
•   Reduce TCO,
    complexity, need for
    special skills
•   Ease the process of
    system upgrades         Buy <-> Build
•   Improve your ability
    to meet process
    integration business
    objectives
Adapters!
Why Should I Worry?
•   Provide non-intrusive
    connectivity to
    existing systems
•   Reduce
    implementation and
    maintenance cost
    versus coding
•   Reduce TCO,
    complexity, need for
    special skills
•   Ease the process of
    system upgrades              Buy <-> Build
•   Improve your ability    Intrusive <-> Non-Intrusive
    to meet process
    integration business
    objectives
Adapters!                         SAP
                                  JDE
                                                         RosettaNet
                                                             CICS
                                                              IMS
Why Should I Worry?             Oracle       A       A        DB2
                              Great Plains
                               Navision                   MQSeries
                                Mapics                   SQL Server
•   Provide non-intrusive     PeopleSoft             A      ODBC
    connectivity to              Scala
                                             A
                                                             JDBC
                                                              ADO
    existing systems             Siebel
                                                            Oracle
                                 Onyx                A     Informix
•   Reduce                     WorldTrak
                                                             IDMS
                                Clarify
    implementation and          Pivotal
                                                             J2EE
    maintenance cost           McHugh        A       A      CORBA
                                                              JMS
    versus coding               Kewill
                                                          Progress
                                 Eqos
                                                            Ingres
•   Reduce TCO,                 Ariba                A        Java
    complexity, need for    Commerce One
                              VerticalNet
                                                          IBM 3270
    special skills              Clarus       A       A
                                                            DEC VT
                                                              FTP
                              Peregrine
•   Ease the process of            …
                                                              EDI
                                                               …
    system upgrades
                                    More than 310 adapters!
•   Improve your ability
    to meet process
    integration business
    objectives
Microsoft Adapters
•   Host Integration Server 2000
    •   CICS and IMS COM interface
    •   MSMQ-MQSeries Bridge
    •   DB2/VSAM access and replication

•   BizTalk Server Adapter for SAP
    •   RTM December 2001
    •   SAP Certified

•   BizTalk Server Adapter for MQSeries
    •   RTM October 2001

•   BizTalk Server Adapter for SQL Server
    •   Beta version - RTW

•   BizTalk Server Adapter for Web Services
    •   RTM October 2002 - RTW
Host Integration Server 2000
Integration with Host Systems


                                            Providing Comprehensive
                              APPLICATION   Application & Transaction
                                            Integration


                                    DATA    Providing Comprehensive
                                            Data Integration


                                            Providing Integrated Security
                               SECURITY
                                            Integration


                                            Providing Comprehensive
                                NETWORK
                                            Network Integration


  Providing a Comprehensive Set of Components for Integrating
                 Windows with Host Systems
HIS 2000 - Messaging Integration
With BizTalk Server
                                                          Synchronous (COM+-based)

                                                   Invocation                 Execution
                                                                               CICS or IMS
           EDI
                                        LOB          COMTI
                                       Adapter

                                                 Business Process
                                                                             DB2  VSAM
                                          COM                              IMS DB
                 Transformation
Receive          BizTalk Server 2000
                                                    OLE DB                    DDF or DFM

Transmit
                  Orchestration
                                                       Asynchronous (Messaging-based)
                   Scheduling
                                         MSMQ
                                                   Invocation                 Execution
                                                 MSMQ - MQSeries               MQSeries
                                                     Bridge


                                                                           Legacy Apps & Data
Security Integration
Single Sign-on and Password Sync
                                       PDC
                        Top Tier
                        Domain
                                          RACF, Top Secret, ACF/2
          Host                        Host
          Account PDC              Integration
          Cache                      Server

                                                  OS/400
                Resource
                 Domain
 Windows 2000
 Professional
UNIX Integration
               Windows
Applications   Clients      UNIX Server     UNIX
                                           clients



  Security
                            Windows 2000
                            Server
   Data

                          Windows
  Network                Services for
                          UNIX 3.0
    UNIX                     NetWare
                             Server
To Corporate Message Bus
Integration engine : where is the world going?

                                                                                   But,
                                                                                this is not
Customers                                                 BizTalk
                                                       Operations                    a
                                                             Server                Web
                                                                                 Service!
                                                             Group

  BizTalk
Participating                    Web                                            Accounting
   Server
    Bank        Internet         Dept
   Group                                      Multi Transport Message Routing
                                          Validation, Transformation, Encryption…

                                        Orchestration, Transactions and State Mgmt …
                                                           Cust
Merchant                                                  Service
                           Auditing &        Registry &
                            Tracking                          Monitoring        Deployment
                                              Security
To Corporate Message Bus
Integration engine : where is the world going?

                                                                                  Let’s
                                                                                 turn it
Customers                                                 BizTalk
                                                       Operations                into a
                                                             Server               Web
                                                                                Service!
                                                             Group

  BizTalk
Participating                    Web                                            Accounting
   Server
    Bank        Internet         Dept
   Group                                      Multi Transport Message Routing
                                          Validation, Transformation, Encryption…

                                        Orchestration, Transactions and State Mgmt …
                                                           Cust
Merchant                                                  Service
                           Auditing &        Registry &
                            Tracking                          Monitoring        Deployment
                                              Security
BizTalk Server & Web Services
                                          SME’s     Government Marketplaces
                               Mobile Users     Business    Portals
•   Enterprise Web Services -
    BizTalk Server
    orchestrates business logic
    which may be exposed as
    Web Services
•   BizTalk Server
    orchestrates business logic                            Web-Services
    which may be contained on
    legacy systems
•   Many business scenarios                                       Biztalk
    require Orchestration of
    both Web Services and
    Legacy Systems              EAI
•   BizTalk Server exposed as
    a Web Service
Two Interfaces
•   Client Interface
    •   Submit an XML purchase order through a
        <WebMethod>
•   Enterprise Interface
    •   Procurement process transaction takes
        27 days
    •   View the whole Purchase Order Process
        in one diagram
    •   Some suppliers support flat-files only
    •   Some small suppliers support email only
BizTalk Adapter for Web
Services
Feature Highlights
•  Publishing Side
    •   Run-time: Exposes back-end systems as web
        services
    •   Design-time: Convert XDR schemas to web
        services
    •   Generate WSDL
•   Consuming Side
    •   Provide samples
BizTalk Adapter for Web
Services

                          MMC
                         Snap-in            BizTalk

                                      XML                          SAP

Web       Web                                 BTM       Adapters
Client   Server XML     Run Time      XML




                                                                   Siebel
                                            BTS Store
                      Event Log ATU
An Example
PO   Hub                                     Supplier
                     Purchase Order



                        Invoice


            Web         Payment        Web

           Service   Payment Ack      Service
Web Services Aggregation
•   “SOAP [WebServices] …. will evolve into a
    semichaotic system of integrated services” –
    Charles Gosling
•   But.. BizTalk Server orchestrates Web Services
    to a single coherent process

      Web              Web
     Service          Service
        1                2



     Web               Web
    Service           Service
       3                 4
To Corporate Message Bus



                       Corporate Bus



BizTalk Server                           BizTalk Server
    Router                                   Router


      Department Bus                   Department Bus
To Corporate Message Bus



                         Corporate Bus


Web Service             WS-Security        Web Service
  Router               WS-Transactions       Router
WS-Routing                WS-DIME          WS-Routing
                         BPEL4WS
      Department Bus         ….          Department Bus

                          See WS-I