Language Service Scheduler Resume - PowerPoint

Document Sample
Language Service Scheduler Resume - PowerPoint Powered By Docstoc
					Open Source Job Scheduler




                                           Architecture and
                                           Mode of Operation


                                           http://jobscheduler.sourceforge.net
Software- und Organisations-Service GmbH                             www.sos-berlin.com
Contents



      Components
      Platforms & Databases
      Architecture
      Job Configuration
      Deployment
      Distributed Processing
      Security
      Failsafe Operation



Software- und Organisations-Service GmbH   www.sos-berlin.com
Icons used on these pages



         supported     Works with all                       Jobs
          platforms    supported platforms     Job



                       Works with all                       Managed Jobs are stored
         supported                             DB
          platforms    supported platforms                  in a database
                       and Java               Managed Job



            any        Any platform of your                 Javascript is required for Ajax GUI
          platform
                       choice applicable



         supported     Works with all
         database      supported databases



             any       Any database of your
          database
                       choice applicable




Software- und Organisations-Service GmbH                                                          www.sos-berlin.com
Components


Run-time Components for Job Execution


              Engine & Operations GUI                                                                                   Backup Engine



       Jobs and job chains are executed in the Job Scheduler Engine in batch mode                                  Backup Job Scheduler instances
                                                                                                                     are used for failsafe operation
       The built-in Operations GUI is accessible for browsers and is used to control
        jobs and job chains, e.g. start, stop, suspend, resume, and to access log files                             Failover is performed automatically




Design-time Components for Job Configuration

        Hot Folders                                                     Job Editor GUI                               Managed Jobs GUI



                                                                  Define jobs and job chains with a client GUI     Define jobs and job chains by browser
       Hot Folders store job configurations                                                                         (same functionality as Job Editor GUI)
                                                                  (same functionality as Managed Jobs GUI)
        and are monitored by Job Scheduler
        for changes that are immediately                          Store job configurations in XML files on disk    Store job configurations in a database
        detected and automatically applied by                                                                       Submit jobs and job chains to one or
                                                                  Manage job configurations with Hot Folders
        the respective Job Scheduler instance                                                                        more Job Scheduler instances


Software- und Organisations-Service GmbH                                                                                     www.sos-berlin.com
Platforms & Databases



Supported Operating Systems                Supported Databases
      Windows 2000, 2003, XP, Vista          DB2 8.x, 9.x
      Linux starting with kernel 2.4         Oracle 8.1.7, 9.x, 10.x
      Solaris 8, 9, 10                       SQL Server 2000, 2005
      HP-UX 11 (PA-RISC, IA-64)              Sybase ASE 15
      IBM AIX 5.3                            Firebird 1.5
                                              MySQL 4.1, 5.x
                                              PostgreSQL 8.x




Software- und Organisations-Service GmbH                          www.sos-berlin.com
Architecture
Single Server Operation

                                                                                                    At a Glance:
                             Browser
                                                                                                       You can operate the Job
                   any                                                                                  Scheduler on a single server
                 platform
                                                                                                        without a database.

                                     Access Operations GUI                                             If you want to operate Job
                                     to control jobs                                                    Scheduler without a
                                                                                                        database, no additional
                                                                                                        software is required.
                                                                                                       The implementation of the
                                                                    Job Editor GUI                      Job Scheduler includes a
                      Engine & Operations GUI                                                           built-in Operations GUI.
         supported                                                               supported
          platforms                                                               platforms            You can use the Job Editor
                                                                                                        GUI to configure jobs that
                                                                                                        are stored as XML files.
                                              Execute and control            Manage and configure
                                              jobs and job chains            jobs and job chains       Use any of the supported
                               Job                                                                      platforms.



                                        Job                                                         By the way!
                       Job
                                                                                                     You can use any editor of
                                                                                                        your choice to manage job
                                                                                                        configurations in XML files.


                              Individual
                             Application




Software- und Organisations-Service GmbH                                                                     www.sos-berlin.com
Architecture
Using a Database with regard to Compliance
                                                                                                          At a Glance:
                                                                                                             If you decide to use a data-
                                                                                                              base, then you can locate it
                         Browser                                                                              on any host and platform.
             any
           platform
                                                                                                             Connectivity is established
                                                                                                              per JDBC.
                              Access Operations GUI
                              to control jobs                           Job Editor GUI

                                                                                          supported
                                                                                           platforms



                Engine & Operations GUI                                            Manage and configure

                                                                                                          By the way!
                                                                                   jobs and job chains
                                    supported
                                     platforms
                                                                                                             The advantage of using a
                                                                                                              database is that you keep
          Execute jobs
                                                                                                              track of the job history and
                                                                                                              log files for compliance of
                                                        Job                                                   your IT processes.
                                                                     Store job history
                                                      Scheduler
                              JDBC Connectivity       Database
                                                                     and log files                           Job history and log files can
                      Job
                                                                                                              be accessed directly by the
                                                                                                              Operations GUI per browser.

                                                                    any       supported
                                                                  platform     dtabase




Software- und Organisations-Service GmbH                                                                            www.sos-berlin.com
Architecture
Accessing Company Databases

                                                                                               At a Glance:

                                                                                                  If you want to use a data-
                                                                                                   base, you can use different
                                                         Company     Execute SQL and
                                                                                                   products for your architecture.
                                                         Company
                                                         Database
                                                         Database    stored procedures            For example you could add
                                                                                                   a company database for the
                               Job                                     any                         execution of SQL statements
                                                                                  supported
                                                                     platform      dtabase         and stored procedures by jobs.
                                                                                                  You can use a different
                                                                                                   database product for the job
                                                                                                   history and log files of
                  Engine & Operations GUI                                                          Job Scheduler.

                                           supported
                                            platforms



              Execute jobs
                                                           Job
                                                                     Store job history
                                                         Scheduler
                                     JDBC Connectivity               and log files
                                                         Database
                         Job
                                                                         any       supported
                                                                       platform    database




Software- und Organisations-Service GmbH                                                                www.sos-berlin.com
Job Configuration
Using Hot Folders

                                                                                                                     At a Glance:

                                                                                                                        If you use Hot Folders then
                                                                                                                         Job Scheduler will
                                                                                                                         automatically monitor
                                                           Store jobs
                                                           and job chains                                any
                                                                                                                         changes to the configuration.
                                 Job Editor GUI                                   Hot Folders          platform
                                                                                                                        The Job Editor GUI enables
                                                                                                                         you to manage configurations
                                              supported                                                                  in Hot Folders on disk.
                                               platforms
                                                                                                                        The Job Scheduler monitors
                                                                                                                         the Hot Folders constantly.
                                                                                           Jobs and job chains
                                                                                           are stored in XML files
                                                                                                                         Any changes are immediately
                                                                                                                         detected.

                                                            Monitor Hot Folders and
                                                                                                                        The requested changes are
                                                            apply changes to jobs                                        applied right away without
          Engine & Operations GUI                                                                                        the need for a restart of
                                                                                                                         Job Scheduler.
                                     supported

                                                                                                                     By the way!
                                      platforms



                          Execute jobs
                                                                                                                      You could still use at any time
                                                                                                                         your favorite editor in order to
                                                                                                                         configure jobs in Hot Folders.
                    Job




Software- und Organisations-Service GmbH                                                                                       www.sos-berlin.com
Job Configuration
Using Managed Jobs GUI

                                                                                                                    At a Glance:
                                                                                              Browser
                                                                                                                       If you want to use the
           supported                                                                                                    Managed Jobs GUI with a
            platforms                                                   Access Managed Jobs                             web server, PHP and DB
                                 PH                                     GUI for configuration
                                PHP                                                                                     extension, you will require a
                                                                                                                        database client to access
                                                                                                                        the database.
       Web Server
      Web Server                                     Managed Jobs GUI   Store jobs and                                 The Manged Jobs GUI is
                                                                        job chains            Job                       operated with Apache or IIS.
                                                                                           Scheduler
                            DB Extension                                                 HotDatabase
                                                                                             Folders
                                                                                                                       The Jobs are stored in the
                                                                                                        supported       Job Scheduler database.
                                                                                                        database
                                                                                                                       The Job Scheduler applies
                                                                                                                        changes after submission
                                      Submit changes to                                                                 by the Managed Jobs GUI.
                                      jobs and job chains


                                                                        Apply configuration                         By the way!
                                                                        on start-up
                                                                                                                       LAMP or WAMP will
                        Engine & Operations GUI
                                                                                                                        facilitate this solution
                                                                                                                        perfectly, configurations with
                                                  supported                                                             PHP are easier to handle.
                                                   platforms


                                      Execute jobs



                                  Job




Software- und Organisations-Service GmbH                                                                                      www.sos-berlin.com
Job Configuration
Mixed Usage of Hot Folders and Managed Jobs
Access Job EditorGUI
for configuration
                                                                                                           At a Glance:
                                 Changes become                               any
                                 active imediately                          platform                        You can use both Hot Folders
                                                                                                               and the Managed Jobs GUI to
                                 Store jobs                                                                    manage configurations.
                                                           Hot Folders          Monitor Hot Folders
    Job Editor GUI               and job chains in
                                                                                and apply changes           Configurations in Hot Folders
                                 XML-Files
                                                                                to Job Scheduler               are automatically synchronized
               supported
                platforms                                                                                      with Managed Jobs database.
                                                                                                              Configurations in the Managed
                                                                                                               Jobs database are automati-
                                                                                                               cally written to Hot Folders.
                                                                                                 Browser      The requested changes are
                                                         Submit jobs/                                          applied right away without
                                                         job chains to       Job
                                                                                                               the need for a restart of
                                                         Hot Folders
                                                                                                               Job Scheduler.
Access Managed Jobs
GUI for configuration                                                    Job synchronizes Hot
                                 Changes become active                   Folders automatically

                                                                                                           By the way!
                                 when submitted by                       with the database
                                 Managed Jobs.

  Managed Jobs GUI                                            Job                                                                    Hot Folders
                                 Store jobs
                                 and job chains in
                                                            Scheduler                                       You could still use at any time
                                                            Database                                           your favorite editor in order to
              supported          Database
               platforms                                                                                       configure jobs in Hot Folders.




Software- und Organisations-Service GmbH                                                                             www.sos-berlin.com
Deployment
                                                                          Hot Folders




Deploy Jobs and Job Chains by Hot Folders

                                                                                                                    At a Glance:

                                                                                                                       Job Scheduler Supervisor
                                                                                                                        replicates job configurations
                                                               Store jobs                                               from Hot Folders to the
                                                               and job chains                              any          Workload Instances.
                                         Job Editor GUI                             Hot Folders          platform
                                                                                                                       Some jobs are deployed to
                            supported
                             platforms
                                                                                                                        all instances while other
                                                                                                                        jobs are deployed to specific
                                                                                                                        Workload Instances.
                                                                                                                       Workload Instances connect
                                                                                           Monitor changes to
                                                                                                                        on start-up to a Supervisor
                                                                                           jobs and job chains
                                                                                                                        Instance and update their
                                                                                                                        jobs and schedules.
                                                                                                                       Workload instances can
                                            Workload                                                                    execute jobs independently
                                                                                                                        of a Supervisor Instance.
                                         Replicate jobs and job chains                                                 Workload Instances re-
                 Workload                to multiple Workload Instances             Supervisor &                        connect automatically to a
                                                                                   Operations GUI                       Supervisor Instance after
    supported                                                                                                           network outages.
     platforms                                                                                      supported
                                                                                                     platforms


                        Workload




Software- und Organisations-Service GmbH                                                                                     www.sos-berlin.com
Deployment
Deploy Jobs and Job Chains by Managed Jobs GUI

                                                                                                             At a Glance:
                                                                                                                Jobs for multiple Job
                                                                                                                 Scheduler instances are
                                                                                                                 stored in a central database.
                                                                    Managed Jobs GUI
                                                                                                                With the Managed Jobs GUI
                                                                                                                 you can set up jobs and job
                                                                supported
                                                                 platforms                                       chains and manage their
                                                                                   Manage jobs and job
                                                                                                                 configuration centrally.
                                                                                   chains for multiple Job
                                                                                   Scheduler instances




                           DB Extension                                                                      By the way!
                                                                                                                This solution will be most
                                        Engine                                                                   suitable if you intend to
                                                                                                                 operate an arbitrary number
                                                                                                                 of Job Schedulers with a
                                    Apply jobs and job chains
                                                                               Job                               large number of jobs and
                  Engine            from a central database
     supported                                                               Scheduler      supported            job chains.
      platforms                                                              Database       database




                           Engine




Software- und Organisations-Service GmbH                                                                              www.sos-berlin.com
Distributed Processing
Remote Execution

                                                                                                      At a Glance:

                                                                                                         Job Scheduler supports the
                                                      SSH Server                                          execution of jobs via SSH
                                                                                any                       on remote hosts. No SSH
                                                                              platform
                                                                                                          client is required.
                                                                                                         Job Scheduler supports the
                                                                                                          execution of jobs on remote
                                                     Execute jobs on a remote                             Job Scheduler instances.
                                               Job   host that runs an SSH server
                                                                                                         Job chains for execution
                                                                                                          of individual job steps on
                                                                                                          remote hosts are supported.
                              DB Extension
                                                                                                      .
                       Engine
          supported
           platforms

                                                              Execute jobs on a remote
                                                      Job
                                                              Job Scheduler instance
                        Job




                Distribute a job chain                Job
                to multiple Job Scheduler
                instances on different hosts                                    Engine
                                                                                         supported
                                                                                          platforms


                        Job




Software- und Organisations-Service GmbH                                                                       www.sos-berlin.com
  Distributed Processing
   Load Balancing

                                                                                                              At a Glance:
                                                                                                                 For Load Balancing you can
                                                                                                                  operate an arbitrary number
                                      Network Storage                                                             of Job Schedulers in parallel.
                                                                    any                                          All Job Schedulers use the
                                                                  platform                                        same job configurations and
                                                                                                                  database.
                                                                                                                 Job configurations are
                                                                                                                  loaded from a network
                            Job Configuration      Job Configuration                                              storage, alternatively from a
                                                                                                                  clustered database
             Engine
                             DB Extension                                               Engine
                                                                                                 supported
                                                                                                                  (Managed Jobs).
                                                                                                  platforms
                      Fetch Enqueued Orders        Fetch Enqueued Orders
supported
 platforms                  Store Job History      Store Job History                                             Job Schedulers concurrently
                          Store Order History      Store Order History                                            execute jobs and job chains
                                                                                                                  that are synchronized by a
                                                                                                                  central database.


                                                                                                              By the way!
                                                                                                                 This solution fits well if you
                                        Database                                                                  want to scale the same
                                         Cluster                                                                  jobs for parallel processing
                                                                supported      any                                on multiple hosts.
                                                                database     platform
                                                                                                                 Since you can process jobs
                                                                                                                  parallely you can achieve
                                                                                                                  high efficiency in your
                                                                                                                  processing time.




  Software- und Organisations-Service GmbH                                                                              www.sos-berlin.com
Distributed Processing
Event Processing

                                                                                                    Step 2                              At a Glance:
                                                                                                    Cascaded event processing:
                                                                                                    - process stylesheets or               Any jobs or Third Party
                                                                                                    - process scripts                       Applications could submit
                                                               Step 1
                                                                                                    - per job, per event class              events to the Supervisor
                                       Third Party             Submit event:                                                                Job Scheduler (step 1).
                                       Application
                              any
                                                               - via TCP/IP                                                                The Supervisor hands over
                            platform                           - via Shell Script                                                           events to a cascade of
                                                                                                        Stylesheets/                        event handlers that are
                                                                                                         Scripting
                                                                                                                                            implemented as XSLT
                                                                                      Step 2                                                stylesheets or scripts
                                                                                                                                            (step 2).
                                                                                                                      Step 3
                                                                                     Hand over of
                                                                                     an event to                      Receive XML           Event handlers implement
                                                              Step 1                 to the event                     answer for job        individual conditions for
                                                                                     handlers                         starts from the       job starts and return the
                                          Workload           Submit event
                                                                                                                      event handlers        respective XML commands
                                                                                                                                            should a job or job chain be
                                       Step 4 Start jobs/ job chains                                                                        started (step 3).
                 Workload                      triggered by events                   Supervisor &                                          The Supervisor causes the
                                                                                    Operations GUI                                          respective jobs/ job chains
    supported
     platforms                                                                                           supported
                                                                                                                                            to be started in the remote
                                                                Step 4                                    platforms                         Workload instance (step 4).
                                                     Start job/ job chain                                                               .
                        Workload




Software- und Organisations-Service GmbH                                                                                                        www.sos-berlin.com
Distributed Processing
Event Processing: Submitting Events

                                                                                                                              At a Glance:

                                                                                                                                 Any jobs or Third Party
                                                                                                                                  Applications could submit
                                                        Step 1                    Start a Shell Script:
                                                                                                                                  events to the Supervisor
                                         Third Party    Submit event:             ./jobscheduler_event.sh –x $?                   Job Scheduler (step 1).
                                         Application                                -e daily_closing
                             any
                                                        - via TCP/IP                -j backup_database                           Sending events can be
                           platform                     - via Shell Script                                                        implemented by use of a
                                                                                  This script would create an event for the
                                                                                  event class „daily_closing“ and would
                                                                                                                                  shell script that hands over
                                                                                  transmit the exit code, job name and            job data and additional
                                                                                  additional payload data to the                  payload data to the
                                                                                  Supervisor instance.                            Supervisor instance.
                                                                                  Should the Supervisor not be accessible        In case of failure to access
                                                       Step 1                     then events are stored locally and are           the Supervisor instance
                                                                                  dequeued later on by a job.                      events are stored locally
                                           Workload    Submit event                                                               and are dequeued by a
                                                                                                                                  job on a regular basis.
                                                                                                                              .
    Start a Shell Script within a job:
    <job title=″backup database″>                                             Supervisor &
      <script language=″shell″><![CDATA[                                     Operations GUI
        ./home/js/create_backups.sh                                                              supported
                                                                                                  platforms
        ./jobscheduler_event.sh –x $?
           -e daily_closing
           -j backup_database
      ]]></script>
    </job>




Software- und Organisations-Service GmbH                                                                                               www.sos-berlin.com
Distributed Processing
Event Processing: Cascading Event Handlers

 Sample stylesheet that checks successfully terminated jobs and
                                                                                                Step 2                       At a Glance:
 starts a job if the respective conditions apply:                                               Cascaded event processing:
                                                                                                - process stylesheets or        Event handlers are used
 <?xml version="1.0" encoding="ISO-8859-1"?>                                                                                     in order to implement indi-
 <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform"                               - process scripts
 xmlns:sos="http://www.sos-berlin.com" version="1.0">                                           - per job, per event class       vidual conditions for job
   <xsl:import href="scheduler_event_functions.xsl.inc"/>                                                                        execution. They are imple-
   <xsl:output indent="yes"/>
                                                                                                                                 mented as XSL stylesheets
   <xsl:template match="events[                                                                                                  or with JavaScript..
     (sos:d('0357export-exinanag') and sos:d('0357export-exinordi')
 and sos:d('0357export-exinrice') and sos:d('0357export-exinveas'))
     or sos:d('0357fgio-EXPORT_DATABASE')
                                                                                                    Stylesheets/                The Supervisor triggers
                                                                                                     Scripting
     ]">                                                                                                                         event handlers according to
     <xsl:call-template name="run_job">                                           Step 2                                         the information given with
       <xsl:with-param name="job">sample_jobs/0357fgio-                                                                          the event. The more specific
 JEODF001</xsl:with-param>                                                                                        Step 3
       <xsl:with-param name="host">localhost</xsl:with-param>
                                                                                 Hand over of                                    event handlers are triggerd
     </xsl:call-template>                                                        an event to                                     first.
                                                                                 to the event
     <remove_event>
       <event event_class="JEODF001"/>
                                                                                 handlers                                        Therefore a sequence
     </remove_event>
   </xsl:template>                                                                                                               of job chain, job, event class
 </xsl:stylesheet>                                                                                                               and finally the default event
                                                                                                                                 handler is triggered
                                                                                                                                 cascadingly.
                                                                                 Supervisor &
 Event handlers are stored on disk and are triggered                            Operations GUI
 according to a naming scheme:                                                                       supported
                                                                                                      platforms
 - process event handler for a given job chain
 - process event handler for a given job
 - process event handler for a given event class                      Event handlers return XML elements for Job
 - process default event handler                                      Scheduler commands that would cause a job
                                                                      chain or a job to start as in:
                                                                      <start_job job=″backup database″/>
                                                                      <add_order job_chain="backup"/>



Software- und Organisations-Service GmbH                                                                                             www.sos-berlin.com
Security
Basic Authentication

                                                                                          At a Glance:
                                                                                             If you want to apply an
                                                                                              individual authentication,
                                                                                              you can choose between
                         PHP                                                                  Basic HTTP authentication
                                                                                              and IP address authentication.
                                                                                             If you use Basic HTTP
                                                                                              authentication the user
                                                                                              specific passwords are
                                  Engine & Operations GUI
                                                            supported
                                                                                              stored MD5 encrypted in the
                                                             platforms                        Job Scheduler configuration.
                                                                                             In case you use IP address
                                                                                              authentication a fixed address
                                                                                              per client or network range is
                                                                                              specified in the configuration.

                                                                                              However, this does not apply
                                                                                              for the use of terminal servers
                                                                                              that assign the same address
            IP address                                                   Basic HTTP
                                                                                              and for use of HTTP proxies.
            authentication                Browser                        authentication
            per client                                                   per client

                                                                                          By the way!
                         any
                       platform
                                                                                             If you have a network with
                                                                                              dynamic IP assignment
                                                                                              and lots of users then these
                                                                                              authentication solutions
                                                                                              would increase the required
                                                                                              configuration efforts.



Software- und Organisations-Service GmbH                                                           www.sos-berlin.com
    Security
    External Authentication

                                                                                                          At a Glance:
                                                                                                             You can choose to use
                                                                                                              a web server as a proxy
                                                                                                              between the clients and
                                       PHP                                                                    the Job Scheduler instances.
                            Engine & Operations GUI                                                          An arbitrary number of Job
                                                                                                              Schedulers is addressed by
                                             supported                                                        one web server.
                                              platforms
                                                                                                             LDAP, PAM and subsequent
                                                                                                              mechanisms supported by
                                                                Engine & Operations GUI                       Apache can be used for
                                                                                                              individual authentication.
           Repo-                                                                  supported
                                                                                   platforms
           sitory
                                                                                                          By the way!
                                                  Forward access to
                                                  the Operations GUI                                         You could authenticate
                                                                                                              users against existing Unix
Access repository                                                                                             accounts using passwd.
for user authentication


                                                      Access Operations GUI
                          Web Server                                               Browser
                                                                                                 any
               any
                                                                                               platform
             platform




    Software- und Organisations-Service GmbH                                                                       www.sos-berlin.com
Failsafe Operation
Automatic Failover from Primary to Backup Job Schedulers

                                                                                                    At a Glance:
                                                                                                       For automatic failover you have
                                                                                                        to set up one or more Backup
                                        Network Storage                                                 Job Scheduler Instances.
                                                                                                       The Backup Instances use
                                                                                                         the same configuration and
                                                                                                        database as the Primary Job
                                                                                                        Scheduler Instance.
                                                                                                       Job configurations are loaded
                              Job Configuration     Job Configuration                                   from a network storage,
                                                                                                        alternatively from a clustered
                                                                                                        database (Managed Jobs).
       Primary Engine                                                          Backup Engine
                                                                                                       The backup Job Schedulers
  supported                                                                            supported
                                                                                                        constantly check if the
   platforms            Send primary heartbeats     Send backup heartbeats              platforms       Primary Job Scheduler is
                              Store Job History     Check primary heartbeats                            up and running and will
                            Store Order History                                                         assume control in case of
                                                                                                        failure of the primary instance.
                                                                                                       The Backup Job Schedulers
                                                                                                        will not execute any jobs,
                                                                                                        unless the heartbeats of the
                                                                                                        Primary Job Scheduler
                                                                                                        instance fail to be detected.
                                         Database
                                          Cluster




Software- und Organisations-Service GmbH                                                                     www.sos-berlin.com
Open Source Job Scheduler




                                           Let the rabbit do the job

                                           http://jobscheduler.sourceforge.net




Software- und Organisations-Service GmbH                                    www.sos-berlin.com

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:11
posted:3/8/2011
language:English
pages:22
Description: Language Service Scheduler Resume document sample