Recent Efforts on the Asia-Pacific Grid (ApGrid) SEKIGUCHI, Satoshi Electrotechnical Laboratory (ETL), AIST(TACC), MITI Sekiguchi@etl.go.jp Satoshi Matsuoka Tokyo Inst. Technology/JST Matsu@is.titech.ac.jp Several slides are courtesy of Grid people What is ApGrid? A meeting point for all Asia-Pacific HPCN researchers ..doing grid-related work Communication channel to the Global Grid Forum, and other grid communities Pool for finding international project partners Not a single source funded “project”! Unlike EuroGrid, eGrid, IPG, etc. ACSys APAN: http://apan.net Japan North America Europe (STARTAP) South Korea TransPAC (100 Mbps) Europe China Hong Kong Latin America Thailand Philippines Malaysia Singapore Australia-Japan Link Indonesia (1.5Mbps Frame Relay) Exchange Point Australia Access Point Current Status Planned ACSys APAN Projects Distributed computing ACSys, ANU, CSIRO, Osaka U, NUS, ISI, Argonne Lab, Indiana U,... Digital libraries GEMINI project: ACSys, SingaREN, I2-DSI, KAIST, MAFFRC Earth Observation: CSIRO, Agencies (NASDA, ESA, NASA….) Data mining ACSys; Illinois University (Terabyte challenge) Virtual environments / Telerobotics ACSys, ETL/RWCP, U Chicago, Indiana Distance education Association of Pacific-Rim Research Universities (APRU) Internet technologies testbeds for MBONE, IPv6, Cache, RSVP/DS/QoS National Backbones for Japaese Academia TACC RWCP 135Mbps nGrid/eGrid 1.5Mbps Partners 135Mbps APAN STAR TAP Chicago 100Mbps IMnet Tokyo TransPAC vBNS Waseda 155Mbps 384Kbps 10Mbps WIDE 1.5Mbps Frame Relay TIT Australia 10Mbps SINET TACC: Tsukuba Advanced Computing Center Osaka: Osaka University 155Mbps RWCP: Real World Computing Partnership Osaka 100Mbps TIT: Tokyo Institute of Technology Waseda: Waseda University KEK-ETL collaboration StarTAP (100Mbps) （ループ長 約２７㎞） KEK CERN (dedicated 2Mbps?) Tsukuba U Today 135Mbps Planned 2.4Gbps Tokyo 5km AIST/ETL 1000km ApGRID: motivations (1) Establish a regional wide testbed for global computing (Grid and/or Meta) Disseminating research activities Providing an easy-access environment for researchers, students, vendors, etc. Improving interoperability of existing tools Testbed for software development and trial to have evaluation of usability and to archive performance numbers Finding demonstrative applications ApGRID: motivations (2) Create a competitive/collaborative community to the iGRID and the eGRID for: Making international collaborations Supporting and collaborating with network people, ex. APAN, IM-net, etc. Attempt to negotiate for standardization with real experience (in Global Gridforum.) Also, domestic (intra-country) service Nation-wide Several “non-cooperative” network communities Seeking governmental and/or industrial funding Campus-wide Find Volunteers within our friends APGrid Locations/Potential Partners Japan Korea (KORDIC, ) AIST/TACC/ETL Singapore (NUS) National Institute of Advanced Industrial Science and Technology Malaysia Tokyo Institute of Technology Thailand Waseda U, ROC, Osaka-u, Hong Kong, Nara Advanced Institute of S & T Taiwan KEK (DataGrid) Other APAN members Australia ANU, Monash U United States PNNL, SDSC ApGrid: Services (1) Grid computing service Deploy major grid software packages ready to use Ninf v.2.0 Globus, Netsolve, NWS, Nimrod, Condor Legion,etc. MPICH/G(2), PACX-MPI, Harness, etc System resources US220R x 2CPU x 4 from ETL ORIGIN 2000/16CPU, J90/16CPU, CS6400/64 SR8000/8node, WH-II 8node Clusters (Pentium, Alpha), etc in many places Ninf Overview Other Global Computing Systems, Ninf DB e.g., NetSolve via Adapters Server Meta data Server Ninf Internet Computational Meta Meta Server Ninf Library results Ninf Library (Ninf Executable) Ninf Library Server Server (Ninf Executable) (Ninf Executable) Ninf Client Ninf query Library Client request : Ninf_call(“linpack”, ..); : Ninf RPC protocol Program Ninf Overview (cont’d.) Ninf server + Ninf RPC protocol transparent execution of Ninf library program on computational server Ninf database server direct query on accurate constant database Ninf Client Interface easy-to-use programming interface Ninf Metaserver scheduling of computation, asynchronous and automatic parallel computation, Ninf RPC Protocol Exchange interface information at run-time No need to generate client stub routines (cf. SunRPC) No need to modify a client program when server’s libraries are updated. Client Program Ninf library program Client Library Interface Info Stub Program Interface Info Interface Info Ninf Server Interface Request Interface Info. Argument Result ASP-Like ApGrid Ninf Service Simplified Resource access and architecture than Load balancing w/VIP the Ninf Metaserver Different VIP per package Limit the # of known e.g. linpack.apgrid.org Servers Grouping of libraries Load balancing with via VIP L4 switch technology VIP expands the URL Central to address of administration of appropriate server servers and DB Ninf 2.0/Netsolve Transaction support etc lapack.ApGrid.org Simplified architecture than the Metaserver ・Limit the # of Servers murata.ApGrid.org ・Load balancing with L4 switch technology lapack.eGrid.org 3-DNS ・Central administration of servers and DB ・Transactions Res DB (“lapack”,”dgesv”, .., ..) 22.214.171.124(VIP) BIG/IP package routine Selector/scheduler BIG/IP Selector/scheduler hpcc.gr.jp 126.96.36.199/24 Different VIP per package e.g. linpack.apgrid.org Grouping of libraries via VIP ninf.org 188.8.131.52/23 VIP expands the URL to address of appropriate server Ninf 2.0/netsolve etc ApGrid: Services (2) Grid information service Maintain name servers and databases ASP-like portal service Handling users, micro economics Grid security support service (Plan) PKI: Public Key Infrastructure Certificate Authority ApGrid Application examples Remote/Tele-operation Lifescience/Bioinformatics High Energy Physics domain (data grid) SDP Climate and environmental studies Fundamental material characteristics Remote collaboration etc ApGrid: Current Status Just kicked off, and some of the resources are ready, but still we need: Hiring people to maintain and to install the regular services initially Considering to have meeting in mid. March, 2001 Contributing to the GGF Enrolling more partners Reserved: apgrid.org, Web site will be open shortly Find international partners Creating much stronger relation with APAN activities Summary Some success stories Collaboration with Application Scientists International Collaborations Osaka-U/UCSD (Globus) NetSolve/Ninf Collaboration WGCC2000, Grid Forum, metacomputing WS Government funded several projects the Asia-Pacific Grid (ApGrid) TACC is ready for providing computing resources National, Regional testbed International Collaborations Efforts a MUST!