4 Hegelian Dialec5cs German philosopher Georg Wilhelm Friedrich Hegel explained philosophy of history as a dialec5c between thesis, an5- thesis and resul5ng synthesis. there could emerge a theory first and it could be confronted by an opposing theory. The dialec5c between these opposing theories may find a consensus by assimila5ng the main aspects of both, in the due course of 5me 4

5 History of Compu5ng (According to me!) 5

6 Cloud Compu5ng The most powerful feature of cloud compu5ng is its capacity to transfer compu5ng as a 5 th u5lity a[er water, electricity, gas, and telephony. That was the promise! My Defini5on: Cloud Compu5ng is a form of parallel and distributed system which uses virtualiza5on techniques to orchestrate large storage, memory and network resources of data- centres or similar resources as a unified unit but with apparent elas5c availability on- demand by the customers. It relies on the economy of scale to provide infrastructural and applica5on services without upfront commitment of customers over a network or Internet with minimal management, running and maintenance costs. 6

7 Hype Cycle

8 State of the Cloud

9 Public Cloud Usage

10 Private Cloud Usage 10

11 Private Cloud Usage

12 HPC in Cloud? Gartner CIO survey 2011 predicts that 23% of compu5ng ac5vity would never move to cloud. Some of the High Performance Compu5ng (HPC) applica5ons will be among those 23% that would never move to cloud. Ian Foster noted: The one excep5on that will likely be hard to achieve in cloud compu5ng (but has had much success in Grids) are HPC applica5ons that require fast and low latency network interconnects for efficient scaling to many processors. 12

13 Silver Lining in the Cloud However the future for high performance compu5ng in cloud is not that bleak. It could be possible for specialized clouds and providers with new tools and technology to enable HPC applica5ons on cloud with acceptable level of speed and efficiency. Science Cloud supported by Nimbus project - is an early indica5on of that trend 13

14 Two Ques5ons Whether Cloud could produce HPC like performance? Whether HPC capabili5es of Cloud can be harnessed effec5vely over slow networks like the Internet? 14

15 Whether Cloud could produce HPC like performance? 15

16 Dell Experiment Comparison between a bare metal (BM) installa5on (with RHEL 6.5) and a virtual machine (VM) running on a hypervisor (OpenStack), on a single node (15 Jul 2014). Running NAS Parallel Benchmarks, ANSYS, etc. Applica5ons which are embarrassingly parallel and compute intensive perform 1-2% lower on the VM rela5ve to the BM Applica5ons which have very high memory bandwidth requirements may perform up to 25% lower on the VM rela5ve to the BM. Ref: 16

22 Docker vs VMs VM hypervisors, such as Hyper- V, KVM, and Xen, all are based on emula5ng virtual hardware. That means they re fat in terms of system requirements. Containers use shared opera5ng systems. They are supposed to be much more efficient than hypervisors in system resource terms. Loading 5me and system resources that need to launch those applica5ons could be lower That s theory, what s prac5cal? 22

23 IBM Experiment Passive Benchmarking with docker LXC, KVM & OpenStack on IBM So[Layer By Boden Russell Disclaimer: The tests herein are passive no in depth tuning, analysis, etc. More ac5ve tes5ng is warranted. These results do not necessary reflect your workload or exact performance nor are they guaranteed to be sta5s5cally sound. Ref: 23

24 What Openstack IS A group of 7+ core open source projects aimed at providing comprehensive cloud services. It is more than a hypervisor manager. It sits above the pool of virtualized resource as a master control plane. It provides users with a single point of control and orchestra5on.

32 Whether HPC capabili5es of Cloud can be harnessed effec5vely over slow networks like the Internet? 32

33 A Surprise By- product of my PhD My PhD research at ANU has produced a SOA middleware that is intended to produce high performance outcomes for not so embarrassingly parallel scien5fic applica5ons. ANU- SOAM was moulded by adop5ng the architecture of IBM- Pla5orm Symphony Enterprise SOA middleware. The programming model supported ANU- SOAM with its Data Service extension is found to effec5vely harness cloud compu5ng resources over Internet to produce HPC results. 33

34 Service Oriented Architecture SOA is a compu5ng paradigm that considers services as building blocks for applica5ons. In SOA, atomic units of computa5on(s) are considered as a Service, which are at the disposal of Clients. A Resource Manager nego5ates the availability/ scheduling of services to clients. 34

35 SOA Tradi5onal Architecture 35

36 High Performance Scien5fic Compu5ng - Main Challenge Inter- dependency of underlying computa5onal tasks in many scien5fic applica5ons. Eg: N Body problem. When these applica5ons are parallelized, the inter- dependency shall compel atomic units of work - tasks - to progress in phases (we call it as genera8ons). This increases task granularity which result in increased communica5on and communica5on costs (Overheads) that slows down the applica5on. They are not embarrassingly parallel! 36

37 N Body Problem 37

38 N Body Problem Conven5onal Approach The naïve NBS algorithm starts with a known set of values for the mass, velocity and posi5on of bodies involved. The future posi5ons and veloci5es of bodies can be predicted by itera5vely moving forward in small 5me increments. This linear algorithm is split into client and service processes and the algorithm is parallelized by sending subset(s) of the N bodies to each SI. The SIs process these subsets and the par5al results are communicated back to the client to synchronize all updates from all SIs. 38

40 Data Service Extension Introduced to deal with interdependency of tasks in scien5fic apps (as explained in the example of NBS). The Data Service allows SIs to communicate each other without 5ght coupling so that many decisions can be taken among SIs, rather than going back to client all the 5me. This will reduce communica5ons between client and SIs in many applica5ons. allow applica5on programmers to move cri5cal applica5on logic from client side to service side. 40

42 Data Service Func5ons Data common to all SIs can be set (add) using this service. The common data is replicated among all SIs and client process. This common data can be accessed (get) either by client or SIs. Updates to this common data (put) can also be made by individual SIs or client processes, without changing common data for a for a par5cular genera5on of tasks). put is a deferred opera5on in CDS. These updates (put) can be synchronized between SIs and the client process using sync. isync applies sync only to service instances. The common data will be synchronized among SIs but won t be updated back to the client side. 42

45 Experimental Setups - within Cloud Two types of cloud experimental scenarios 1) ANU-SOAM deployed within cloud: both the client and SIs to run within a public cloud IaaS. 2) ANU-SOAM deployed over the Internet: access a public cloud IaaS across Internet, from home PC. Selec5on of a right cloud provider turned out to be cri5cal. Because, ANU- SOAM uses OpenMPI as its communica5on backbone, which does not support Network Address Transla5on (NAT). Since the Amazon cloud uses NAT to translate the public IP addresses of its compute nodes, Rackspace (which doesn't use NAT technology) was chosen, especially to enable the second set of experiments. 45

46 NBS All within Cloud 20 NBS-SOAM within cloud - Loading time NBS-SOAM within cloud - Compute time NBS-SYMPHONY within cloud - Total time 15 Time (Sec) Service Instances 46

47 Cloud over Internet 47

48 NBS - Cloud over Internet Conven5onal SOA Approach 400 NBS-SYMPHONY within cloud - Total time NBS-SYMPHONY over the Internet- Total time Time (Sec) Service Instances 48

49 NBS - Cloud over Internet ANU SOAM Approach NBS-SOAM within cloud - Loading time NBS-SOAM within cloud - Compute time NBS-SOAM over the Internet - Loading time NBS-SOAM over the Internet - Compute time Time (Sec) Service Instances 49

50 Comparison NBS-SOAM over the Internet - Total time NBS-SYMPHONY over the Internet- Total time 400 Time (Sec) Service Instances 50

Cloud Compu)ng in Educa)on and Research Dr. Wajdi Loua) Sfax University, Tunisia ESPRIT - December 2014 04/12/14 1 Outline Challenges in Educa)on and Research SaaS, PaaS and IaaS for Educa)on and Research

AMD SEAMICRO OPENSTACK BLUEPRINTS CLOUD- IN- A- BOX OCTOBER 2013 OpenStack What is OpenStack? OpenStack is a cloud operaeng system that controls large pools of compute, storage, and networking resources

How the ersa Problem became the ersa Solu3on. Why a network and network security is impera3ve for ersa s NeCTAR cloud. Paul Bartczak Infrastructure Manager About ersa eresearch SA is a collabora3ve joint

OpenStack IaaS 1 Rhys Oxenham OSEC.pl BarCamp, Warsaw, Poland November 2013 Disclaimer The information provided within this presentation is for educational purposes only and was prepared for a community

White Paper Cisco Application-Centric Infrastructure (ACI) and Linux Containers What You Will Learn Linux containers are quickly gaining traction as a new way of building, deploying, and managing applications

STRATEGIC WHITE PAPER The next step in server virtualization: How containers are changing the cloud and application landscape Abstract Container-based server virtualization is gaining in popularity, due

5. Implementation Implementation of the trust model requires first preparing a test bed. It is a cloud computing environment that is required as the first step towards the implementation. Various tools

Open System Laboratory of University of Illinois at Urbana Champaign presents: Outline: IMCM: A Flexible Fine-Grained Adaptive Framework for Parallel Mobile Hybrid Cloud Applications A Fine-Grained Adaptive

Is OpenStack the best path forward towards successful Clouds? Cor van der Struijf Senior Cloud Advisor corvds@nl.ibm.com What is the best path forward? I was just wondering if you could help me find my

Intel Service Assurance Administrator Product Overview Running Enterprise Workloads in the Cloud Enterprise IT wants to Start a private cloud initiative to service internal enterprise customers Find an

CLOUD COMPUTING When It's smarter to rent than to buy Is it new concept? Nothing new In 1990 s, WWW itself Grid Technologies- Scientific applications Online banking websites More convenience Not to visit

Module 1 Overview of cloud computing and the Nectar services Introduction This documentation provides a general introduction to cloud computing and an overview of the NeCTAR Research Cloud, Virtual Laboratories

Déployer son propre cloud avec OpenStack GULL francois.deppierraz@nimag.net Who Am I? System and Network Engineer Stuck in the Linux world for almost 2 decades Sysadmin who doesn't like to type the same