Notes for BSc CSIT

 Applications of Cloud Computing 1) Scientific Applications Scientific applications have been run on both traditional high-performance computing (HPC) systems such as supercomputers and clusters, as well as high throughput computing (HTC) platforms such as Grids, for many years. Many businesses have employed classical HPC to assist tackle a range of problems since they have access to enormous quantities of computer power. Although these systems were often built to solve a specific problem, a growing number of SMEs and even university departments began to use general-purpose HPC systems. Scientists, engineers, system administrators, and developers have been investigating HPC Cloud environments to take advantage of what Cloud Computing has to offer them as new growing technology. Running complex scientific applications has become more accessible to the research community thanks to the popularity of Cloud Computing, which allows researchers to access on-demand compute resources in minutes

  Aneka Manjrasoft is dedicated to developing revolutionary software solutions that facilitate the development and deployment of applications on private or public Clouds. Their product, Aneka, serves as an Application Platform as a Service for Cloud Computing. Aneka provides a variety of programming paradigms such as Task Programming, Thread Programming, and MapReduce Programming, as well as tools for quick application development and smooth deployment on private or public Clouds to distribute applications. Aneka is a cloud-based platform and framework for constructing distributed applications. It makes use of the idle CPU cycles of a heterogeneous network of desktop PCs, servers, and data centers. Aneka provides a comprehensive set of APIs for developers to transparently use such resources and express the business logic of apps using the chosen programming abstractions. To monitor and govern the deployed infrastructure, system administrators might use a set of tools. This can be a pub

 The core modules of Hadoop include: Hadoop Common: The common utilities that support the other Hadoop modules. Hadoop Distributed File System (HDFS): A distributed file system that provides high-throughput access to application data. Hadoop Yet Another Resource Negotiator (YARN): A framework for job scheduling and cluster resource management. Hadoop MapReduce: A YARN-based system for parallel processing of large data sets. Hadoop Ozone: An object store for Hadoop Examples of Popular Hadoop-related Software Popular Hadoop packages that are not strictly a part of the core Hadoop modules, but that is frequently used in conjunction with them, include: Apache Hive is data warehouse software that runs on Hadoop and enables users to work with data in HDFS using a SQL-like query language called HiveQL. Examples of Popular Hadoop-related Software  Popular Hadoop packages that are not strictly a part of the core Hadoop modules, but that are frequently used in conjunction with them, include: 

Uses of Microsoft Azure Microsoft Azure's use cases are quite diversified because it comprises multiple service offerings. Running virtual machines or containers in the cloud is one of Microsoft Azure's most common uses. These computational resources can run infrastructure components including domain name system (DNS), Windows Server services like Internet Information Services (IIS), or third-party apps. Third-party operating systems, such as Linux, are also supported by Microsoft. Azure is also extensively utilized as a platform for cloud-based database hosting. Microsoft provides serverless relational databases like Azure SQL as well as non-relational databases like NoSQL.  Furthermore, the platform is commonly used for disaster recovery and backup. Many businesses utilize Azure storage as an archive to satisfy their long-term data preservation obligations.

 Google Cloud Platform (GCP) Google Cloud Platform (GCP) is a set of cloud computing services supplied by Google that operates on the same infrastructure that Google uses internally for its end-user products such as Google Search, Gmail, file storage, and YouTube. Google's cloud platform offers its consumers dependable and highly scalable cloud computing services. These services assist customers in computing and storing data, as well as developers in developing, testing, and deploying applications. The Google cloud platform includes application storage, and cloud computing capabilities for backend, mobile, and online applications that use the internet. Over four million apps rely on and use the platform. Google makes effort to keep the backend as basic as possible, employing a minimal file system. The Google cloud platform is built on this architecture. It responds to information requests using simple commands such as write, read, and open. It is a computing system that is distribu

The differences between SOAP and REST are:-  RESTful web services and SOAP both have their own set of advantages and disadvantages. A REST web service, for example, is often a superior choice when time is of the essence, while SOAP triumphs in designing the services with various,non-CRUD methods. Unless otherwise specified by the Web Services provider, the type of web service implemented by a partner is determined by the company's requirements. Amazon and eBay both employ web services for REST and SOAP. And, as more firms become service focused and experiment with new features, they will be forced to accommodate both types. SOAP It stands for Simple Object Access Protocol. It is an XML-based messaging protocol. It needs more bandwidth and resources for better web performance. SOAP enforces XML as a message format. It has not great performance as compared to REST. SOAP defines its security. It does not support error handling.  SOAP is a heavyweight XML protocol that requires more co

Different types of Web Services are:-  1. XML-RPC (Remote Procedure Call)  2. UDDI 3. SOAP 4. WSDL 5. REST  1. XML-RPC (Remote Procedure Call)  XML-RPC (Remote Procedure Call) is the most fundamental XML protocol for exchanging data across a wide range of network devices, which allows applications to invoke functions or procedures across a network. XML-RPC performs RPCs using XML messages. In the XML request, the XML-RPC client gives a Procedure name and arguments, and the server delivers either a fault or a response in the XML response. The body of the HTTP response contains the network. This platform-independent web service uses HTTP to transmit data and communicate other information from the client to the server in a timely and efficient manner. The body of the HTTP response contains XML replies. XML-RPC enables the communication between many programs so that a Java client application can communicate with a Perl server application. 2. UDDI UDDI (Universal Description, Discovery, and

 Benefits of Web Service By reducing development time, the technology assists IT professionals and web architects in streamlining connections. With this simpler infrastructure, corporate leaders are beginning to realize greater  Web services provide Interoperability - applications developed in one programming language can communicate with the application developed in other programming languages.  Web services allow effective technology distribution over a complete network in a B2B business where both parties understand how the process works. Web Services interact via regular Internet technology.  XML is used in the data representation and data transportation levels of Web Services. So it provides minimal effort communication.

 Web Services Web service refers to the software system designed to support interoperable machine-to-machine or web interaction over the computer network and World Wide Web. A server running on the network listens for requests at a certain port and serves web content such as HTML, JSON, XML, etc. Web services are self-contained, modular, distributed, dynamic programs that may be specified, published, located, or invoked through a network to produce products and services. These apps might be local, distributed, or based. Web services are client and server applications that interact using the HyperText Transfer Protocol (HTTP) over the World Wide Web (WWW). Web Service is "a software system designed to support interoperable machine-to-machine interaction over a network". Web services, as defined by the World Wide Web Consortium (W3C), provide a common mechanism for interoperating across software applications running on various platforms and frameworks. Web services are distingu

PARALLEL COMPUTING Parallel computing is a sort of computer architecture in which many processors simultaneously execute or process an application or calculation. Parallel computing aids in the performance of big calculations by splitting the workload across several processors, all of which work on the computation at the same time. The majority of supercomputers run using parallel computing methods. Parallel processing is another name for parallel computing. Parallel processing is typically used in operating environments/scenarios that need large computing or processing capability. Parallel computing's primary goal is to enhance available computing power for quicker application processing or job resolution. Parallel computing infrastructure is often hosted in a single facility where multiple processors are deployed in a server rack or independent servers are linked together. The application server provides a calculation or processing request that is broken down into little pieces o

RELATIONAL DATABASES A relational database is a form of database that stores and allows access to data elements that are connected. Relational databases are based on the relational model, which is an easy-to-understand method of expressing data in tables. In a relational database, each row in the table is a record with a unique ID called the key. The columns of the table carry data attributes, and each record generally includes a value for each attribute, making it simple to construct links between data points. In a relational database, each table, also known as a relation, includes one or more data categories in columns, also known as attributes. Each row, also known as a record or tuple, includes a unique instance of data, or key, for the columns' stated categories. Each table has a unique primary key that identifies the data in the table. The relationship between tables may then be defined using foreign keys, which are fields in one table that are linked to the primary key of

 Serial Computing Traditionally, the software has been written for serial computation:  A problem is broken into a discrete series of instructions Instructions are executed sequentially one after another  Executed on a single processor  Only one instruction may execute at any moment in time

 GOOGLE CLOUD DATASTORE Google Cloud Datastore is a Google Cloud Platform service that provides a highly scalable, fully managed NoSQL database. Cloud Datastore is based on Bigtable and Megastore technologies from Google. Cloud Datastore is a NoSQL document database designed for online and mobile applications that require automated scalability, excellent performance, and simplicity of development. Features of Google Cloud Datastore include: Atomic transactions.  Cloud Datastore can perform a series of operations in which they succeed. High availability of reads and writes.  Cloud Datastore is hosted in Google data centers, which employ redundancy to reduce the effects of single points of failure. Massive scalability with high performance.  To manage scalability automatically, Cloud Datastore has a distributed design. Cloud Datastore employs a combination of indexes and query limitations to ensure that your queries grow with the size of your result set rather than the size of your data

 AMAZON DYNAMO Amazon offers DynamoDB, a fully managed proprietary NoSQL database service that supports key-value and document data formats, as part of the Amazon Web Services portfolio. DynamoDB provides a comparable data architecture to Dynamo and gets its name from it, but it has a distinct underlying implementation. DynamoDB employs synchronous replication over many data centers for high durability and availability, and it has a multi-master design that requires the client to resolve version conflicts. Amazon DynamoDB is a key-value and document database that promises performance in single-digit milliseconds at any size. It is a fully managed, multiregional, multi-master database for internet-scale applications that has built-in security, backup and restore, and in-memory caching. DynamoDB can handle more than 10 trillion requests per day, with peaks of more than 20 million requests per second. Many of the world's fastest-growing companies, like Lyft, Airbnb, and Redfin, as wel

 STORAGE MECHANISM IN HBASE HBase is a column-oriented database, with tables ordered by row. Only column families, which are key-value pairs, are defined in the table structure. A table contains many columns families, each of which can include any number of columns. Subsequent column values are saved on the disk in a logical order. A timestamp is associated with each cell value in the table. In a nutshell, in an HBase: The table is a collection of rows. The row is a collection of column families. A Column family is a collection of columns.  The column is a collection of key-value pairs. An example schema of a table in HBase is provided below. COLUMN-ORIENTED AND ROW-ORIENTED DATABASE Column-oriented databases, as opposed to row-oriented databases, store data tables as portions of columns of data. They will have column families. Row-Oriented Database It is suitable for the Online Transaction Process(OLTP). Such databases are designed for a small number of rows and columns. Column-Orient

 HDFS Architecture The architecture of a Hadoop File System is shown in figure 7.2. Those components of the architecture are described as below: Namenode The namenode is the commodity hardware that contains the GNU/Linux operating system and the namenode software. It is software that can be run on commodity hardware. The system having the namenode acts as the master server and it does the following tasks: •Manages the file system namespace.  •Regulates client's access to files. •It also executes file system operations such as renaming, closing, and opening files and directories. Datanode The datanode is a piece of commodity hardware that runs the GNU/Linux operating system as well as the datanode software. A datanode will exist for each node (Commodity hardware/System) in a cluster. These nodes are in charge of their system's data storage. Datanodes perform read-write operations on the file systems, as per the client's request.  They also perform operations such as block cr

 WIDELY SEEN SECURITY ISSUES 1. Data breaches:  A data breach might be the primary goal of a targeted attack, or it might be the consequence of a human mistake, application flaws, or inadequate security policies. It might include any material that was not meant for public distribution, such as personal health information, financial information, personally-identifying information, trade secrets, and intellectual property. The cloud-based data of a business may be valuable to many parties for a variety of reasons. The danger of data breaches is not unique to cloud computing, but it remains a top issue for cloud consumers. 2. Insufficient identity, credential, and access management:  Bad actors impersonating genuine users, operators, or developers can access, edit, and delete data; issue control plane and management functions; eavesdrop on data in transit, or distribute harmful software that looks to come from a genuine source. As a result, inadequate identity, credentials, or key managem