Unlocking the potential of big data in the cloud

Cloud computing and Big Data are the two top innovation hubs in ICT. Together they have the potential to become pivotal enhancers of social transformation and economic development for many years to come.

Two ICT initiatives are filling technology headlines these days, promising to revolutionize computing, business practice, education and most areas of knowledge one can think of. On the one hand, Big Data is an emerging paradigm for large scale distributed data management that aims at being able to process large amounts of data beyond the possibilities of traditional database technologies. On the other hand, is born as a paradigm for distributed computing systems whose goal is to offer software as a service over the Internet. Cloud computing offers an agile delivery model and a highly scalable infrastructure to support the demands for storage and computation of big data technologies. Both technologies are thus converging to offer an immeasurable assortment of information to mine and derive meaningful analytics from, and a growing range of services and resources with applications in any field with a stake in ICT development and innovation.

Both cloud computing and Big Data are quickly maturing and becoming widespread, but a determined effort is needed to create a holistic environment in which both can thrive and develop their full potential. The ambitious scientific goal of the Cloud4BigData project - recently launched by the Madrid-based research institute IMDEA Networks, the Polytechnic University of Madrid and the University Rey Juan Carlos - is to ease the convergence of big data technologies with their underlying cloud infrastructure, attaining high levels of efficiency, flexibility, scalability, high availability, quality of service (QoS), ease of use, security and privacy.

Cloud4BigData will tackle head-on the current drawbacks and shortcomings of and of cloud computing as well as leveraging their strengths. From secure to efficient data processing, the project aims to combine and integrate distinct and specialized technologies in a single unified platform. The project will also demonstrate its competence in emerging application areas with highly demanding requirements requiring cloud and Big Data technologies such as machine-to-machine, Internet of Things and smart*(smart grid, smart cities, smart transport, etc.) and other more traditional areas such as online applications, multimedia applications, or distributed games demanding Big Data support to go beyond their current functionalities.

Cloud4BigData is funded by the Department of Education, Youth and Sports of the Regional Government of Madrid, through the 2013 R&D technology program for research groups, co-financed by Structural Funds of the European Union. It commenced last October 2014 and will conclude in September 2018.

Explore further

Brain inspired data engineering

Provided by IMDEA Networks Institute
Citation: Unlocking the potential of big data in the cloud (2014, December 5) retrieved 23 August 2019 from https://phys.org/news/2014-12-potential-big-cloud.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors

User comments

Dec 08, 2014
Cloud computing is driving a new wave of innovation in the area of big data. The open source solution from HPCC Systems provides a single platform that is easy to install, manage and code. Designed by data scientists, HPCC Systems is a data intensive supercomputer that has evolved for more than a decade, with enterprise customers who need to process large volumes of data in a 24/7 environment. Its Thor Data Refinery Cluster, which is responsible for ingesting vast amounts of data, transforming, linking and indexing that data, and its Roxie Data Delivery Cluster are now offered on the Amazon Web Services (AWS) platform. Taking advantage of HPCC Systems in the cloud provides a powerful combination designed to make Big Data Analytics computing easier for developers and can be launched and configured with the click of a button through their Instant Cloud solution.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more