ENGINEERING RESEARCH PAPERS

big data research papers 2013-2014




Big-Data Management Use-Case: A Cloud Service for Creating and Analyzing Galactic Merger Trees
free download

ABSTRACT We present the motivation, design, implementation, and preliminary evaluation for a service that enables astronomers to study the growth history of galaxies by following their 'merger trees' in large-scale astrophysical simulations. The service uses the Myria

Changing Engines in Midstream: A Java Stream Computational Model for Big Data Processing
free download

ABSTRACT With the addition of lambda expressions and the Stream API in Java 8, Java has gained a powerful and expressive query language that operates over in-memory collections of Java objects, making the transformation and analysis of data more convenient, scalable

The Uses of Big Data in Cities
free download

ABSTRACT There is much enthusiasm currently about the possibilities created by new and more extensive sources of data to better understand and manage cities. Here, I explore how big data can be useful in urban planning by formalizing the planning process as a general

PigSPARQL: A SPARQL Query Processing Baseline for Big Data.
free download

ABSTRACT In this paper we discuss PigSPARQL, a competitive yet easy to use SPARQL query processing system on MapReduce that allows adhoc SPARQL query processing on large RDF graphs out of the box. Instead of a direct mapping, PigSPARQL uses the query

CS principles goes to middle school: learning how to teach" Big Data" .
free download

ABSTRACT Spurred by evidence that students' future studies are highly influenced during middle school, recent efforts have seen a growing emphasis on introducing computer science to middle school learners. This paper reports on the in-progress development of a

Big Data for Big Business? A Taxonomy of Data-Driven Business Models Used by Start-Up Firms
free download

The purpose of this paper is to propose a taxonomy of business models used by start-up firms that rely on data as a resource of major importance for their business datadriven business models (DDBMs). Furthermore, it proposes a DDBM framework to systematically

Knowledge Bases in the Age of Big Data Analytics
free download

ABSTRACT This tutorial gives an overview on state-of-the-art methods for the automatic construction of large knowledge bases and harnessing them for data and text analytics. It covers both big-data methods for building knowledge bases and knowledge bases being

Big Data and New Product Innovation
free download

ABSTRACT Innovation and new product development is a risky and tough business as most of the new products fail. There are many reasons for that. To name a fewundercapitalization, poor market research, not getting customers involved at the right time and not reaching the

Big Data and Distributed Data Mining: An Example of Future Networks
free download

ABSTRACT This paper describes the perspective on the analytics of big data generated by sensors and devices on the edge of networks. The paper includes a discussion of the importance of data at the edge of networks where some of biggest big data is generated.

Exploring Big Data using Visual Analytics.
free download

Data is complete, correct, and not changing over time Network Security Data: IP Flows Task: Detection of Novel Viruses Fraud Detection Data: Credit Card (or Phone Call) Data Task: Detection of Fraud Business Analytics Data: Customer Records Task:

DOES BIG DATA PROVIDE BIG OPPORTUNITIES FOR SERVICE RESEARCH?
free download

ABSTRACT Big data analytics is an emerging field with great potential for crossfertilization between information systems and service research. However, there is little rigorous inquiry into big data from a service science or management perspective. In this conceptual work,

Big Data: Uses and Limitations
free download

For years, statisticians have been working with large volumes of data in fields as diverse as astronomy, bioinformatics, and data mining. Big Data is different because it is generated on a massive scale by countless online interactions among

Database research challenges and opportunities of big graph data
free download

ABSTRACT Large volumes of graph-structured data are becoming increasingly prevalent in areas such as social and professional network analysis recommendation services, such as product advertisement, news and media alerts, learning resource recommendation,

Next-generation plant science: putting big data to work
free download

The introduction of next-generation sequencing has benefitted plant science due to a rapidly expanding num- ber of fully sequenced and annotated plant genomes. The availability of genomic data has enabled researchers to go a step further and integrate big data from different

Toward Progress Indicators on Steroids for Big Data Systems.
free download

Recently we have witnessed an explosive growth in the complexity, diversity, number of deployments, and capabilities of big data processing systems (see Figure 11). This growth shows no sign of slowing; if anything, it is accelerating, as more users bring more diverse

FROM THE EDITORS BIG DATA AND MANAGEMENT
free download

This editorial launches a series written by editors and co-authored with a senior executive, thought leader, or scholar from a different field to explore new content areas and grand challenges with the goal of expanding the scope, interestingness, and

Comparative Analysis of Transfer Protocols For Big Data
free download

ABSTRACT Scientists working in various fields such as astronomy and biology require access to vast volumes of data (also referred to as big data) for their research. This data may need to transferred over long distances to enable collaboration among scientists

A Paradigm for Learning Queries on Big Data
free download

ABSTRACT Specifying a database query using a formal query language is typically a challenging task for non-expert users. In the context of big data, this problem becomes even harder as it requires the users to deal with database instances of big sizes and hence

COMMUNITY SOCIOECONOMIC DEPRIVATION AND OBESITY TRAJECTORIES IN CHILDREN USINGBIG DATA.
free download

Little is known about how community-level socioeconomic conditions alter trajectories of body weight gain in children. Using data from a large electronic health record, we investigate whether residence in communities with higher socioeconomic deprivation is

Big Data Meets Big Models: Solution of Large-Scale Bayesian Inverse Problems
free download

USArray network of 400 broadband seismic stations with~ 70 km spacing over 1000 km aperture. Past/present stations in green, future stations in blue. Right. Shear waves from deep South American earthquake plotted on top of map of arrival time. Early arrivals

The 'big data'revolution in healthcare
free download

An era of open information in healthcare is now under way. We have already experienced a decade of progress in digitizing medical records, as pharmaceutical companies and other organizations aggregate years of research and development data in electronic databases.

Bootstrapping Privacy Compliance in Big Data Systems
free download

ABSTRACT With the rapid increase in cloud services collecting and using user data to offer personalized experiences, ensuring that these services comply with their privacy policies has become a business imperative for building user trust. However, most compliance

Meet Charles, big data query advisor.
free download

ABSTRACT In scientific data management and business analytics, the most informative queries are a holy grail. Data collection becomes increasingly simpler, yet data exploration gets significantly harder. Exploratory querying is likely to return an empty or an

epiC: an Extensible and Scalable System for Processing Big Data
free download

ABSTRACT The Big Data problem is characterized by the so called 3V features: Volume-a huge amount of data, Velocity-a high data ingestion rate, and Variety-a mix of structured data, semi-structured data, and unstructured data. The state-of-the-art solutions to the Big

A Review on Cloud to Handle and Process Big Data
free download

ABSTRACT Cloud computing provides services to internet by utilizing resources of the computing infrastructure to provide different services of the internet. It allows consumers and businesses to use applications without installation and access their personal files at any

How Far Can Big Data Take Us Towards Understanding Cities
free download



XORing Elephants: Novel Erasure Codes for Big Data
free download

ABSTRACT Distributed storage systems for large clusters typically use replication to provide reliability. Recently, erasure codes have been used to reduce the large storage overhead of threereplicated systems. Reed-Solomon codes are the standard design choice and their

Linked data, big data, and the 4th paradigm
free download

Around 2006, the inception of Linked Data has led to a realignment of the Semantic Web vision and the realization that data is not merely a way to evaluate our theoretical considerations, but a key research enabler in its own right that inspires novel theoretical

ASSESSING WHETHER BIG DATA SOLUTIONS PROVIDE VALUE FOR DIAGNOSTICS MANUFACTURERS
free download

OBJECTIVES: Patients, physicians, and other decision-makers make implicit tradeoffs among benefits and risks of different treatments. Many methods have been proposed to conduct quantitative benefit-risk analysis (BRA). We propose a framework for classifying

Numbersense: How to Use Big Data to Your Advantage
free download

Numbersense: How to Use Big Data to Your Advantage Author: Kaiser Fung ISBN-13: 9780071799669 Numbersense describes how to solve the labyrinth of big data by walking the reader through real- life examples from sports, education, marketing, health, and economics.

Big Data for Population-Based Cancer Research
free download

266 plan preserves the confidentiality, integrity, and availability of personally identifiable information and protected health information, including limited data sets. This security plan ensures regulatory compliance with the Health Insurance Portability and Accountability

Big Data in Big Companies
free download

Big data burst upon the scene in the first decade of the 21st century, and the first organizations to embrace it were online and startup firms. Arguably, firms like Google, eBay, LinkedIn, and Facebook were built around big data from the beginning. They didn't have

The Promise Of Big Data: New Methods For Sociological Analysis
free download

This is not to suggest that big data is somehow 'pure' or 'free' of social norms and constraints simply that these data are produced beyond rather than through sociological research methods. Figure 1: Number of #nov9 Tweets, Retweets and Mentions 30th October

Storage Challenge: Where Will All That Big Data Go?
free download

Market research firm Aberdeen Group found that data growth has averaged about 35 percent annually in recent years, as Figure 1 shows. According to Aberdeen senior research analyst Dick Csaplar, this means the amount of storage necessary to hold all this

Big Data in Higher Education the University of Otago Experience
free download

ABSTRACT Big Data-a collection of large and complex data sets, often challenging to process using traditional database management tools, brings new opportunities for institutions of higher education, as institutions continue to face unprecedented challenges in their

Interactive Outlier Exploration in Big Data Streams
free download

ABSTRACT We demonstrate our VSOutlier system for supporting interactive exploration of outliers in big data streams. VSOutlier not only supports a rich variety of outlier types supported by innovative and efficient outlier detection strategies, but also provides a rich

Extracting Dimensions of Consumer Satisfaction with Quality from Online Chatter: Strategic Brand Analysis of Big Data Using Latent Dirichlet Allocation
free download

ABSTRACT Online chatter or User-Generated Content (UGC) constitutes an excellent emerging source for identifying dimensions of quality at a very high temporal frequency. This study proposes a unified framework for extracting the latent dimensions of consumer satisfaction

Big data are shaping the future of materials science
free download

Big data mean different things to different people. In commerce, retailers extract trends from millions of consumer purchases to target advertising and increase profits. In health, Google and the US Centers for Disease Control and Prevention analyze vast amounts of search

Securing the Data in Big Data Security Analytics.
free download

ABSTRACT Big data security analytics is an emerging approach to intrusion detection at the scale of a large organization. It involves a combination of automated and manual analysis of security logs and alerts from a wide and varying array of sources, often aggregated into a

BIG DATA: A Review
free download

ABSTRACT Big data is pool of large and complex data sets so it becomes difficult to process data using database management tools. With the fast evolution of data, data storage and networking collection capacity, Big Data are rapidly growing in all science and

A Review on the Role of Big Data in Business
free download

ABSTRACT Big data is a game changing thing. Successful organizations are achieving business advantages by analyzing big data. It has received significant attention in recent years but some challenges are one of the major causes in diminishing the growth of

On Rewriting, Answering Queries in OBDA Systems for Big Data (Short Paper).
free download

ABSTRACT The project Optiqueaims at providing an end-to-end solution for scalable access to Big Data integration, were end users will formulate queries based on a familiar conceptualization of the underlying domain. From the users queries the Optique platform

Bayes and big data: the consensus Monte Carlo algorithm
free download

ABSTRACT A useful definition of big data is data that is too big to comfortably process on a single machine, either because of processor, memory, or disk bottlenecks. Graphics processing units can alleviate the processor bottleneck, but memory or disk bottlenecks

Astrogenomics: big data, old problems, old solutions?
free download

BioMed Central Ltd contributing groups, observatories and space missions (the people best qualified to curate the data), the VO framework assures their interoperability through a set of common standards, formats and protocols, enabled by associated

A web service for scholarly big data information extraction
free download

ABSTRACT The automatic extraction of metadata and other information from scholarly documents is a common task in academic digital libraries, search engines, and document management systems to allow for the management and categorization of documents and

Unleashing the Potential of Big Data
free download

While knowledge is the engine of the economy, Big Data is its fuel. This characterization of Big Data was made by Ms. Neelie Kroes, European Commission Vice President in charge of the digital agenda for Europe. Kroes calls Big Data the new oil. For traditional industries

Policy-Making 2.0: Unleashing the Power of Big Data for Public Governance
free download

The rapid emergence of open data portals and the explosion in data availability ('big data') in the government context is opening great opportunities for collaborative governance and innovative way of using modelling techniques for improving policy-making. We refer to this

Big data
free download

Could there possibly be a correlation between people buying books and shoes from the online retailer Amazon at a certain time in the evening? Are credit card companies able to predict which of their customers may be heading for a marriage crisis, solely on the basis

Visualizing Big Data: Social Network Analysis
free download

We live in an interconnected world. What began as a dream of academic researchers has entered the realm of commerce and politics. What began as an experiment run by computer scientists in the IBM labs has morphed into human-computer interactions and social

MegaODA large sample and BIG DATA time trials: Separating the chaff
free download

Just-released MegaODA software is capable of conducting UniODA analysis for an unlimited number of attributes using samples as large as one million observations. To minimize the computational burden associated with Monte Carlo simulation used to

New Framework For Improving Big Data Analysis Using Mobile Agent
free download

ABSTRACT the rising number of applications serving millions of users and dealing with terabytes of data need to a faster processing paradigms. Recently, there is growing enthusiasm for the notion of big data analysis. Big data analysis becomes a very important

Solving Problems with Visual Analytics: The Role of Visualization and Analytics in Exploring Big Data.
free download

ABSTRACT Never before in history data is generated and collected at such high volumes as it is today. As the volumes of data available to business people, scientists, and the public increase, their effective use becomes more challenging. Keeping up to date with the flood

Pecan Street, Inc.: Smart Grid, Smart Meter, Big Data
free download

The optimizations for Intel processors, the ability to support interactive on-demand queries, the ease of integration with SQL* and Oracle*, the ability to have the management infrastructure above the normal Hadoop stack-these are all really attractive to us. These

The big-data revolution in US health care: Accelerating value and innovation
free download

1 This estimate is based on a measure developed by McKinsey, estimated spending according to wealth, which is derived from a regression analysis of income and spending data from other countries in the Organisation of Economic Co-operation and Development

Big Data Techniques for Wind Turbine Condition Monitoring
free download

ABSTRACT The desire to reduce the cost of energy from wind turbine generation has seen an increase in the research applied to the field of wind turbine condition monitoring. Wind turbine condition monitoring has the potential to reduce operation and maintenance costs

Semantic Technologies for Big Data
free download

Data Tactics Corporation is a minority--owned small business that specializes in Data Management, Data Architecture, Data Engineering, Semantic Data Representations, and Big Data. Since 2005, our engineers have been on the forefront of large, multi--domain,

Big and Useful: What's in the Data for Me?(Panel Description)
free download

In the context of extracting value to users from the available data, the database community has historically been focusing on efficient processing of primarily structured queries posed by expert users mostly on structured, pre-organized data. The rather recent Big-Data

MegaODA large sample and BIG DATA time trials: Harvesting the wheat
free download

In research involving multiple tests of statistical hypotheses the efficiency of Monte Carlo (MC) simulation used to estimate the Type I error rate (p) is maximized using a two-step procedure. The first step is identifying the effects that are not statistically significant or ns.

Redoop Infrastructure for Recurring Big Data Queries
free download

ABSTRACT This demonstration presents the Redoop infrastructure, the first fullfledged MapReduce framework with native support for recurring big data queries. Recurring queries, repeatedly being executed for long periods of time over evolving high-volume data, have

Getting Real About Games: Using Ethnography to Give Direction to Big Data
free download

ABSTRACT HCI scholars have been among those attracted to the study of online, computer- supported gaming. Big Data approaches, which analyze electronic traces left by game play, are an increasingly popular way to study it. This paper identifies basic epistemological

Twitter: Big data opportunities
free download

IN THEIR POLICY FORUM The parable of Google Flu: Traps in big data analysis (14 March, p. 1203), D. Lazer et al. remark upon recent failures of Google Flu Trends (GFT) and cast these as limitations of big data analysis in general. However, many of these

Big data processing with MapReduce for E-book
free download

ABSTRACT Evolution of IT and computer has made e-books popular day by day. In this paper, we are interested in searching a word in e-books. However, it is impossible to search a word in digitized e-books if they consist of image files such as JPG and PDF. Our solution to this

MegaODA large sample and BIG DATA time trials: Maximum velocity analysis
free download

This third time trail of newly-released MegaODA software studies the fastest-to-analyze application, known as a 2x2 cross-classification table. Designs involving unweighted binary data are arguably currently the most widely employed across quantitative scientific

Placing Big Data in Official Statistics: A Big Challenge
free download

ABSTRACT Big Data refers to data sets that are impossible to store and process using common software tools, regardless of the computing power or the physical storage at hand. The Big Data phenomenon is rapidly spreading in several domains including healthcare,

Biodiversity research in the big data era: GigaScience and Pensoft work together to publish the most data-rich species description
free download

ABSTRACT With the publication of the first eukaryotic species description, combining transcriptomic, DNA barcoding, and micro-CT imaging data, GigaScience and Pensoft demonstrate how classical taxonomic description of a new species can be enhanced by

New IT Solution Using Human-oriented Big Data Analytics
free download

OVERVIEW: There has been a shift in recent years toward innovation and the creation of new value being the wellspring of corporate competiveness. By working in collaboration with customers on big data analysis through its data analysis service, Hitachi is fostering

Embedded Analytics and Statistics for Big Data.
free download

Embedded analytics and statistics for big data have emerged as an important topic across industries. As the volumes of data have increased, software engineers are called to support data analysis and applying some kind of statistics to them. This article provides an

TOWARD CLOUD-BASED BIG DATA ANALYTICS
free download

Advanced data mining techniques and associated tools can help extract information from large, complex datasets that is useful in making informed decisions in many business and scientific applications including tax payment collection, market sales, social studies,

Getting Your Big Data Priorities Straight: A Demonstration of Priority-based QoS using Social-network-driven Stock Recommendation
free download

ABSTRACT As we come to terms with various big data challenges, one vital issue remains largely untouched. That is the optimal multiplexing and prioritization of different big data applications sharing the same underlying infrastructure, for example, a public cloud

Enabling Spatial Big Data via CyberGIS: Challenges and Opportunities
free download

Recent years have seen the emergence of many new and valuable spatial datasets. Examples include trajectories of cell-phones and Global Positioning System (GPS) devices, vehicle engine measurements, global climate models (GCM) simulation data, volunteered

Big data analytics for smart mobility: a case study.
free download

This paper presents a real case study were several mobility data sources are collected in a urban context, integrated and analyzed in order to answer a set of key questions about mobility. The study of the human mobility is a very sensitive topic for both public transport (

Big Data Analytics: Perspective Shifting from Transactions to Ecosystems
free download

Daniel Zeng, University of Arizona and Chinese Academy of Sciences Robert Lusch, University of Arizona interesting and meaningful topics for special issues. They worry about the academic standing of the publications they oversee, and along with it, a handful of

Engineering big data solutions
free download

ABSTRACT Structured and unstructured data in operational support tools have long been prevalent in software engineering. Similar data is now becoming widely available in other domains. Software systems that utilize such operational data (OD) to help with software

Mobile Sensing, BYOD and Big Data Analytics: New technologies for audience research in museums
free download

ABSTRACT Over the past four decades, varied information technology and communication tools were incorporated in standard audience research methodologies thus becoming a ubiquitous feature of fieldwork and data analysis. In this paper, we highlight the costs and

Big Data Small Footprint: The Design of A Low-Power Classifier for Detecting Transportation Modes
free download

ABSTRACT Sensors on mobile phones and wearables, and in general sensors on IoT (Internet of Things), bring forth a couple of new challenges to big data research. First, the power consumption for analyzing sensor data must be low, since most wearables and

The Human and Ethical Aspects of Big Data
free download

photographed, fingerprinted, and questioned regarding their marital status, education, and occupation. Mind you, such data gathering is not unusual-nations have long conducted

Big Data and Visual Analytics in Health and Medicine: From Pipe Dream to Reality
free download

The increasing move to electronic data platforms for the management of health information is creating an untapped resource with the power to change health care. These Big Data open up possibilities for better quality health care, and better and faster clinical research.

PROB: A tool for Tracking Provenance and Reproducibility of Big Data Experiments.
free download

ABSTRACT Reproducibility of computations and data provenance are very important goals to achieve in order to improve the quality of one's research. Unfortunately, despite some efforts made in the past, it is still very hard to reproduce computational experiments with high

Big Data Preprocessing Mechanism for Analytics of Mobile Web Log.
free download

ABSTRACT The number of mobile Web service users has increased steadily as wireless mobile Web-based services have diversified, and existing services are also being provided by Web- based interfaces on smartphones. However, mobile Web users' information can be leaked

Big Data Analytics using Hadoop Components like Pig and Hive
free download

ABSTRACT In big data world, Hadoop Distributed File System (HDFS) is very popular. It provides a framework for storing data in a distributed environment and also has set of tools to retrieve and process. These data set using map-reduce concept. In this paper, a

Big data and workforce analytics
free download

6 publications from Schwartz et al [8], and Stoughton et al [9]. For me, what's entirely missing from these application/research teams are those individuals who actually understand human psychology and the fundamentals of measurement much more than they do business

White House--MIT Big Data Privacy Workshop [A Personal View
free download

Actual and potential societal benefits of information in our increasingly digital world are leading to significant shifts in values(eg, security versus freedom) in behaviours, and ultimately in polices and laws. More than ever before, technology is far ahead of the law.

Ubiquitous analytics: Interacting with big data anywhere, anytime
free download

With more than 4 billion mobile devices in the world today, mobile computing is quickly becoming the universal computational platform of the world (P. Baudisch and C. Holz, My

Integrating big data into the computing curricula.
free download

ABSTRACT An important recent technological development in computer science is the availability of highly distributed and scalable systems to process Big Data, ie, datasets with high volume, velocity and variety. Given the extensive and effective use of systems

THE IMPLICATIONS OF BIG DATA FOR THE ENTERPRISE SYSTEMS FOR SMALL BUSINESSES
free download

ABSTRACT This article explores the implications of big data on small business enterprise systems. Possible issues include: 1) What areas in small business enterprise systems are impacted the most? 2) What algorithms/programs will be used for big data for enterprise

Big Data Investment, Skills, and Firm Value
free download

ABSTRACT This paper considers how labor market factors have shaped early returns to investment in big data technologies. It tests the hypothesis that returns to early investments in Hadoop a key big data infrastructure technology have been concentrated in select

Big data in 10 years
free download

There is a lot of excitement about Big Data which is at the intersection of the ongoing explosion in data (volumes, variety, and velocity at which it arrives and must be acted upon), the dramatic increase in cost effective memory capacities, and the maturation of scale out

Big Data and Marketing Analytics in Gaming: Combining Empirical Models and Field Experimentation
free download

ABSTRACT This paper reports on the development and implementation of a large scale, marketing analytics framework for improving the segmentation, targeting and optimization of a consumer-facing firm's marketing activities. The framework leverages detailed

Scientific big data analytics challenges at large scale
free download

Data intensive computing will play a major role in exascale scientific discovery [1, 2]. Data volume, variety, velocity, and complexity all present challenges that must be faced to efficiently address data analysis at large scale [3, 4].

Benchmarking Correctness of Operations in Big Data Applications
free download

ABSTRACT With a wide variety of big data applications, the past few years have witnessed an increasing number of data stores with novel design decisions that may sacrifice the correctness of an application's operations to enhance performance. This paper presents

An Embedding Method of Dynamic Educational Content through Big Data Analytics
free download

ABSTRACT A large variety of digital content for smart mobile devices has entered the market. The demand for more diverse digital content has been accelerated through the implementation of an educational environment termed 'Smart Education'in Korea. Digital

Harnessing the Value of Big Data Analytics
free download

Executive Summary In business publications and IT trade journals, the buzz about big data challenges is nearly deafening. Rapidly growing volumes of data from transactional systems like enterprise resource planning (ERP) software and non-transactional sources

" All Programmable SOC FPGA for networking and computing in big data infrastructure" .
free download

Senior Vice President amp; CTO The All Programmable SoC FPGA for Networking and Computing in Big Data Infrastructure Page 1 Page 2. Trend Data Center Infrastructure: Cloud Computing Big Data Increasing Volume, Velocity, and Variety Security Both outside and inside

The big data revolution: IPUMS-International. Trans-Border access to decades of census microdata samples for three fourths of the world and more
free download

ABSTRACT Over the past decade a revolution has occurred in the dissemination and analysis of census microdata. This paper discusses the IPUMS-International initiative to liberate census data for researchers world-wide without cost. Academic researchers and policy

Understanding systems and architecture for big data
free download

ABSTRACT The use of Big Data underpins critical activities in all sectors of our society. Achieving the full transformative potential of Big Data in this increasingly digital world requires both new data analysis algorithms and a new class of systems to handle the

Big-Data-Driven Control Strategies for Complex Networks
free download

Spurred by the growth of the World Wide Web and the Internet, and their similarity to numerous other large, dynamic, real-life networks, a truly cross-disciplinary science of complex networks has emerged in the past 15 years [1-12]. Hundreds of studies have

Crawling big data in a new frontier for socioeconomic research: Testing with social tagging
free download

ABSTRACT Tags and keywords, freely chosen by users for annotating resources, offer a new way for organizing and retrieving web resources that closely reflect the users' interests and preferences, as well as automatically generate folksonomies. Social tagging systems have

A Study on Improvements of Electric Trading System Using Big Data
free download

ABSTRACT With wireless communication and smart apparatuses, people now can create, share, and consume information at anytime and anywhere. In addition, development of technology has allowed the large-scale data of image, voice, and image to be spreaded

Semantic link network based model for organizing multimedia big data
free download

ABSTRACT Recent research shows that multimedia resources in the wild are growing at a staggering rate. The rapid increase number of multimedia resources has brought an urgent need to develop intelligent methods to organize and process them. In this paper, the

A big data approach to the ultra-fast prediction of DFT-calculated bond energies.
free download

ABSTRACT Background: The rapid access to intrinsic physicochemical properties of molecules is highly desired for large scale chemical data mining explorations such as mass spectrum prediction in metabolomics, toxicity risk assessment and drug discovery. Large volumes of

The Forrester Wave : Big Data Predictive Analytics Solutions, Q1 2013
free download

Vendors Must Rise To The Challenge Of Big Data Predictive Analytics With the rise of big data, the predictive analytics market has woken up; rms now understand the opportunity to use big data to increase their knowledge of their business, their competitors, and their

Multimedia Big Data: From Large-Scale Multimedia Information Retrieval To Active Media
free download

The explosion of multimedia data (image, video, 3D, etc.) from mobile image captures, social sharing, the web, TV shows and movies, and the availability of large amount of metadata have created unprecedented opportunities and fundamental challenges to multimedia

Modeling big smart data.
free download

Large volumes of data are generated continuously by billions of human data producers, sensors, surveillance systems, communication devices and networks (eg, the Internet). Proper analysis of this data can lead to new scientific insights, new products and services,

Big Data-Related Technologies, Challenges and Future Prospects
free download

How big is big? Science writer Stephen Strauss asks in his fun book for kids titled How Big is Big and explains that bigness is something no one can consume. In this book, we aim to answer this interesting question, but in the context of computer data. In the big data era,

Applying Stratosphere for Big Data Analytics.
free download

ABSTRACT Analyzing big data sets as they occur in modern business and science applications requires query languages that allow for the specification of complex data processing tasks. Moreover, these ideally declarative query specifications have to be optimized, parallelized

Study and Analysis of an Efficient Power Consumption Application for Big Data Collection
free download

ABSTRACT The use of smartphones has increased recently, and because of the Global Positioning System (GPS) feature of smartphones, various services have also been increasing in number. However, the GPS function in smartphones consumes a large

Big Data And Microseismic Imaging Will Accelerate The Smart Drilling Oil And Gas Revolution
free download

Contributor ooking for good news in American innovation? Over the past five years, technology has improved the productivity of the typical oil or gas rig on America's Shale fields between 200 and 300 percent according to industry experts at Bentek. This stunning

Data Mining and Knowledge Discovery for Big Data
free download

The field of data mining has made significant and far-reaching advances over the past three decades. Because of its potential power for solving complex problems, data mining has been successfully applied to diverse areas such as business, engineering, social media,

Big Data or Right Data?
free download

ABSTRACT Big data nowadays is a fashionable topic, independently of what people mean when they use this term. The challenges include how to capture, transfer, store, clean, analyze, filter, search, share, and visualize such data. But being big is just a matter of

Big Data, Statistics, and the Internet
free download

Big Data, Statistics, and the Internet Steven L. Scott Page 4. Dan Ariely January 2013 Facebook post Big data is like teenage sex: everyone talks about it, nobody really knows how to do it, everyone thinks everyone else is doing it, so everyone claims they are doing it

Local Law Enforcement Jumps on the Big Data Bandwagon: Automated License Plate Recognition Systems, Information Privacy, and Access to Government
free download

As government agencies and law enforcement departments increasingly adopt big-data surveillance technologies as part of their routine investigatory practice, personal information privacy concerns are becoming progressively more palpable. On the other hand,

An efficient framework for practical Software Estimation with Machine Learning and Big DataAnalytics
free download

ABSTRACT Today, data analysis techniques in machine learning and statistics play a vital role not only in software industry but also in science amp; technology development. Software development effort is one of the most important metrics that must be correctly estimated in

How innovative oil and gas companies are using big data to outmaneuver the competition.
free download

a microsoft white paper Drilling for new Business Value 2 contents 3 Executive summary 4 Understanding the appeal of big data 5 Making smarter, faster decisions 5 Preparing to unlock big data's value Big data and the microsoft upstream reference architecture framework

Cognitive Networked Sensing and Big Data
free download

The idea of writing this book entitled Cognitive Networked Sensing and Big Data started with the plan to write a briefing book on wireless distributed computing and cognitive sensing. During our research on large-scale cognitive radio network (and its experimental

Machine Learning Big Data Framework and Analytics for Big Data Problems
free download

ABSTRACT Generally, big data computing deals with massive and high dimensional data such as DNA microrray data, financial data, medical imagery, satellite imagery and hyperspectral imagery. Therefore, big data computing needs advanced technologies or methods to

Organizational Alignment Is Key to Big Data Success
free download

One was the promise of improved data-driven decision making. Everybody agreed on that in principle. All organizations expressed an interest in being able to do that, though what that means for different organizations varies. Some organizations are focused on

This One Does Not Go Up To Eleven: The Quantified Self Movement as an Alternative Big DataPractice
free download

ABSTRACT In academic and public discourses, big data is primarily about powerful public and private sector institutions managing the actions of populations, and the ways this management becomes internalized in the lives of users. This ethnography of the

Big data analytics for drug discovery
free download

ABSTRACT Big Data refers to data sets that are so large and complex that traditional data processing tools and technologies cannot cope with. The process of examining such data to uncover hidden patterns in them is referred to as Big Data Analytics. Drug discovery is

Big Data in Cloud Environment
free download

ABSTRACT Big Data concerns large-volume, complex, growing data sets with multiple, autonomous sources. With the fast development of networking, data storage, and the data collection capacity, Big Data is now rapidly expanding in all science and engineering

Beyond Big Data?
free download

The interactive use of Big Data within the scientific method could reap tremendous rewards, but Big Data is not readily accepted by most scientists as an integral part of their research because of the way they think about and study the natural world. In fact, only a

Study on the Automatic Alteration of the Transmission Style for Big Data Transfer according to the Change of Internet Status
free download

ABSTRACT In the era of big data, big data transmission on Internet will become commonplace. One of typical characteristics of the Internet is that the status of Internet is very hard to expect. Therefore, it is necessary to actively change the method of the transmission of big data

Big Data for Social Science Research: Hypes, Myths, and Realities
free download

Big Data for Social Science Research: Hypes, Myths, and Realities Jonathan Zhu

Fugue: Slow-Worker-Agnostic Distributed Learning for Big Models on Big Data
free download

ABSTRACT We present a scheme for fast, distributed learning on big (ie high-dimensional) models applied to big datasets. Unlike algorithms that focus on distributed learning in either the big data or big model setting (but not both), our scheme partitions both the data and

Analysis of Students' Movement Patterns through Big Data
free download

ABSTRACT Currently, the usage rate of GPS is increasing. In addition to GPS, Big Data is also in the spotlight. The Big Data is a technique that creates values through repetition pattern analysis of data . Using the Big Data, it is possible to analyze the movement path, time,

Big Data in Ubiquitous Wireless Sensor Networks
free download

Big data through cloud computing is an excellent way to offload significant amounts of computation and data from both data centers and terminal devices, due to its flexibility, scalability and significant economic savings. However, cloud computing maybe not

Big Data Projects in High Energy Physics and Cosmology at Kansas State University
free download

The goal of high energy physics (HEP) research is to discover as much as possible about the elementary properties of energy, matter, space, and time. New discoveries are made by analyzing data from new experiments performed under conditions allowing the

Inside the 'Big Data'Factory: Lessons from Health Informatics
free download

ABSTRACT This paper highlights wider engineering challenges encountered in the design and development of interfaces for 'Big Data'analysis tools with a small number of users in specialist application domains. Based on six years' collaboration with a UK-based health

OPC: An Effective Memory Computing Solution of Big Data For PC
free download

ABSTRACT The Big Data computing is one of hot spots of the internet of things and cloud computing. The memory computing is one of key factors of improving performance. Many companies and institutions provide technology and produce. But expensive cost and

Big Data, big influence.
free download

SEPTEMBER 2013| MINNESOTA MEDICINE| 41 part of the commons, broad community input and involvement will be needed to determine how it could be harnessed to help society more effectively address disparities and guide us toward health equity. If it

TEACHING DATABASE ADMINISTRATION IN THE WORLD OF BIG DATA AND SMALL BUDGETS
free download

ABSTRACT Teaching advanced database subjects such as database administration within a university environment traditionally has many challenges; however, the modern world of big data and engineered database systems, as well as increased pressure on universities

Erratum: Data Mining and Knowledge Discovery for Big Data
free download

WW Chu (ed.), Data Mining and Knowledge Discovery for Big Data, Studies in Big Data 1, online version of this volume, the foreword is missing. It is given on the next page.

Big Data Market Size and Vendor Revenues
free download

As of early 2012, the Big Data market stands at just over $5 billion based on related software, hardware, and services revenue. Increased interest in and awareness of the power of Big Data and related analytic capabilities to gain competitive advantage and to improve

Big Data Ethics
free download

We are on the cusp of a Big Data Revolution. Increasingly large datasets are being mined for important predictions and often surprising insights. We are witnessing merely the latest stage of the Information Revolution that has transformed our society and our lives over the

MPI for Big Data: New Tricks for an Old Dog
free download

ABSTRACT The processing of massive amounts of data on clusters with finite amount of memory has become an important problem facing the parallel/distributed computing community. While MapReduce-style technologies provide an effective means for

The Politics of Big Data A Three-Level Analysis
free download

ABSTRACT What role does politics play in the emerging Big Data domain? The paper argues that Big Data political power struggles surface at three distinct levels of analysis: the social sciences, the information state, and bureaucratic politics. At the social sciences level of

3.1. 2 Big Data for GSS
free download

In today's world, human behaviour, social networks, and civil infrastructures are closely intertwined. Coupled social, technical, informational and organizational systems or STIOs do not stand-alone. They consist of many interacting physical, technological, and human or

Small area model-based estimators using big data sources
free download

ABSTRACT The timely, accurate monitoring of social indicators, such as poverty or inequality, at a fine grained spatial and temporal scale is a challenging task for official statistics, albeit a crucial tool for understanding social phenomena and policy making. We advocate in this

Ethical research standards in a world of big data [v1; ref status
free download

ABSTRACT In 2009 Ginsberg reported using Google search query volume to estimate et al. influenza activity in advance of traditional methodologies. It was a groundbreaking example of digital disease detection, and it still remains illustrative of the power of gathering data

Towards the End-to-End Design for Big Data Management in the Cloud: Why, How, and When?
free download

ABSTRACT With the wide-scale adoption of cloud computing and with the explosion in the number of distributed applications and end-user devices, we are witnessing insatiable desire to build bigger-and-bigger systems that can serve hundreds of millions of end-

Semantics-empowered Big Data Processing with Applications
free download

ABSTRACT We discuss the nature of Big Data and address the role of semantics in analyzing and processing Big Data that arises in the context of Physical-Cyber-Social Systems. We organize our research around the Five Vs of Big Data, where four of the Vs are harnessed

Environmental Conditions' Big Data Management and Cloud Computing Analytics for Sustainable Agriculture
free download

ABSTRACT The World is getting swamped with data to the tune of 7ZB a year mostly emanating from the 'internet of things' devices. This data is scattered in various devices and no meaningful relationship may be derived from it, and neither can this terrific rate be

Superconductor: A Language for Big Data Visualization
free download

Increases in data availability is the force behind many recent innovations in society. However, visualization technology for exploring data is not keeping up. Designers must choose between scale and interactivity. They want big displays because of the ability to

Big Data and official statistics
free download

ABSTRACT More and more data are being produced by an increasing number of electronic devices surrounding us and on the internet. The amount of data and the frequency at which they are produced are so vast that they are usually referred to as 'Big Data'. Because of

Transparent and flexible network management for big data processing in the cloud
free download

ABSTRACT We introduce FlowComb, a network management framework that helps Big Data processing applications, such as Hadoop, achieve high utilization and low data processing times. FlowComb predicts application network transfers, sometimes before they start, by

Big Data Mining by L2 SVMs-Geometrical Insights Help
free download

ABSTRACT The seminar will introduce a novel learning algorithm for the class of L2 Support Vector Machines classifier dubbed Direct L2 SVM (DL2 SVM). The proposed comprehensive DL2 SVM algorithm avoids solving the QP problem and yet, it produces both the exact and

Big Data Proxies an Health Privacy Exceptionalism
free download

[B] ig data is taking advantage of us without our permission. Often without consent or warning, and sometimes in completely surprising ways, big data analysts are tracking our every click and purchase, examining them to determine exactly who we are establishing

BIG DATA: PAVING THE ROAD TO IMPROVED CUSTOMER SUPPORT EFFICIENCY
free download

ABSTRACT The organizational adage 'customer is king'is not new. With a significant number of organizational resources devoted to understanding the 'king's' needs and responding to them, this phrase, in today's competitive business arena, is an understatement. With the

Interactive Data Exploration with Big Data Tukey Plots
free download

ABSTRACT Before testing hypotheses, confirmatory data analysis benefits from first examining the data to suggest hypotheses to be tested. This is known as exploratory data analysis (EDA). Our goal is to develop new automated tools to produce effective raw data

Comparison of Distributed Data-Parallelization Patterns for Big Data Analysis: A Bioinformatics Case Study
free download

ABSTRACT As a distributed data-parallelization (DDP) pattern, MapReduce has been adopted by many new big data analysis tools to achieve good scalability and performance in Cluster or Cloud environments. This paper explores how two binary DDP patterns, ie,

Big Data in Today's Working World
free download

Advancements in technology have enabled professional industries to better leverage the use of new and existing data. The term Big Data has been introduced to describe this new and unique method of data collection, storage and analysis. Big Data and traditional data

Simulation based Analysis on Big Data Service Bottleneck for Data Center
free download

ABSTRACT Big data service requires lots of IT resource if users want the fast analysis of big data. Thousands of CPUs, hundreds of Tera-byte storages and very high speed interconnections are demanded. Therefore, it is necessary to find the economic way for

Astronomy and Big Data
free download

From the shifting of our beloved earth away from the centre of the universe, to discovering the billions of galaxies and stars that make up our intergalactic neighbourhood, Astronomy continues to surprise and astound us. For a long time, empirical results have been the

Exploring Opportunities for Non-Volatile Memories in Big Data Applications
free download

ABSTRACT Large-capacity memory system allows big data applications to load as much data as possible for in-memory processing, which improves application performance. However, DRAM faces both scalability and energy challenges due to its inherent charging

A big data approach to analyzing market volatility
free download

Understanding the microstructure of the financial market requires the processing of a vast amount of data related to individual trades, and sometimes even multiple levels of quotes. This requires computing resources that are not easily available to financial academics and

Functional SVD for Big Data
free download

1) Smoothness is controlled by the tuning parameter ?. 2) Adding? u? 2 to make the problem scale-invariant 3) ? (·) is the loss function which measure the fidelity of the rank-1 approximation. If ? (·)=?·? 2, then least square. 4) Due to the theory

Measuring the uk's digital economy with big data
free download

In 1948, the post-war British Government badly needed to improve the nation's economy. To help it draw up the right policies for jobs and growth, the Government took a very scientific approach-one of which Lord Kelvin would have been proud. Government statisticians

Processing of Heterogeneous Big Data in an Atrain Distributed System (ADS) Using the Heterogeneous Data Structure r-Atrain
free download

ABSTRACT The present day world dealing with big data (expanding very fast in 4Vs: Volume, Varity, Velocity and Veracity) needs New advanced kind of logical and physical storage structures, New advanced kind of heterogeneous data structures, New mathematical

Big Data Problems in Social Media Analytics
free download

You may recognize me from my pictures. Yes, it's really me. I've been curious about online dating for a long time, but, like lots of people, have been reluctant to take the leap. I'm just now getting around to it for a couple reasons. After recently writing and publishing my new

The Perfect Storm of Mobile, Social, Cloud, and Big Data
free download

This scenario is becoming a reality as four of the fastest-growing technologies mobile, social, cloud, and big data collide. Combined, their impact creates a perfect storm that can wreak havoc or generate opportunity for IT departments. The task is to accept that profiling. This will include development for possibly billions of individuals' characterization of the genome, epigenome, transcriptome, proteome, cytokineome, metabolome, auto antibodyome, and microbiome (gut, urine, nose, tongue, and skin). With this we will have

High-Availability Monitoring and Big Data: Using Java Clustering and Caching Technologies to Meet Complex Monitoring Scenarios
free download

ABSTRACT Monitoring and control applications face ever more demanding requirements: as both data sets and data rates continue to increase, non-functional requirements such as performance, availability and maintainability become more important. C2MON (CERN

Big data challenges and opportunities in high-throughput sequencing
free download

Traditionally, data collection has been the principle bottleneck for advancement in the life sciences, particularly in genomics. For example, during the Human Genome Project, time, equipment, and laboratory space were consumed by the preparation of clone libraries and

MERRA Analytic Services: Meeting the Big Data challenges of climate
free download

60 The term ''Big Data''is used to describe data sets that are too 61 large and complex to be science represents 63 a Big Data domain that is experiencing unprecedented growth 64(

Spatial Big Data Organization, Access and Visualization with ESSG
free download

ABSTRACT There are hundreds of spatial reference frame (SRF) being applied, and the great difference among SRFs has blocked the share of global data on planet Earth. A conceptual spheroid of radius 12,800 km and a spheroid degenerated octree grid method

Compressing Big Data: when the rate of convergence to the entropy matters.
free download

ABSTRACT In this talk we discuss of the rate of convergence to the entropy of dictionary based compressors. A faster rate of convergence to the theoretical compression limit should correspond to better compression in practice, but constants also matters. Therefore in the

Review of Graph Databases for Big Data Dynamic Entity Scoring
free download

Summary Modeling data as a graph enables users to quickly analyze networked phenomenon, such as social network-based marketing data (eg, linking entities in social media based on their friends and their" likes" , their friend-of-a-friend's" likes" , etc.) and

Testing Vpin on Big Data Response to Reflecting on the Vpin Dispute
free download

This document was prepared as an account of work sponsored by the United States Government. While this document is believed to contain correct information, neither the United States Government nor any agency thereof, nor the Regents of the University of

Soft Computing in Big Data Processing
free download

Big data is an essential key to build a smart world as a meaning of the streaming, continuous integration of large volume and high velocity data covering from all sources to final destinations. The big data range from data mining, data analysis and decision making, by

Addressing Big Data Problems using Semantics and Natural Language Understanding
free download

ABSTRACT –The need to solve the key problems related to Big Data in a practical and effective way is becoming very important as the data is growing very fast-already exceeding the exabyte range. There are multiple problems with big data including storage, search,

Managing Consistency for Big Data Applications on Clouds: Tradeoffs and Self-Adaptiveness
free download

ABSTRACT In the era of Big Data, data-intensive applications handle extremely large volumes of data while requiring fast processing times. A large number of such applications run in the cloud in order to benefit from cloud features. In this context, replication is essential in order

Big Text Data Clustering using Class Labels and Semantic Feature Based on Hadoop of Cloud Computing
free download

ABSTRACT Clustering of class labels can be generated automatically, which is much lower quality than labels specified by human. If the class labels for clustering are provided, the clustering is more effective. In classic document clustering based on vector model,

Optique 1.0: Semantic Access to Big Data?
free download

ABSTRACT The Optique project aims at developing an end-to-end system for semantic data access to Big Data in industries such as Statoil ASA and Siemens AG. In our demonstration we present the first version of the Optique system customised for the Norwegian

Efficient Privacy-Preserving Big Data Processing through Proxy-Assisted ORAM.
free download

ABSTRACT We present a novel mechanism that allows a client to securely outsource his private data to the cloud while at the same time to delegate to a third party the right to run certain algorithms on his data. The mechanism is privacy-preserving, meaning that the

Towards quality of service driven consistency for Big Data management
free download

With the advent of Cloud Computing, Big Data management has become a fundamental challenge during the deployment and operation of distributed highly available and fault tolerant storage systems such as the HBase extensible record store. These systems can

Selectivity of Big data
free download

When Big data are discussed in relation to official statistics, a point of critique often raised is that Big data are collected by mechanisms unrelated to probability sampling, and are therefore not suitable for production of official statistics. The first part of this statement

3. A study on the Scalability of FRBCSs for Imbalanced Datasets in the Big Data Scenario
free download

ABSTRACT Classification with big data has become one of the latest trends when talking about learning from the available information. The data growth in the last years has rocketed the interest in effectively acquiring knowledge to analyze and predict trends. The variety and

Networking For Big Data
free download

Washington University in St. Louis Networking For Big Data Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 Washington University in St. Louis Big Data: Google Trends ? Near the peak (As in Gartner's Hype cycle) ? Highest interest in India ? Followed by

The R amp; D Tax Aspects of Big Data
free download

Firms have always analyzed data to support the development of new products, refine existing ones and better understand their markets. However, the explosion of data brought on by the digital age has largely outpaced the ability to make cogent use of this wealth of

Distributed Processing for Big Data Video Analytics
free download

The growing number of live video streams available today, combined with advances in system integration capabilities and video processing methods, provides a rich source of quantitative information that can act as a source stream for Big Data ingest to enable a

A comparative study on how big data is scaling business intelligence and analytics
free download

ABSTRACT The term Big Data is causing a furore all around us spanning from news articles to professional magazines, from tweets to YouTube videos, social media and blog discussions. This term, coined by Roger Magoulas from O'Reilly media in 2005, refers to a wide range

Small texts for Big Data
free download

Taking advantage of Big Data while retaining a user-centered point of view is quite difficult. Managing data volume, variety and velocity to extract the relevant information is still challenging. The information extraction needs customization to adapt both content and

Towards a Big Data Reference Architecture
free download

ABSTRACT Technologies and promises connected to 'big data'got a lot of attention lately. Leveraging emerging 'big data'sources extends requirements of traditional data management due to the large volume, velocity, variety and veracity of this data. At the

User Taste Prediction Service Using Big Data
free download

ABSTRACT In this paper, we propose a personalized contents recommendation service using big data. We presented a user similarity-based contents recommendation service using NFC. This service used a small sample because it used only information of the users who

Leveraging on Electric Vehicles for Big Data Transfers
free download

Both governments and car manufacturers have recently made huge investments in electric vehicles (EVs) to turn them into a viable solution to cope with problems such as pollution due to internal combustion engines and increasing gas prices. For instance, the Renault-

Living on fumes: Digital footprints, data fumes, and the limitations of spatial big data
free download

Amid the continued rise of big data in both the public and private sectors, spatial information has come to play an increasingly prominent role. This article defines big data as both a sociotechnical and epistemic project with regard to spatial information. Through interviews

Taming Biological Big Data with D4M
free download

The growth of large, unstructured data sets is driving the development of new tech nologies for finding items of interest in these data. Because of the tremendous expansion of data from DNA sequencing, bioinformatics has become an active area of research in the

Visualization of Big Data: Its Tools and Challenges
free download

ABSTRACT The rapid development of the heterogeneous networking and social websites is leading to the exponential growth in the amount of the data. To examine the bulky amount of data, from concealed patterns and unidentified correlations, the big data analysts require

Big Data Collection and Utilization for Operational Support of Smarter Social Infrastructure
free download

OVERVIEW: Progress is being made on the use of information-control platforms for the collection of social infrastructure data and its utilization in fields such as electric power and EV operation. In addition to the collection of social infrastructure data, information-control

Big Data and Internet of Things: A Roadmap for Smart Environments
free download

Data-intensive computing is now starting to be considered as the basis for a new, fourth paradigm for science. Two factors are encouraging this trend. First, vast amounts of data are becoming available in more and more application areas. Second, the infrastructures

Achieving Competitive Advantage Through Big Data. Strategic Implications
free download

ABSTRACT Big data is, without doubt, a hot topic nowadays, moreover because the development of new technology makes it possible to analyze all available ever-growing data which easily amasses terabytes of information. However, big data poses both a big

A study on the Monitoring Model for Traffic Analysis and Application of Big Data
free download

ABSTRACT New services such as Smart media recently as an extension of the platform, big data, with an increase of the Internet traffic, according to new network services, such as LTE network QoS (Quality of Service) to be reflected in policies such as the well known Internet

Big Data and Hadoop: A Review
free download

ABSTRACT -Big data is a term for massive data sets, a large amount of data available in complex structured or no structure form. These vast amounts of data are generated by social media and networks, scientific instruments, mobile devices, sensor technology and

Development of Electric Trading System Using Big Data.
free download

ABSTRACT Development of Smart Apparatuses, represented by Smart-phone, and development of internet and information amp; communication technology has changed the pattern of our life. With wireless communication and smart apparatuses, people now can

Is Big Data an Economic Big Dud?
free download

IF pencil marks on some colossal doorjamb could measure the growth of the Internet, they would probably be tracking the amount of data sloshing through the public network that spans the planet. Christened by the World Economic Forum as the new oil and a new

Big Data and the Ag Sector: More than Lots of Numbers
free download

ABSTRACT It seems that one can't go through a work day without seeing some mention of Big Data, its application and its potential to have unprecedented impact. The potential for Big Data application in the agricultural sector is examined. The role of analytics and the

Belles lettres Meets Big Data
free download

In preparing his 1887 paper, Mendenhall tallied the lengths of at least 30,000 words, and he recruited friends to count more. Out of curiosity, I tried hand-tabulating the lengths of the first 1,000 words of Oliver Twist. The task took more than an hour, and I made a dozen

Taking a big data/NoSQL approach to digital asset management
free download

Providing easy, open access to assets and asset information across an organisation is a universal goal for digital asset management systems. When a digital asset management team is charged with delivering access to assets to various teams all with different

Optimizing Distance-Based Methods for Big Data Analysis
free download

ABSTRACT Distance-based methods for measuring spatial concentration such as the Duranton- Overman index undergo an increasing popularity in the spatial econometrics community. However, a limiting factor for their usage is their computational complexity since both their

Dynamic Hilbert Curve-based B+-Tree to Manage Frequently Updated Data in Big DataApplications
free download

ABSTRACT In big data application sets, the values of the data used change continually in practice. Therefore, applications involving frequently updated data require index structures that can efficiently handle frequent update of data values. Several methods to index the

Architecture Framework and Components for the Big Data Ecosystem
free download

ABSTRACT Big Data are becoming a new technology focus both in science and in industry and motivate technology shift to data centric architecture and operational models. There is a vital need to define the basic information/semantic models, architecture components and

Big Data Processing and Mining for the future ICT-based Smart Transportation Management System
free download

ABSTRACT Future Internet (FI) technologies can considerably enhance the effectiveness and user friendliness of present smart transportation management systems (STMS), providing considerable economic and social impact. Real-world application scenarios are needed

Big data analytics in healthcare: promise and potential
free download

ABSTRACT Objective: To describe the promise and potential of big data analytics in healthcare. Methods: The paper describes the nascent field of big data analytics in healthcare, discusses the benefits, outlines an architectural framework and methodology, describes

BIG DATA AND ACCREDITATION
free download

Big Data has captured public attention as a critical tool to advance data analytics, visualization and customized services to consumers. This trend is affecting higher education with more data available on student readiness, progression and success. While much is

Parallel routing on multi-core routers for big data transfers
free download

ABSTRACT Over the last several years, the deployment of multi-core routers has grown rapidly. However, big data transfers are not leveraging the powerful multi-core routers to the extent possible, particularly in the key function of routing. Our main goal is to find a way to

City Data: Big, Open and Linked
free download

ABSTRACT Cities are moving towards policy-making based on data. They are publishing data using Open Data standards, linking data from disparate sources, allowing the crowd to update their data with Smart Phone Apps that use Open APIs, and applying Big Data

Recommending Environmental Big Data Using Semantically Guided Machine Learning
free download

In information technology, Big Data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data- processing applications [75]. The trend to larger data sets is due to the additional

Big Data: A Small Introduction
free download

Soho, London, August 1854: seven years before the discovery of germs by Louis Pasteur, people were dying in their hundreds from a mysterious disease called cholera. The wisdom of the time was that cholera was caused by miasma: something bad in the air a foul fog

Data Visualization for Big Data
free download

In late 2012, the Parsons Institute for Information Mapping began documenting data visualization strategies for big data. Defining visualization strategies specifically for big data is difficult, since not everyone agrees on what big data is. Big data can generally be

Theory of Solid Matrices amp; Solid Latrices, Introducing New Data Structures MA, MT: for Big Data
free download

ABSTRACT Matrix theory has an unlimited volume of applications in all branches of Science, Engineering, Statistics, Optimization, Numerical Analysis, Computer Science, Medical Science, Economics, etc. The present day world dealing with big data (expanding very fast

Classifying network traffic in the big data era
free download

CLASSIFYING NETWORK TRAFFIC IN THE BIG DATA ERA Professor Yang Xiang challenges of the network traffic classification problems in big data era Solving Challenge 1: Big network data, small samples Solving Challenge 2: Processing traffic accurately, with

How big data is changing the whole equation for business
free download

Big data is also changing hiring. Take Catalyst IT Services, a Baltimore-based technology outsourcing company that assembles teams for programming jobs. This year, the company will screen more than 10,000 candidates. Not only is traditional recruiting too slow and

A Performance Modeling Language For Big Data Architectures.
free download

ABSTRACT Big Data applications represent an emerging field, which have proved to be crucial in business intelligence and in massive data management. Big Data promises to be the next big thing in the development of strategical computer applications, even if it

Big Data Analaysis and Visualization: What Do LINACS and Tropical Storms Have In Common?
free download

ABSTRACT While there is wisdom in the old adage" the two constants in life are death and taxes,''there are unavoidable truths facing modern experimental and computational science. First is the growing" impedance mismatch''between our ability to collect and generate data

Big Data Distortions: Exploring the Limits of the ABA LEATPR Standards
free download

Before moving on to my contribution about how the growing reliance on big data analytics may necessitate a slight modification to the ABA Standards on Law Enforcement Access to Third Party Records (LEATPR Standards), 1 I would like first to pay a few compliments to

The Glass House Effect: Big Data, the New Oil, and the Power of Analogy
free download

One hears with some frequency today that?data is the new oil.? 1 Recently, Virginia Rometty, IBM's Chief Executive Officer, updated the phrase, explaining that Big Data is the new oil. 2 Most people who use the analogy do so in order to convey Big Data's

Discussion about Big Data Mining Based on Hadoop
free download



Exploiting bounded staleness to speed up Big Data analytics
free download

ABSTRACT Many modern machine learning (ML) algorithms are iterative, converging on a final solution via many iterations over the input data. This paper explores approaches to exploiting these algorithms' convergent nature to improve performance, by allowing

Data Posting: a New Frontier for Data Exchange in the Big Data Era.
free download

Data exchange [5, 1] is the problem of migrating a data instance from a source schema to a target schema such that the materialized data on the target schema satisfies a number of given integrity constraints (mainly inclusion and functional dependencies). The target

Inverted Indexing In Big Data Using Hadoop Multiple Node Cluster
free download

ABSTRACT Inverted Indexing is an efficient, standard data structure, most suited for search operation over an exhaustive set of data. The huge set of data is mostly unstructured and does not fit into traditional database categories. Large scale processing of such data

Global Data Spatially Interrelate System for Scientific Big Data Spatial-Seamless Sharing
free download

ABSTRACT A good data sharing system with spatial-seamless services will prevent the scientists from tedious, boring, and time consuming work of spatial transformation, and hence encourage the usage of the scientific data, and increase the scientific innovation.

Information Centric Networking for Delivering Big Data with Persistent Identifiers
free download

ABSTRACT Information Centric Networking (ICN) is a new and promising network concept which is founded upon the idea that most users in the internet are interested in accessing digital objects, irrespectively of their locations. Digital objects in ICN have unique names

Big Data Analytics for Security
free download

Enterprises routinely collect terabytes of security-relevant data (for instance, network events, software application events, and people's action events) for regulatory compliance and post hoc forensic analysis. Large enterprises generate an estimated 10 to 100 billion events

Big Data Analytic and Visualization On Mobile Devices
free download

ABSTRACT This paper presents an Android Application that can be used by the higher level management, staff, salesman etc in their mobile phones and tablets. It gives the organization an analytical view in the form of Charts (Area Chart, Bar Chart, D3 Chart, Google Maps etc

Dealing with big data: The case of Twitter
free download

ABSTRACT As data sets keep growing, computational linguists are experiencing more big data problems: challenging demands on storage and processing caused by very large data sets. An example of this is dealing with social media data: including metadata, the messages of

Interpreting Big Data : Self-Quantifiers, Data Distance, and Rock Star Analysts
free download

ABSTRACT A variety of institutions businesses, healthcare companies, and governmental agencies are investing significant resources in order to capture and analyze Big Data. Researchers across academic disciplines, too, are utilizing Internet-generated Big Data to

Big Data Initiative as an IT Solution for Improved Operation and Maintenance of Wind Turbines
free download

ABSTRACT Big Data (BD) problems require handling extremely large or complex datasets that would be difficult and expensive using traditional relational databases. Software solutions with distributed processing, weakened consistency requirements and well-designed data

United States Government Efforts toward Big Data Research and Development
free download

Research and development revolving around big data is currently making huge strides in industry, academia and national governments. The term does not quite have an exact definition, but is rather a general way of referring to large quantities of digital data. If we

Big Data Fundamentals
free download

Louis Big Data Fundamentals Raj Jain Washington University in Saint Louis Washington University in St. Louis Big Data ? Data is measured by 3V's: ? Volume: TB

Big Data Framework for u-Healthcare System
free download

ABSTRACT Recent u-Healthcare system can measure more complicated bio signal according to both built in sensor technology and personal carrying equipments' appearance. The system has been developed to analyze bio signal at anywhere and anytime. For example,

Innovation of tourism statistics through the use of new big data sources
free download

In the last decade, more and more data have been becoming available for research and development. There seems to be a move from data scarcity to data abundance ( data deluge ). This is primarily the result of increasing possibilities to digitize growing volumes

Big Data Case Study: A Web-Log Based Framework for Analyzing the Use-Quality of a Website
free download

ABSTRACT One key element of assessing a website is to measure how much it is used by users. This paper proposes a framework of measuring the use-quality of a website by analyzing its web-log. A web-log is a representative type of big data, which is spotlighted

A Distributed Rule Engine Based on Message-Passing Model to Deal with Big Data
free download

ABSTRACT Rule engine is a good way of knowledge representation and inference. It has been extensively studied and used in artificial intelligence. However, because of its low computational efficiency and the limitation of single machine's capacity, it cannot deal well

The Future Revolution on Big Data
free download

ABSTRACT Big data is a popular, but poorly defined marketing buzzword, that describe the exponential growth, availability and use of information, both structured and unstructured. The big data trend and how it can serve as the basis for innovation, differentiation and

Information Retrieval Architecture for Heterogeneous Big Data on Situation Awareness.
free download

ABSTRACT The paper proposes the model of the data integrations systems with which the buyer/user searches and aggregates organizational entity from multiple heterogeneous data sources in order to have a contract with the proper entity for the new project. The

Healthcare Big Data Exploration in Real-Time
free download

This project explores motivating scenarios for exploring very complex medical data sets in real time, as well as exploring the implications that emerging technologies can have on existing analysis efforts that have risen out of traditional RDBMS enterprise data

Network Security Monitoring and Analysis based on Big Data Technologies
free download

ABSTRACT Network flow data provide valuable information to understand the network state and to be aware of the network security threats. However, processing the large amount of data collected from the network and providing real time information remain as big challenges.

Exploring the Big Data Spectrum
free download

ABSTRACT Today, enterprises are flooded with data terabytes and petabytes of it. Exabytes, zettabytes and yottabytes are definitely on the way. This tsunami of data, as some experts call it, which is growing exponentially, at a very high velocity from different sources in

From Big Data to Meaningful Information with SAS High-Performance Analytics
free download

This paper is about the importance of Big Data and What You Can Accomplish with the data that counts. Until recently, organizations have been limited to using subsets of their data, or they were constrained to simplistic analyses because the sheer volumes of data

Emergence and Taxonomy of Big Data as a Service
free download

ABSTRACT The amount of data that we produce and consume is growing exponentially in the modern world. Increasing use of social media and new innovations such as smartphones generate large amounts of data that can yield invaluable information if properly managed.

With Big Data Comes Big Responsibility
free download

Holly Biola, Randall M. Best, Rita M. Lahlou, Lauren MB Burke, Charles Dewar, Carlos T. Jackson, Joshua Broder, Linda Grey, Richard C. Semelka, Allen Dobson background Patients are being exposed to increasing levels of ionizing radiation, much of it from

Sizing Up Big Data, Broadening Beyond the Internet
free download

Looking for a better use for his skills, Mr. Hammerbacher departed to Silicon Valley less than a year later and joined Facebook. He started a team that began to mine the vast amounts of social network data Facebook was collecting for insights on how to tweak the service and

Big data versus small data analysis towards personalized medicine practice
free download

The new era in medical research and development, based on new approaches and advanced technologies, enabled profound insights, in various levels and degrees of sensitivity, on the human body physical and mental functioning. The identification of these

REVIEW: ENTROPY REDUCTION IN BIG DATA USING VARIOUS METHODS
free download

ABSTRACT Big data refer to a huge database out of which searching has always been a contradicting issue. To search a data out of a bunch of data set, needs a perfect classification method. The data which does not come out efficiently is termed as the

Extraction of Text from Images of Big Data
free download

ABSTRACT Collection of data sets very large and complex that becomes difficult to be processed using on-hand database management tools or traditional data processing applications is called Big Data. Text information in images of big data serves as important

Big Data and Genomics
free download

1.ABSTRACT This year's topic is Big Data and I will talk about Big Data in context of Cancer Genomics. I will try not to turn the discussion today in biology but since the algorithm I am going to introduce to you today is relevant for finding driver mutations in typical tumors; I

SeqArray: an R/Bioconductor Package for Big Data Management of Genome-Wide Sequencing Variants
free download

In the era of big data, thousands of gigabyte-size data sets are challenging scientists for data management, even on well-equipped hardware. Currently, next-generation sequencing techniques are being adopted to investigate common and rare variants, making the

High-Performance Spatial Query Processing on Big Taxi Trip Data using GPGPUs
free download

ABSTRACT City-wide GPS recorded taxi trip data contains rich information for traffic and travel analysis to facilitate transportation planning and urban studies. However, traditional data management techniques are largely incapable of processing big taxi trip data at the scale

A High-performance Computing Toolset for Big Data Analysis of Genome-Wide Variants
free download

2 Background Today thousands of gigabyte-size data sets are challenging scientists in the management of big data, diverse types of data, and complex data relationships even on well- equipped hardware. In information technology, big data usually refers to a collection of

Research on E-Government Model Based on Big Data
free download

ABSTRACT The rapid development of big data will greatly change the government's management mode. Each country in the world has issued various policies to deal with the development of big data, and our government also attaches great importance to the industry of big data.

Exploring Big Data opportunities for Online Customer Segmentation}
free download

ABSTRACT In today's competitive business environment, more and more organizations lead to move or extent their business online. Thus, there is an increasing need for organizations to build concrete online marketing strategies in order to engage with their customers. One

Is big data enough? A reflection on the changing role of mathematics in applications
free download

The advent of computers, and especially high-performance computers, has had a dramatic impact on the way in which mathematics is done and even more on how mathematics is applied, as demonstrated by the growth of computational mathematics as well as what

Ontologies for Big Data
free download

Page 1. Ontologies for Big Data Lillian Hella Department of Computer and Information Science Lecture Page 2. Page 34. 34 Use of Ontologies for Big Data Volume amp; Velocity amp; Value amp;

Research on the Method of Big Data Analysis
free download

ABSTRACT Witli the development of society, the relational database facing to the great opportunities and challenges, how to store big data, analysis big data is become a hot issue. This article from the traditional data analysis start, find out the traditional data analysis

Education and Big Data versus Big-But-Buried Data
free download

ABSTRACT The technologized world is buzzing about big data, and the apparent historic promise of harnessing such data for all sorts of purposes in business, science, security, and our domain of interest herein education. We distinguish between big data simpliciter (BD

Redundant Data Removal Technique for Efficient Big Data Search Processing.
free download

ABSTRACT Ranch industry has grown bigger. In Australia, ranches have very large number of livestock commodities: cattle, lambs, and muttons. To manage such a very large scale commodities, they need to install sensor network with MapReduce of Hadoop; since the

Big Data: are We Making a Big Mistake
free download

Big data is a vague term for a massive phenomenon that has rapidly become an obsession with entrepreneurs, scientists, governments and the media ive years ago, a team of researchers from Google announced a remarkable achievement in one of the world's top

Text Extraction From Big Data Images
free download

Big data can be seen as a collection of data set s that are very large and complex which becomes difficult to be processed using on-hand database management tools or traditional data processing applications. The data sets that are included here are with sizes beyond

A Service-Oriented Approach to Facilitate Big Data Analytics on the Web
free download

ABSTRACT The volume of data exposed on the Web is increasing at a robust pace. Reasoning is a wide-spread knowledge discovery and information retrieval technique, in particular extensively used for developing Web applications. However, most of the reasoning

A Dashboard of an Education Data Portal using Big Data Solutions
free download

ABSTRACT An Educational Data Portal (EDP) play important role in teaching and learning as it contains useful resources. Every big educational institutions such as university shall build an EDP soon or later. The aim of this study is to utilize Big Data solutions in building

Challenges of Big Data Analytics
free download

The current computer science and industry approach to the Big Data Analytics emphasizes on the importance of Graph processing, how to scale up the capability to process big graph and many algorithms are developed in this line of thinking. However, the more

Structuring Big Data: How Financial Models May Help
free download

ABSTRACT The goal of this paper is to illustrate how financial models can be used to analyze unstructured data. Indeed, with the advent of social media, researchers have access to massive amounts of new data. These new data are unstructured in the sense that they can

Unsupervised joke generation from big data.
free download

ABSTRACT Humor generation is a very hard problem. It is difficult to say exactly what makes a joke funny, and solving this problem algorithmically is assumed to require deep semantic understanding, as well as cultural and other contextual cues. We depart from previous

Big data versus the big C.
free download

big data in biomedical

Big Data Optimization: Randomized lock-free methods for minimizing partially separable convex functions
free download



Student Training in the Era of Big Data Physics Research
free download

Amit Chakrabarti, William and Joan Porter Professor and Head, Department of Physics, Kansas State University his article summarizes how the availability of Big Data is changing the research landscape in Physics. Some thoughts on student training in this new era are


FREE ENGINEERING RESEARCH PAPERS