RESEARCH PAPERS

big data research papers 2013




Comparative Analysis of Transfer Protocols For Big Data
free download

ABSTRACT Scientists working in various fields such as astronomy and biology require access to vast volumes of data (also referred to as big data) for their research. This data may need to transferred over long distances to enable collaboration among scientists 

Database research challenges and opportunities of big graph data
free download

Graph-structured data differs from other big data in its greater focus on the relationships between entities, regarding these relationships as important as the entities themselves, and allowing the possibility of modelling the attributes of relationships just as for entities, specifying 

Big Data: A revolution that will transform how we live, work and think
free download

Read This First: We offer two ways that you can get this book for free, You can choose the way you like! You must provide us your shipping information after you complete the survey. All books will be shipped from Amazon US or Amazon UK depending on your region! 

COMMUNITY SOCIOECONOMIC DEPRIVATION AND OBESITY TRAJECTORIES IN CHILDREN USING BIG DATA.
free download

Little is known about how community-level socioeconomic conditions alter trajectories of body weight gain in children. Using data from a large electronic health record, we investigate whether residence in communities with higher socioeconomic deprivation is 

Getting Real About Games: Using Ethnography to Give Direction to Big Data
free download

ABSTRACT HCI scholars have been among those attracted to the study of online, computer- supported gaming.Big Data approaches, which analyze electronic traces left by game play, are an increasingly popular way to study it. This paper identifies basic epistemological 

MegaODA large sample and BIG DATA time trials: Harvesting the wheat
free download

In research involving multiple tests of statistical hypotheses the efficiency of Monte Carlo (MC) simulation used to estimate the Type I error rate (p) is maximized using a two-step procedure. The first step is identifying the effects that are not statistically significant or ns. 

MegaODA large sample and BIG DATA time trials: Separating the chaff
free download

Just-released MegaODA™ software is capable of conducting UniODA analysis for an unlimited number of attributes using samples as large as one million observations. To minimize the computational burden associated with Monte Carlo simulation used to 

How Far Can Big Data Take Us Towards Understanding Cities
free download

8.15 Shuttle from Hilton Hotel to Santa Fe Institute 8.30 BREAKFAST 9.00 – 9.40 Welcome and opening remarks 9.40 -- 10.30 The History and Promise of Urban Big Data Colin Harrison (IBM Smarter Cities Project, retired) 10.30 – 10.45 COFFEE BREAK 10.45 – 12.15 Big

DOES BIG DATA PROVIDE BIG OPPORTUNITIES FOR SERVICE RESEARCH?
free download

ABSTRACT Big data analytics is an emerging field with great potential for crossfertilization between information systems and service research. However, there is little rigorous inquiry into big data from a service science or management perspective. In this conceptual work, 

Toward Progress Indicators on Steroids for Big Data Systems.
free download

Recently we have witnessed an explosive growth in the complexity, diversity, number of deployments, and capabilities of big data processing systems (see Figure 11). This growth shows no sign of slowing; if anything, it is accelerating, as more users bring more diverse 

Big Data: Uses and Limitations
free download

• Rodriguez (2012):For years, statisticians have been working with large volumes of data in fields as diverse as astronomy, bioinformatics, and data mining. Big Data is different because it is generated on a massive scale by countless online interactions among 

Turning big data into tiny data: Constant-size coresets for k-means, PCA and projective clustering.
free download

ABSTRACT We prove that the sum of the squared Euclidean distances from the n rows of an n× d matrix A to any compact set that is spanned by k vectors in Rd can be approximated up to (1+ e)-factor, for an arbitrary small e 0, using the O (k/e2)-rank approximation of A and a 

Storage Challenge: Where Will All That Big Data Go?
free download

Market research firm Aberdeen Group found that data growth has averaged about 35 percent annually in recent years, as Figure 1 shows. According to Aberdeen senior research analyst Dick Csaplar, this means the amount of storage necessary to hold all this 

On Rewriting and Answering Queries in OBDA Systems for Big Data (Short Paper)
free download

ABSTRACT The project Optiqueaims at providing an end-to-end solution for scalable access to Big Data integration, were end users will formulate queries based on a familiar conceptualization of the underlying domain. From the users queries the Optique platform 

Big Data Options For Small And Medium Enterprises
free download

ABSTRACT The terms Cloud Computing and Big Data are often in the media, and small and medium sized business concerns are realizing that the amount of data they handle could be very large and important in their decision making and planning. This paper explores the 

Biodiversity research in the big data era: GigaScience and Pensoft work together to publish the most data-rich species description
free download

With the publication of the first eukaryotic species description, combining transcriptomic, DNA barcoding, and micro-CT imaging data, GigaScience and Pensoft demonstrate how classical taxonomic description of a new species can be enhanced by applying new generation 

Big Data Meets Big Models: Solution of Large-Scale Bayesian Inverse Problems
free download

Figure: Left. USArray network of 400 broadband seismic stations with~ 70 km spacing over 1000 km aperture. Past/present stations in green, future stations in blue. Right. Shear waves from deep South American earthquake plotted on top of map of arrival time. Early arrivals 

The Promise Of Big Data: New Methods For Sociological Analysis
free download

This is not to suggest that big data is somehow 'pure' or 'free' of social norms and constraints simply that these data are produced beyond rather than through sociological research methods.  Figure 1: Number of #nov9 Tweets, Retweets and Mentions 30th October - 

Astrogenomics: big data, old problems, old solutions?
free download

The ominous warnings of a data deluge in the life sciences from highthroughput DNA sequencing data are being supplanted by a second deluge, of clichs bemoaning our collective scientific fate unless we address the genomic data tsunami. It is imperative that we explore the 

The RD Tax Aspects of Big Data
free download

Firms have always analyzed data to support the development of new products, refine existing ones and better understand their markets. However, the explosion of data brought on by the digital age has largely outpaced the ability to make cogent use of this wealth of 

Big Data Analytics: Perspective Shifting from Transactions to Ecosystems
free download

Daniel Zeng, University of Arizona and Chinese Academy of Sciences Robert Lusch, University of Arizona interesting and meaningful topics for special issues. They worry about the academic standing of the publications they oversee, and along with it, a handful of 

Big Data and Distributed Data Mining: An Example of Future Networks'
free download

ABSTRACT This paper describes the perspective on the analytics of big data generated by sensors and devices on the edge of networks. The paper includes a discussion of the importance of data at the edge of networks where some of biggest big data is generated. 

Meet Charles, big data query advisor.
free download

ABSTRACT In scientific data management and business analytics, the most informative queries are a holy grail. Data collection becomes increasingly simpler, yet data exploration gets significantly harder. Exploratory querying is likely to return an empty or an 

Bayes and big data: The consensus monte carlo algorithm
free download

ABSTRACT A useful definition of big data is data that is too big to comfortably process on a single machine, either because of processor, memory, or disk bottlenecks. Graphics processing units can alleviate the processor bottleneck, but memory or disk bottlenecks 

Solving Problems with Visual Analytics: The Role of Visualization and Analytics in Exploring Big Data.
free download

ABSTRACT Never before in history data is generated and collected at such high volumes as it is today. As the volumes of data available to business people, scientists, and the public increase, their effective use becomes more challenging. Keeping up to date with the flood 

Pecan Street, Inc.: Smart Grid, Smart Meter, Big Data
free download

The optimizations for Intel processors, the ability to support interactive on-demand queries, the ease of integration with SQL* and Oracle*, the ability to have the management infrastructure above the normal Hadoop stack-these are all really attractive to us. These 

Big Data in Big Companies
free download

Big data burst upon the scene in the first decade of the 21st century, and the first organizations to embrace it were online and startup firms. Arguably, firms like Google, eBay, LinkedIn, and Facebook were built around big data from the beginning. They didn't have 

Study and Analysis of an Efficient Power Consumption Application for Big Data Collection
free download

ABSTRACT The use of smartphones has increased recently, and because of the Global Positioning System (GPS) feature of smartphones, various services have also been increasing in number. However, the GPS function in smartphones consumes a large 

Semantic Technologies for Big Data
free download

Data Tactics Corporation is a minority--owned small business that specializes in Data Management, Data Architecture, Data Engineering, Semantic Data Representations, and Big Data. Since 2005, our engineers have been on the forefront of large, multi--domain, 

Big and Useful: What's in the Data for Me?(Panel Description)
free download

The rather recent Big-Data phenomenon has been shaping a world where extreme quantities of data are col- lected in an ad-hoc, almost accidental, way. Further, the user targets for Big Data are broader than those tradition 

Open Data and Open Code for Big Science of Science Studies
free download

 Big science of science studies utilize big data, ie, large, complex, diverse, longitudinal, and/or distributed datasets that might be owned by different stakeholders. They apply a systems science approach to uncover hidden patterns, bursts of activity, correlations, and laws. 

Very Fast Estimation for Result and Accuracy of Big Data Analytics: the EARL System
free download

ABSTRACT Approximate results based on samples often provide the only way in which advanced analytical applications on very massive data sets (aka 'big data') can satisfy their time and resource constraints. Unfortunately, methods and tools for the computation of 

Big Data in Cloud Environment
free download

ABSTRACT Big Data concerns large-volume, complex, growing data sets with multiple, autonomous sources. With the fast development of networking, data storage, and the data collection capacity, Big Data is now rapidly expanding in all science and engineering 

A big data approach to the ultra-fast prediction of DFT-calculated bond energies
free download

The rapid access to intrinsic physicochemical properties of molecules is highly desired for large scale chemical data mining explorations such as mass spectrum prediction in metabolomics, toxicity risk assessment and drug discovery. Large volumes of data are 

Workload Management for Big Data Analytics
free download

Parallel database systems and MapReduce systems (most notably Hadoop) are essential components of today's infrastructure for Big Data analytics. These systems process multiple concurrent workloads consisting of complex user requests, where each request is 

Big Data: New Tricks for Econometrics
free download

Nowadays computers are in the middle of almost every economic 6 transaction. These computer-mediated transactions generate huge 7 amounts of data, and new tools are necessary to manipulate and ana-8 lyze this data. This essay offers a brief introduction to 

How structured data (Linked Data) help in Big Data Analysis---Expand Patent Data with Linked Data Cloud
free download

ABSTRACT Big Data is currently a big topic in the world. It is a commonly used term to describe data that exceeds the processing capacity of on--hand database management tools. We often use 4V (Volume, Variety, Velocity and Value) to describe its characteristics. Big Data 

Big process for big data
free download

The application is owned, delivered, and managed remotely by one or more providers 2. The application is based on a single code base that is consumed in a one-to-many model by all contracted customers at any time 3. The application is licensed on pay-per-use or 

Mining Big Data in Real Time
free download

Streaming data analysis in real time is becoming the fastest and most efficient way to obtain useful knowl- edge from what is happening now, allowing organizations to react quickly when problems appear or to detect new trends helping to improve their performance. Evolving data 

A bloat-aware design for big data applications.
free download

ABSTRACT Over the past decade, the increasing demands on data-driven business intelligence have led to the proliferation of large-scale, dataintensive applications that often have huge amounts of data (often at terabyte or petabyte scale) to process. An object-oriented 

Big Data and Network Analytics for Boosting Car Pooling
free download

ABSTRACT This work proposes a novel heuristic approach for suggesting assignement among users appearing in a potential car pooling network. We considered big datasets of GPS trajectories that allowed us to construct the network of car pooling among car drivers. 

Data Mining and Knowledge Discovery for Big Data
free download

Editor Wesley W. Chu Department of Computer Science University of California Los Angeles USA ISSN 2197-6503 ISSN 2197-6511(electronic) ISBN 978-3-642-40836-6 ISBN 978-3-642-40837-3 (eBook) DOI 10.1007/978-3-642-40837-3 Springer Heidelberg New 

Erratum: Data Mining and Knowledge Discovery for Big Data
free download

WW Chu (ed.), Data Mining and Knowledge Discovery for Big Data, Studies in Big Data 1, DOI: 10.1007/978-3-642-40837-3, © Springer-Verlag Berlin Heidelberg 2014  In the original online version of this volume, the foreword is missing. It is given on the next page.

Beyond Big Data?
free download

The interactive use of Big Data within the scientific method could reap tremendous rewards, but Big Data is not readily accepted by most scientists as an integral part of their research because of the way they think about and study the natural world. In fact, only a 

Beyond Myopic Inference in Big Data Pipelines
free download

ABSTRACT Big Data Pipelines decompose complex analyses of large data sets into a series of simpler tasks, with independently tuned components for each task. This modular setup allows re-use of components across several different pipelines. However, the 

Optimizing Distance-Based Methods for Big Data Analysis
free download

ABSTRACT Distance-based methods for measuring spatial concentration such as the Duranton- Overman index undergo an increasing popularity in the spatial econometrics community. However, a limiting factor for their usage is their computational complexity since both their 

Towards the End-to-End Design for Big Data Management in the Cloud: Why, How, and When?
free download

ABSTRACT With the wide-scale adoption of cloud computing and with the explosion in the number of distributed applications and end-user devices, we are witnessing insatiable desire to build bigger-and-bigger systems that can serve hundreds of millions of end- 

Big Data for Social Science Research: Hypes, Myths, and Realities
free download

 Big Data for Social Science Research: Hypes, Myths, and Realities Jonathan Zhu

MPI for Big Data: New Tricks for an Old Dog
free download

ABSTRACT The processing of massive amounts of data on clusters with finite amount of memory has become an important problem facing the parallel/distributed computing community. While MapReduce-style technologies provide an effective means for 

OPC: An Effective Memory Computing Solution of Big Data For PC
free download

ABSTRACT The Big Data computing is one of hot spots of the internet of things and cloud computing. The memory computing is one of key factors of improving performance. Many companies and institutions provide technology and produce. But expensive cost and 

Big data in 10 years
free download

There is a lot of excitement about Big Data which is at the intersection of the ongoing explosion in data (volumes, variety, and velocity at which it arrives and must be acted upon), the dramatic increase in cost-effective memory capacities, and the maturation of scale-out 

Analysis of Students' Movement Patterns through Big Data
free download

ABSTRACT Currently, the usage rate of GPS is increasing. In addition to GPS, Big Data is also in the spotlight. The Big Data is a technique that creates values through repetition pattern analysis of data . Using the Big Data, it is possible to analyze the movement path, time, 

Big Data Analytics using Hadoop Components like Pig and Hive
free download

ABSTRACT In big data world, Hadoop Distributed File System (HDFS) is very popular. It provides a framework for storing data in a distributed environment and also has set of tools to retrieve and process. These data set using map-reduce concept. In this paper, a 

Capturing Full Cellular Regulation In silico using Big Data: A Frontier for Systems Biology Perspectives
free download

This perspective article offers our view on the current and future directions of the integration of big data and genome-wide engineering. In our perhaps not-so-distant view of the future, a desired phenotype can be simply envisioned and inputted into a computational 

BIG Data Analytics: A Framework for Unstructured Data Analysis
free download

ABSTRACT Nowadays, most of information saved in companies are unstructured models. Retrieval and extraction of the information is essential works and importance in semantic web areas. Many of these requirements will be depend on the unstructured data analysis. 

Applying Stratosphere for Big Data Analytics.
free download

ABSTRACT Analyzing big data sets as they occur in modern business and science applications requires query languages that allow for the specification of complex data processing tasks. Moreover, these ideally declarative query specifications have to be optimized, parallelized 

Navigating Big Data with High-Throughput, Energy-Efficient Data Partitioning
free download

ABSTRACT The global pool of data is growing at 2.5 quintillion bytes per day, with 90% of it produced in the last two years alone [24]. There is no doubt the era of big data has arrived. This paper explores targeted deployment of hardware accelerators to improve the 

Big Data
free download

To make money, you've got to predict two things-what's going to happen and what people think is going to happen. When looking at the words of Hal Varian, Google's Chief Economist and professor emeritus at the University of California, Berkeley, thinking of Big Data

Big Data in Today's Working World
free download

Advancements in technology have enabled professional industries to better leverage the use of new and existing data. The term Big Data has been introduced to describe this new and unique method of data collection, storage and analysis. Big Data and traditional data 

Features of Big Data and sparsest solution in high confidence set
free download

This chapter summarizes some of the unique features of Big Data analysis. These features are shared neither by low-dimensional data nor by small samples. Big Data pose new computational challenges and hold great promises for understanding population 

TEACHING DATABASE ADMINISTRATION IN THE WORLD OF BIG DATA AND SMALL BUDGETS
free download

ABSTRACT Teaching advanced database subjects such as database administration within a university environment traditionally has many challenges; however, the modern world of big data and engineered database systems, as well as increased pressure on universities 

Superconductor: A Language for Big Data Visualization
free download

Increases in data availability is the force behind many recent innovations in society. However, visualization technology for exploring data is not keeping up. Designers must choose between scale and interactivity. They want big displays because of the ability to 

The 'big data'revolution in healthcare
free download

An era of open information in healthcare is now under way. We have already experienced a decade of progress in digitizing medical records, as pharmaceutical companies and other organizations aggregate years of research and development data in electronic databases. 

Interactive Data Exploration with Big Data Tukey Plots
free download

ABSTRACT Before testing hypotheses, confirmatory data analysis benefits from first examining the data to suggest hypotheses to be tested. This is known as exploratory data analysis (EDA). Our goal is to develop new automated tools to produce effective raw data 

Managing Consistency for Big Data Applications on Clouds: Tradeoffs and Self-Adaptiveness
free download

ABSTRACT In the era of Big Data, data-intensive applications handle extremely large volumes of data while requiring fast processing times. A large number of such applications run in the cloud in order to benefit from cloud features. In this context, replication is essential in order 

Intelligence Application Workshops: Part I: Big Data meet Complex Models
free download

The Uncertainty in Artificial Intelligence (UAI) Application Workshop was conceived in 2002, and first held at UAI 2003 in Acapulco, Mexico; the first time a workshop was associated with the Conference. This year marks the Workshop's tenth anniversary, having been held in 

The Uses of Big Data in Cities
free download

ABSTRACT There is much enthusiasm currently about the possibilities created by new and more extensive sources of data to better understand and manage cities. Here, I explore how big data can be useful in urban planning by formalizing the planning process as a general 

Taming Biological Big Data with D4M
free download

The growth of large, unstructured data sets is driving the development of new tech nologies for finding items of interest in these data. Because of the tremendous expansion of data from DNA sequencing, bioinformatics has become an active area of research in the 

Big Data Projects in High Energy Physics and Cosmology at Kansas State University
free download

The goal of high energy physics (HEP) research is to discover as much as possible about the elementary properties of energy, matter, space, and time. New discoveries are made by analyzing data from new experiments performed under conditions allowing the 

Ubiquitous Analytics: Interacting with Big Data Anywhere, Anytime.
free download

With more than 4 billion mobile devices in the world today, mobile computing is quickly becoming the universal computational platform of the world (P. Baudisch and C. Holz,My

Big Data Analysis, StudyDevelopment on Existing Cloud Platforms
free download

Recommendations are making their way into more and more products. Using larger datasets are significantly improving the recommendations. Hadoop is being increasingly used for building out the recommendation platforms. Some of the examples of Recommendations 

Dealing with Big Data: the Case of Twitter
free download

As data sets keep growing, computational linguists are experiencing more and more big data problems: challenging demands on storage and processing caused by very large data sets. An example of this is dealing with social media data: including the meta data, the 

Addressing Big Data Problems using Semantics and Natural Language Understanding
free download

ABSTRACT –The need to solve the key problems related to Big Data in a practical and effective way is becoming very important as the data is growing very fast-already exceeding the exabyte range. There are multiple problems with big data including storage, search, 

The big-data revolution in us health care: Accelerating value and innovation
free download

1 This estimate is based on a measure developed by McKinsey,estimated spending according to wealth, which is derived from a regression analysis of income and spending data from other countries in the Organisation of Economic Co-operation and Development 

SeqArray: an R/Bioconductor Package for Big Data Management of Genome-Wide Sequencing Variants
free download

Function Description seqVCF2GDS Imports VCF files seqSummary Gets the summary of a sequencing GDS file (# of samples,# of variants, INFO/FORMAT variables, etc) seqSetFilter Sets a filter to sample or variant (define a subset of data) seqGetData Gets data from a 

Tactical Big Data Analytics: Challenges, Use Cases, and Solutions
free download

ABSTRACT We discuss tactical challenges of the Big Data analytics regarding the underlying data, application space, and computing environment, and present a comprehensive solution framework motivated by the relevant tactical use cases. First, we 

User Taste Prediction Service Using Big Data
free download

ABSTRACT In this paper, we propose a personalized contents recommendation service using big data. We presented a user similarity-based contents recommendation service using NFC. This service used a small sample because it used only information of the users who 

immens: Real-time visual querying of big data
free download

ABSTRACT Data analysts must make sense of increasingly large data sets, sometimes with billions or more records. We present methods for interactive visualization of big data, following the principle that perceptual and interactive scalability should be limited by the 

Networking For Big Data
free download

Louis Networking For Big Data Raj Jain Washington University in Saint Louis Saint Louis, MO 63130

Theory of Solid MatricesSolid Latrices, Introducing New Data Structures MA, MT: for Big Data
free download

ABSTRACT Matrix theory has an unlimited volume of applications in all branches of Science, Engineering, Statistics, Optimization, Numerical Analysis, Computer Science, Medical Science, Economics, etc. The present day world dealing with big data (expanding very fast 

Dache: A Data Aware Caching for Big-Data Applications Using The MapReduce Framework
free download

ABSTRACT The buzz-word big-data (application) refers to the large-scale distributed applications that work on unprecedentedly large data sets. Google's MapReduce framework and Apache's Hadoop, its open-source implementation, are the defacto software system 

Living on fumes: Digital footprints, data fumes, and the limitations of spatial big data
free download

Amid the continued rise of big data in both the public and private sectors, spatial information has come to play an increasingly prominent role. This article defines big data as both a sociotechnical and epistemic project with regard to spatial information. Through interviews 

A performance modeling language for big data architectures
free download

ABSTRACT Big Data applications represent an emerging field, which have proved to be crucial in business intelligence and in massive data management. Big Data promises to be the next big thing in the development of strategical computer applications, even if it 

BigBench: Towards an Industry Standard Benchmark for Big Data Analytics
free download

ABSTRACT There is a tremendous interest in big data by academia, industry and a large user base. Several commercial and open source providers unleashed a variety of products to support big data storage and processing. As these products mature, there is a need to 

Numbersense: How to Use Big Data to Your Advantage
free download

Page 1. Numbersense: How to Use Big Data to Your Advantage Author: Kaiser Fung Edition: 1 Previous ISBN: Subject: BusinessEconomics 

Parallel routing on multi-core routers for big data transfers
free download

ABSTRACT Over the last several years, the deployment of multi-core routers has grown rapidly. However, big data transfers are not leveraging the powerful multi-core routers to the extent possible, particularly in the key function of routing. Our main goal is to find a way to 

Taking a big data/NoSQL approach to digital asset management
free download

Providing easy, open access to assets and asset information across an organisation is a universal goal for digital asset management systems. When a digital asset management team is charged with delivering access to assets to various teams-all with different 

U-Air: When Urban Air Quality Inference Meets Big Data
free download

ABSTRACT Information about urban air quality, eg, the concentration of PM2. 5, is of great importance to protect human health and control air pollution. While there are limited air- quality-monitor-stations in a city, air quality varies in urban spaces non-linearly and 

Combining R with Scalable Libraries to Get the Best of Both for Big Data
free download

ABSTRACT The R programming language is known for its diversity and sophistication in data analysis, however its scalability to big data has been lacking. Our project Programming with Big Data in R(pbdR) is adding scalability to its list of data virtues. We have developed 

A study on the Monitoring Model for Traffic Analysis and Application of Big Data
free download

ABSTRACT New services such as Smart media recently as an extension of the platform, big data, with an increase of the Internet traffic, according to new network services, such as LTE network QoS (Quality of Service) to be reflected in policies such as the well known Internet 

Toward an Ecosystem for Precision Sharing of Segmented Big Data
free download

ABSTRACT As the amount of data created and stored by organizations continues to increase, attention is turning to extracting knowledge from that raw data, including making some data available outside of the organization to enable crowd analytics. The adoption of the 

Leveraging on Electric Vehicles for Big Data Transfers
free download

Both governments and car manufacturers have recently made huge investments in electric vehicles (EVs) to turn them into a viable solution to cope with problems such as pollution due to internal combustion engines and increasing gas prices. For instance, the Renault- 

Big Data Analysis, StudyDevelopment on Existing Cloud Platforms
free download

Recommendations are making their way into more and more products. Using larger datasets are significantly improving the recommendations. Hadoop is being increasingly used for building out the recommendation platforms. Some of the examples of Recommendations 

Achieving Competitive Advantage Through Big Data. Strategic Implications
free download

ABSTRACT Big data is, without doubt, a hot topic nowadays, moreover because the development of new technology makes it possible to analyze all available ever-growing data which easily amasses terabytes of information. However, big data poses both a big 

Interpreting Big Data: Self-Quantifiers, Data Distance, and Rock Star Analysts
free download

ABSTRACT A variety of institutions-businesses, healthcare companies, and governmental agencies-are investing significant resources in order to capture and analyze Big Data. Researchers across academic disciplines, too, are utilizing Internet-generated Big Data to 

A High-performance Computing Toolset for Big Data Analysis of Genome-Wide Variants
free download

2 Background Today thousands of gigabyte-size data sets are challenging scientists in the management of big data, diverse types of data, and complex data relationships even on well- equipped hardware. In information technology,big data usually refers to a collection of 

Environmental Conditions' Big Data Management and Cloud Computing Analytics for Sustainable Agriculture
free download

The world is getting swamped with data to the tune of 7ZB a year mostly emanating from the 'internet of things' devices. This data is scattered in various devices and no meaningful relationship may be derived from it, and neither can this terrific rate be managed by 

Big Data Investment, Skills, and Firm Value
free download

ABSTRACT This paper considers how labor market factors have shaped early returns to investment in big data technologies. It tests the hypothesis that returns to early investments in Hadoop-a key big data infrastructure technology-have been concentrated in select 

Towards a Big Data Reference Architecture
free download

ABSTRACT Technologies and promises connected to 'big data'got a lot of attention lately. Leveraging emerging 'big data'sources extends requirements of traditional data management due to the large volume, velocity, variety and veracity of this data. At the 

Discussion about Big Data Mining Based on Hadoop
free download

School of Information Management, Wuhan University, China

Mining Big Data Using Parsimonious Factor and Shrinkage Methods
free download

ABSTRACT A number of recent studies in the economics literature have focused on the usefulness of factor models in the context of prediction using qbig datar (see Bai and Ng

Big Data Analysis, StudyDevelopment on Existing Cloud Platforms
free download

Recommendations are making their way into more and more products. Using larger datasets are significantly improving the recommendations. Hadoop is being increasingly used for building out the recommendation platforms. Some of the examples of Recommendations 

Big Data Fundamentals
free download

Apache Accumulo: Sorted distributed key/value store based on Google's BigTable design. 3rd Most popular NOSQL widecolumn system. Provides cell-level security. Users can see only authorized keys and values. Originally funded by DoD.? Apache Thrift: IDL to create 

Big Data Analytic and Visualization On Mobile Devices
free download

ABSTRACT This paper presents an Android Application that can be used by the higher level management, staff, salesman etc in their mobile phones and tablets. It gives the organization an analytical view in the form of Charts (Area Chart, Bar Chart, D3 Chart, Google Maps etc 

Big Data and Genomics
free download

1.ABSTRACT This year's topic is Big Data and I will talk about Big Data in context of Cancer Genomics. I will try not to turn the discussion today in biology but since the algorithm I am going to introduce to you today is relevant for finding driver mutations in typical tumors; I 

Learning to Hash with its Application to Big Data Retrieval and Mining
free download

both labeled data and unlabeled data for hash function learning. MLH: Minimal loss 

Big Data: Pitfalls, Methods and Concepts for an Emergent Field
free download

ABSTRACT Big Data, large-scale aggregate databases of imprints of online and social media activity, has captured scientific and policy attention. However, this emergent field is challenged by inadequate attention to methodological and conceptual issues. I review key 

Big Data Classification: Problems and challenges in network intrusion prediction with machine learning
free download

ABSTRACT This paper focuses on the specific problem of Big Data classification of network intrusion traffic. It discusses the system challenges presented by the Big Data problems associated with network intrusion prediction. The prediction of a possible intrusion attack 

Reliability Meets Big Data: Opportunities and Challenges
free download

ABSTRACT Reliability field data such as that obtained from warranty claims and maintenance records has been used traditionally for such purposes as generating predictions for warranty costs and optimizing the cost of system operation and maintenance. In the current (and 

Big Data Revolution–What Is It?
free download

in the near future with the potential introduction of smart glasses, smart watches, and advanced sensor networks that will form the core of the next-generation Internet. In 

A Real Time Approach with BIG Data–A review
free download

ABSTRACT The term big data is pervasive, and yet still the notion engenders confusion. Big data has been used to convey all sorts of concepts, including: huge quantities of data, social media analytics, next generation data management capabilities, real-time data, and much 

Exploring Big Data opportunities for Online Customer Segmentation}
free download

ABSTRACT In today's competitive business environment, more and more organizations lead to move or extent their business online. Thus, there is an increasing need for organizations to build concrete online marketing strategies in order to engage with their customers. One 

'Big Data'collaboration: Exploring, recording and sharing enterprise knowledge
free download

As data sources and data size proliferate, knowledge discovery from 'Big Data'is starting to pose several challenges. In this paper, we address a specific challenge in the practice of enterprise knowledge management while extracting actionable nuggets from diverse data 

Big Data Optimization: Randomized lock-free methods for minimizing partially separable convex functions
free download

Page 1. Big Data Optimization: Randomized lock-free methods for minimizing partially separable convex functions Peter Richtrik  DESCENT based on: PR and M. Takc, Parallel coordinate

Architecture Framework and Components for the Big Data Ecosystem
free download

ABSTRACT Big Data are becoming a new technology focus both in science and in industry and motivate technology shift to data centric architecture and operational models. There is a vital need to define the basic information/semantic models, architecture components and 

The Big Data Newsvendor: Practical Insights from Machine Learning
free download

We investigate the newsvendor problem when one has n observations of p features as well as past demand data. We consider both small data (p/n= o (1)) and big data (p/n= O (1)). For small data, we propose a linear programming machine learning algorithm and for big data 

Big Data, Bigger Opportunities
free download

Executive Summary Big data appears to have become a buzzword overnight. The term describes innovative techniques and technologies to capture, store, distribute, manage and analyze petabyte-or larger-sized datasets with high-velocity and diverse structures that 

When Big Data Meets Life Sciences: Data Reporting Standards and Innovation!
free download

ABSTRACT Cumulative innovation is a driving force of economic growth. Access costs, the time and effort scientists need to devote to understand existing knowledge, may potentially hinder new innovation. I examine the effect of a decrease in access costs resulting from the 

The Future Revolution on Big Data
free download

ABSTRACT Big data is a popular, but poorly defined marketing buzzword, that describe the exponential growth, availability and use of information, both structured and unstructured. The big data trend and how it can serve as the basis for innovation, differentiation and 

Personalizing Default Rules and Disclosure with Big Data
free download

Law is impersonal. The state generally does not tailor the contents of the law to people's characteristics and traits. In this Article we argue that in the era of Big Data, law should become more personalized. Our main focuses are default rules (situations where people 

Analysis and Research of Problems Faced by Big Data Era
free download

In 1980, the famous futurist Alvin Toffler proposed the first term of Big Data in the literature [1]. Yet, Big Data did not become a buzzword in the Internet information technology industry until 2009. The Research Agency Gartner defined Big Data as high-volume, high-velocity and 

Student Training in the Era of Big Data Physics Research
free download

Amit Chakrabarti, William and Joan Porter Professor and Head, Department of Physics, Kansas State University his article summarizes how the availability of Big Data is changing the research landscape in Physics. Some thoughts on student training in this new era are 

Artificial intelligence and big data
free download

What Is Big Data? Michael Cox and David Ellsworth1 were among the first to use the term big data literally, referring to using larger volumes of scientific data for visu alization (the term large data also has been used). Currently, there are a number of definitions of big data. 

Big Data and Peacebuilding
free download

into complex political emergencies, peace negotiations and peace processes, including post- war state-building and reconciliation. The utility and impact of an initiative like the UN's GlobalPulse to strengthen peacebuilding is rich terrain to explore (UN Global-Pulse). It is 

Big Data, Big Profits? Understanding the Role of Targeting Technologies as Part of a Mixed Online Advertisement Strategy
free download

ABSTRACT The rapid rise of online sales has introduced technologies that promise better targeting of consumers for specific ads. Thus far the literature has not differentiated between online advertising strategies and, instead, explores whether one strategy is more effective 

Getting Started with Big Data
free download

Today, every organization across the globe is faced with an unprecedented growth in data. Imagine this: The digital universe of data was expected to expand to 2.7 zettabytes (ZB) by the end of 2012. Then it's predicted to double every two years, reaching 8 ZB of data by 

TOWARD CLOUD-BASED BIG DATA ANALYTICS
free download

Advanced data mining techniques and associated tools can help extract information from large, complex datasets that is useful in making informed decisions in many business and scientific applications including tax payment collection, market sales, social studies, 

The MTA in the Age of Big Data
free download

Upon completion of the PCAC's 2010 report Minutes Matter, a study of performance measures at the Metropolitan Transportation Authority (MTA), the Permanent Citizens Advisory Committee to the MTA (PCAC) participated in the Transportation Research 

THE PROCESS OF BIG DATA SOLUTION ADOPTION
free download

The Google search engine is well known and used all over the world, but a less known fact is about the use of Google of its search queries for other purposes than to optimize the

The Governance of Big Data: Perspectives and Issues
free download

ABSTRACT Part of governance theory highlights that, within any policy domain or sub-system, the institutional structure plays a major role in shaping how policy issues are considered, actors interact, and outcomes are evaluated. This modernist theory of governance stands 

CLOUD COMPUTING WITH BIG DATA AS A SERVICE
free download

ABSTRACT –Big data management is becoming crucial now a days because of the evolution of large number of social networking websites, powerful mobile devices, sensors, and cloud computing. According to IDC analysis, the global data volume is going to grow 44 times 

The evolution of the ARM architecture towards big data and the data-centre
free download

ABSTRACT In recent years the rapid evolution of the ARM Architecture has lead to a potential inflection point where the architectural and compute capabilities the ARM partners deliver into the low cost, low power, consumer focused products has direct applicability to the 

TOWARDS BIG DATA MINING AND DISCOVERY
free download

We live in an era of big data that has embedded a huge potential and increased information complexity and risks such as insecurity as well as information overload and irrelevance. Also business intelligence and analytics are important in dealing with the magnitude and 

A Service-Oriented Approach to Facilitate Big Data Analytics on the Web
free download

ABSTRACT The volume of data exposed on the Web is increasing at a robust pace. Reasoning is a wide-spread knowledge discovery and information retrieval technique, in particular extensively used for developing Web applications. However, most of the reasoning 

Squeezing a Big Orange into Little Boxes: The AscotDB System for Parallel Processing of Data on a Sphere
free download

and the Intel Science and Technology Center for Big Data. 19 Page 10. References 

Production Scheduling and Decision-Making for Oil Industry Based on Big Data Processing
free download

ABSTRACT With the amount of data produced by numerous enterprises of oil industry brought an explosion of growth, increasing demands on data processing and analysis capabilities, especially, how to face the challenges of data and discover new opportunities, all these 

Big Data and HADOOP: A Big Game Changer
free download

 Research Paper Available online Big Data and HADOOP: A Big Game Changer  architectures. As a result, a new class of systems had to be designed and implemented, giving rise to the new phenomenon of Big Data. 

Exploration on Big Data Oriented Data Analyzing and Processing Technology
free download

ABSTRACT At present, enterprises have urgent needs to conduct an effective and stable statistical analysis on big data. With a view to solving the issue of analysis and processing of big data in respect of enterprise business, this essay proposes a hybrid structure mode 

SCIENCE IN HIGH DIMENSIONS: MULTIPARAMETER MODELS AND BIG DATA
free download

We will analyze the sensitivity of a multiple time scales dynamical system to perturbative changes in its evolution laws. Rather than utilizing the traditional means of examining the structural stability for probing qualitative changes to the attractor as a response to 

Lessons learnt from a public–private big data hackathon
free download

Executive summary This report presents the lessons learnt from a recent hackathon organised by the Big Innovation Centre and Camden Council, the local authority of a Central London borough. The hackathon involved many of the Big Innovation Centre's partners 

Has Katz Become Quaint? Use of Big Data to Outflank the Fourth Amendment
free download

pursuant to the Stored Communications Act (SCA) requiring Twitter to turn over to the government subscriber information concerning the accounts of three Twitter users. The 

Data Visualization Power Tools: Expedite the Easy, Implement the Difficult, or Handle Big Data
free download

ABSTRACT The power tools are SAS macros for ODS Graphics or SAS/GRAPH. You can use them As Is, modify them for similar, but different, tasks, or learn from them to build new solutions for very different problems. Power tools enable you to create results quickly and 

Big Data–Legal Rights and Obligations
free download

Big Data–Legal Rights and Obligations. LLP Kemp Little 1/2013.

TURNING BIG DATA INTO BIG DOLLARS
free download

 RACKSPACE HOSTING | 1 FANATICAL PLACE | SAN ANTONIO, TX 78218 USA TURNING BIG DATA INTO BIG DOLLARS  2. What is Big Data, anyway? Big Data refers to the continuous stream of digital information that arrives through many channels, including: • e-mail 

Big Data: The Next Frontier
free download

Facebook's Haystack 65 billion photos 4 images of different sizes stored for each photo? For a total of 260 billion images and 20PB of storage 1 billion new photos uploaded each week (increment of 60TB) At peak traffic 1 million images served per second An 

Big Data analytics on high velocity streams
free download

Page 1. Big Data analytics on high velocity streams Specific use cases with Storm Master Thesis 15. Part I. Big Data Background 5 Page 16. 2 Digging into Big Data 2.1. 

Survey on MapReduce with Scheduling and Partitioning In Big Data
free download

ABSTRACT Big data is used to describe a massive volume of both structured and unstructured data that is so large that it's difficult to process using traditional database and software techniques. MapReduce is programming model is implemented that helps developer to 

Big Data Archiving with Splunk and Hadoop
free download

ABSTRACT Splunk is a software that handles large amounts of data every day. With data constantly growing, there is a need to phase out old data to keep the software from running slow. However, some of Splunk's customers have retention policies that require the data to 

Developing Innovative Services Based on Big Data: The Case of Go: Smart
free download

ABSTRACT The purpose of this paper is to illuminate the challenges associated with developing innovative technology-based services based on big data. The paper presents and analyzes a case study of GO: SMART, a project with the aim to develop an innovative 

From Linear to Crowd Innovation-Facilitating the process by compiling and processing hard and soft big data through social media
free download

ABSTRACT This paper addresses the issue of Big Data in relation to knowledge transfer and the new concept of Crowd Innovation. The internet has made a huge amount of data available, which is exponential increasing. Different systems are already available for 

BIG DATA: UNDERSTANDING THE DYNAMICS OF DATA ECHO SYSTEM
free download

Big data is a term applied to a new generation of software, applications, system and storage architecture, all designed to provide business value from unstructured/unbalanced data. Big Data sets require advanced tools, software, and systems to capture, store, manage, and 

Big Data in the Information Age: Exploring the Intellectual Foundation of Communication Theory
free download

ABSTRACT Big Data are structured, semi-structured, unstructured, and raw data that are revolutionizing how we think about and use information in the 21st century. Big Data represents a paradigm shift from our prior use of traditional data assets over the past 30+ 

Adoption of Big Data Technology for the Development of Developing Countries
free download

ABSTRACT -The paper gives a short glimpse of what is Big Data, Technologies used to build a Big Data infrastructure and how it can be useful in the development of nation. The paper explores the various possibilities that Big Data can deliver with prospect to improve 

Scalable Distributed Real-Time Clustering for Big Data Streams
free download

ABSTRACT Ever growing volume of data production is the reality we are living in. Social networks, smart cities, telephone networks, the internet are some of the main data producers in the modern world and much of this information is discarded due to the high storage 

BigFoot: Big Data Analytics of Digital Footprints
free download

Executive Summary The goal of this Work Package and deliverable is the design and study of the infrastructure virtualization interfaces. We first report on our progress on building the BigFoot private cloud, which we decided to manage using OpenStack, the most mature 

Methodology for Measuring the Impact of the Privacy Protection Law on the Use of Big Data
free download

The ICT revolution triggered by the emergence of smart devices, typically represented by the iPhone and the iPad, is migrating into the new domain of 'big data'after passing the turning point of 'SNS Life,'which is represented by Twitter and FaceBook among others. These 

Lazy processing of XML in XSLT for big data
free download

ABSTRACT In recent years we've come to see more and more reports on processing big XML data with XSLT, mainly targeted at streaming XML. This has several disadvantages, mainly because streaming is often implemented as forward-only processing, which limits the 


FREE ENGINEERING RESEARCH PAPERS