Big Data Analytical Architecture for Real-Time Applications

Rakesh. S.Shirsath¹ , Vaibhav A.Desale² , Amol. D.Potgantwar³

¹ Department of Computer Engineering, SITRC, Nashik, India.
² Department of Computer Engineering, SITRC, Nashik, India.
³ Department of Computer Engineering, SITRC, Nashik, India .

Correspondence should be addressed to: vaibhav123desale@gmail.com .

Section:Research Paper, Product Type: Journal
Vol.5 , Issue.4 , pp.1-8, Aug-2017

Online published on Aug 30, 2017

Copyright © Rakesh. S.Shirsath, Vaibhav A.Desale, Amol. D.Potgantwar . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
 

View this paper at   Google Scholar | DPI Digital Library

XML View     PDF Download

How to Cite this Paper

1442 Views    386 Downloads    283 Downloads

Abstract :
Now a days due to the enhancement in the substantial of the real-time data coming from many social sites or any live feed of data which is continuously generating tremendous volume of information so in several fields they have got massive attention to the data or information collected by them. Also these days the usage of social media or other applications of social media has increased and data collected through this systems is of different types. Data collected by the real-time applications along with by these social media application is in massive amount. These data can be referred as term �Big Data�. If we gather this data we can observe that data has great significance and aggregation of this data can be done very effectively. Importance to this data is increased but gathered data is in massive amount so it is an challenge to analyze, aggregate and store where data is remotely located. Existing system with the conventional techniques are not able to collect, aggregate and analyze such huge data. Results obtained are not much accurate and decision creation is also not much effective by using the previous systems and methods. Considering attention to data analysis and need of effective framework which will welcome both real-time along with offline data. Therefore in this dissertation topic proposed a framework which is capable of processing huge volume of remote data collected. By using Cloud Computing environment proposed system is more effective on Real-time applications live data feed. This system can efficiently process on the real-time data and can have effective analysis and also decision making.

Key-Words / Index Term :
Big Data, Cloud Computing, Data Analysis, Real-Time Applications

References :
[1] Tanuja A, Swetha Ramana D, "Processing and Analyzing Big data using Hadoop", International Journal of Computer Sciences and Engineering, Vol.4, Issue.4, pp.91-94, 2016.
[2] J. Cohen, B. Dolan, M. Dunlap, J. M. Hellerstein, and C. Welton, “Mad skills: New analysis practices for Big Data�, PVLDB, vol. 2, no. 2,pp. 1481–1492, 2009
[3] J.Dean and S.Ghemawat , “Mapreduce : Simplified data processing on large clusters�, Commun. ACM, vol. 51, no. 1, pp. 107–113, 2008. 5
[4] Prakash Singh , "Efficient Deep Learning for Big Data: A Review", International Journal of Scientific Research in Computer Science and Engineering, Vol.4, Issue.6, pp.36-41, 2016.
[5] .Renu Bhandari, Vaibhav Hans and Neelu Jyothi Ahuja, "Big Data Security – Challenges and Recommendations", International Journal of Computer Sciences and Engineering, Vol.4, Issue.1, pp.93-98, 2016.
[6] S. Jadav, P. Rawool, V. Shah, "Image Merging in Transform Domain", International Journal of Scientific Research in Network Security and Communication, Vol.5, Issue.1, pp.38-39, 2017.
[7] Y.Wang et al., “Using a remote sensing driven model to analyze effect ofland use on soil moisture in the Weihe River Basin, China�, IEEE J. Sel.topics Appl. Earth Observ. Remote Sens., vol. 7, no. 9, pp. 3892–3902,Sep. 2014.
[8] M. Clerc, “The Swarm and the Queen: Towards a Deterministic and Adaptive Particle Swarm Optimization�, In Proceedings of the IEEE Congress on Evolutionary Computation (CEC), pp. 1951-1957, 1999. (conference style)
[9] T. Balaji , "Robust and Realistic Classification of Massive Gray Level Thresholding in Remote Sensing Images", International Journal of Computer Sciences and Engineering, Vol.2, Issue.11, pp.31-38, 2014.
[10] P.Kodimalar, "A Study on Big Data and Big Data Analytical Research and Issues", International Journal of Computer Sciences and Engineering, Vol.3, Issue.11, pp.171-179, 2015.
[11] S. Pumpichet, N. Pissinou, X. Jin, and D. Pan, “Belief-based cleaning in trajectory sensor streams�, 2012 IEEE International Conference on Communications (ICC), Jun. 2012.
[12] A. Paul, J. Wu, J.-F. Yang, and J. Jeong, “Gradient-based edge detection for motion estimation in H.264/AVC�, IET Image Processing, vol. 5, no. 4, p. 323, 2011.
[11] JHS Tomar, JS Kumar, "A Review on Big Data Mining Methods", International Journal of Scientific Research in Network Security and Communication, Vol.4, Issue.3, pp.7-14, 2016.
[12] Antonio Plaza ,Jon Atli Benediktsson , Joseph W. Boardman , Jason Brazile , Lorenzo Bruzzone., “Recent advances in techniques for hyperspectral image processing�, Remote Sensing of Environment, Vol.113, No.1, pp. S110-S122
[13] Y.Wang, “Using a remote sensing driven model to analyze effect ofland use on soil moisture in the Weihe River Basin, China�, IEEE J. Sel.topics Appl. Earth Observ. Remote Sens., vol. 7, no. 9, pp. 38923902,Sep. 2014.
[14] E. Christophe, J. Michel, and J. Inglada., “Remote sensing processing:From multicore to GPU�, IEEE J. Sel. Topics Appl. Earth Observ. Remoteens., vol. 4, no. 3, pp. 643652, Aug. 2011.
[15] R. A. Dugane and A. B. Raut., “A survey on Big Data in real-time.; Int. J.Recent Innov�, Trends Comput. Commun., vol. 2, no. 4, pp. 794797, Apr.2014.
[16] A. Plaza et al., “Recent advances in techniques for hyperspectral image processing�,Remote Sens. Environ., vol. 113, pp. 110122,2009.
[17] Zilong Zou, Yuequan Bao, Fodan Deng, and Hui Li., “An Approach of Reliable Data Transmission With Random Redundancy for Wireless Sensors in Structural Health Monitoring�, IEEE Sensors journal, vol. 15, no. 2, Feb 2015.
[18] M. Mayilvaganan and M. Sabitha., “A cloud-based architecture for Big-Data analytics in smart grid: A proposal�, in Proc. IEEE Int. Conf. Comput. Intell. Comput. Res. (ICCIC), 2013.
[19] Z. Liu, B. Jiang, and J. Heer., immense, “Real-time visual querying of Big Data�, Comput. Graph. Forum, vol. 32. no. 3, pp. 421430, pt. 4, 2013.