Efficient integration of big data with blockchain: Challenges, opportunity and future
Journal: Journal of Autonomous Intelligence DOI: 10.32629/jai.v6i3.726
Abstract
Big data has become more and more popular, piquing the interest of both researchers and technologists as well as business executives. Despite its advantages, big data has a number of problems that necessitate a one-stop shop. Blockchain technology has seen a considerable increase in usage, which has had a substantial impact on its applications and led to a variety of useful outcomes. In the areas of identity, trust, decentralization, data-driven decisions, data ownerships, etc., there are notable game-changers. As a result, Blockchain is frequently acknowledged as an effective fix for big data issues. Among the solutions it suggests are decentralized private data management and digital property resolution. Together, two these technologies can develop beneficial solutions.
Keywords
blockchain; big data; projects; decentralized; security; data
Full Text
PDF - Viewed/Downloaded: 0 TimesReferences
1. Manyika J, Chui M, Brown B, et al. Big Data: The Next Frontier for Innovation, Competition, And Productivity. McKinsey Global Institute; 2011.
2. Hwang K, Chen M. Big-Data Analytics for Cloud, IoT And Cognitive Computing. Wiley; 2017. pp. 432.
3. Siddiqa A, Hashem IAT, Yaqoob I, et al. A survey of big data management: Taxonomy and state-of-the-art. Journal of Network and Computer Applications 2016; 71: 151–166. doi: 10.1016/j.jnca.2016.04.008
4. Wu J, Ota K, Dong M, et al. Big data analysis-based security situational awareness for smart grid. IEEE Transactions on Big Data 2018; 4(3): 408–417. doi: 10.1109/TBDATA.2016.2616146
5. Tole AA. Big data challenges. Database Systems Journal 2013; 4: 31–40.
6. Liu CH, Lin Q, Wen S. Blockchain-enabled data collection and sharing for industrial IoT with deep reinforcement learning. IEEE Transactions on Industrial Informatics 2019; 15(6): 3516–3526. doi: 10.1109/TII.2018.2890203
7. Liu G, Dong H, Yan X, et al. B4SDC: A blockchain system for security data collection in MANETs. IEEE Transactions on Big Data 2022; 8(3): 739–752. doi: 10.1109/TBDATA.2020.2981438
8. Nakamoto S. Bitcoin: A peer-to-peer electronic cash system. In: 2018 Annual National Seminar; 30 May–1 June 2018.
9. Bernabe JB, Canovas JL, Hernandez-Ramos JL, et al. Privacy-preserving solutions for blockchain: Review and challenges. IEEE Access 2019; 7: 164908–164940. doi: 10.1109/ACCESS.2019.2950872
10. Parkin J. The senatorial governance of bitcoin: Making (de) centralized money. Economy and Society 2019; 48(4): 463–487. doi: doi.org/10.1080/03085147.2019.1678262
11. Casino F, Dasaklis YK, Patsakis C. A systematic literature review of blockchain-based applications: current status, classification and open issues. Telematics and Informatics 2019; 36: 55–81. doi: 10.1016/j.tele.2018.11.006
12. Zhang J, Zhong S, Wang T, et al. Blockchain based systems and applications: A survey. Journal of Internet Technology 2020; 21: 1–14. doi: 10.3966/160792642020012101001
13. Shalini S, Santhi H. A survey on various attacks in bitcoin and cryptocurrency. In: 2019 International Conference on Communication and Signal Processing (ICCSP); 4–6 April 2019; Chennai, India. pp. 0220–0224.
14. Huang H, Kong W, Zhou C, et al. A survey of state-of-the-art on blockchains: Theories, modelings, and tools. arXiv 2020; arXiv:2007.03520. doi: 10.48550/arXiv.2007.03520
15. Dey AK, Akcora CG, Gel YR, Kantarcioglu M. On the role of local blockchain network features in cryptocurrency price formation. The Canadian Journal of Statistics 2020; 48(3): 561–581. doi: 10.1002/cjs.11547
16. Angelis J, da Silva ER. Blockchain adoption: A value driver perspective. Business Horizons 2019; 62(3): 307–314. doi: 10.1016/j.bushor.2018.12.001
17. Chen Y, Bellavitis C. Blockchain disruption and decentralized finance: The rise of decentralized business models. Journal of Business Venturing Insights 2020; 13: e00151. doi: 10.1016/j.jbvi.2019.e00151
18. Moin S, Karim A, Safdar Z, et al. Securing IoTs in distributed blockchain: Analysis, requirements and open issues. Future Generation Computer Systems 2019; 100: 325–343. doi: 10.1016/j.future.2019.05.023
19. Zhang R, Xue R, Liu L. Security and privacy on blockchain. ACM Computing Surveys 2019; 52(3): 1–34. doi: 10.1145/3316481
20. Leonardos S, Reijsbergen D, Piliouras G. PREStO: A systematic framework for blockchain consensus protocols. IEEE Transactions on Engineering Management 2020; 67(4): 1028–1044. doi: 10.1109/TEM.2020.2981286
21. Tang MJ, Alazab M, Luo Y. Big data for cybersecurity: Vulnerability disclosure trends and dependencies. IEEE Transactions on Big Data 2019; 5(3): 317–329. doi: 10.1109/TBDATA.2017.2723570
22. Yu H, Yang Z, Sinnott RO. Decentralized big data auditing for smart city environments leveraging blockchain technology. IEEE Access 2018; 7: 6288–6296. doi: 10.1109/ACCESS.2018.2888940
23. Rahman MA, Rashid MM, Hossain MS, et al. Blockchain and IoT-based cognitive edge framework for sharing economy services in a smart city. IEEE Access 2019; 7: 18611–18621. doi: 10.1109/ACCESS.2019.2896065
24. Dwivedi AD, Srivastava G, Dhar S, Singh R. A decentralized privacy-preserving healthcare blockchain for IoT. Sensors 2019; 19(2): 326. doi: 10.3390/s19020326
25. Vyas JD, Han M, Li L, et al. Integrating blockchain technology into healthcare. In: Proceedings of the 2020 ACM Southeast Conference (ACM SE’ 20); 2–4 April 2020; New York, NY, USA. pp. 197–203.
26. Jabbari A, Kaminsky P. Blockchain and supply chain management. Available online: https://www.mhi.org/downloads/learning/cicmhe/blockchain-and-supply-chain-management.pdf (accessed on 26 July 2023).
27. Liu CH, Lin Q, Wen S. Blockchain-enabled data collection and sharing for industrial IoT with deep reinforcement learning. IEEE Transactions on Industrial Informatics 2019; 15(6): 3516–3526. doi: 10.1109/TII.2018.2890203
28. Xu C, Wang K, Li P, et al. Making big data open in edges: A resource-efficient blockchain-based approach. IEEE Transactions on Parallel and Distributed Systems 2019; 30(4): 870–882. doi: 10.1109/TPDS.2018.2871449
29. Sun J, Yao X, Wang S, Wu Y. Blockchain-based secure storage and access scheme for electronic medical records in IPFS. IEEE Access 2020; 8: 59389–59401. doi: 10.1109/ACCESS.2020.2982964
30. Li H, Han D. EduRSS: a blockchain-based educational records secure storage and sharing scheme. IEEE Access 2019; 7: 179273–179289. doi: 10.1109/ACCESS.2019.2956157
31. Shen M, Zhang J, Zhu L, et al. Secure SVM training over vertically-partitioned datasets using consortium blockchain for vehicular social networks. IEEE Transactions on Vehicular Technology 2020; 69(6): 5773–5783. doi: 10.1109/TVT.2019.2957425
32. Andoni M, Robu V, Flynn D, et al. Blockchain technology in the energy sector: A systematic review of challenges and opportunities. Renewable and Sustainable Energy Reviews 2019; 100: 143–174. doi: 10.1016/j.rser.2018.10.014
33. Rabah K. Convergence of AI, IoT, big data and blockchain: A review. The Lake Institute Journal 2018; 1(1): 1–18.
34. Ionescu L. Big data, blockchain, and artificial intelligence in cloud-based accounting information systems. Analysis and Metaphysics 2019; 18: 44–49. doi: 10.22381/AM1820196
35. Gligor DM, Pillai KG, Golgeci I. Theorizing the dark side of business-to-business relationships in the era of AI, big data, and blockchain. Journal of Business Research 2021; 133: 79–88. doi: 10.1016/j.jbusres.2021.04.043
36. Chen J, Lv Z, Song H. Design of personnel big data management system based on blockchain. Future Generation Computer Systems 2019; 101: 1122–1129. doi: 10.1016/j.future.2019.07.037
37. Hassani H, Xu H, Silva E. Banking with blockchain-ed big data. Journal of Management Analytics 2018. doi: 10.1080/23270012.2018.1528900
38. Baza M, Fouda MM, Nabil M, et al. Blockchain-based distributed key management approach tailored for smart grid. In: Fadlullah Z, Khan Pathan AS (editors). Combating Security Challenges in the Age of Big Data. Advanced Sciences and Technologies for Security Applications. Springer, Cham; 2020. pp. 237–263.
39. Deepa N, Pham QV, Nguyen DC, et al. Survey on blockchain for big data: Approaches, opportunities, and future directions. arXiv 2021; arXiv:2009.00858. doi: 10.48550/arXiv.2009.00858
40. Lv Z, Liang Q, Hossain MS, Choi BJ. Analysis of using blockchain to protect the privacy of drone big data. IEEE Network 2021; 35(1): 44–49. doi: 10.1109/MNET.011.2000154
41. Bhuiyan MZA, Zaman A, Wang T, et al. Blockchain and big data to transform the healthcare. In: Proceedings of the International Conference on Data Processing and Applications (ICDPA 2018); 12–14 May 2018; Guangzhou China. pp. 62–68.
42. Xu C, Wang K, Li P, et al. Making big data open in edges: A resource-efficient blockchain-based approach. IEEE Transactions on Parallel and Distributed Systems 2019; 30(4): 870–882. doi: 10.1109/TPDS.2018.2871449
43. Bandara E, Ng WK, De Zoysa K, et al. Mystiko—Blockchain meets big data. In: 2018 IEEE International Conference on Big Data (Big Data); 10–13 December 2018; Seattle, WA, USA. pp. 3024–3032.
44. Lv Z, Qiao L, Hossain MS, Choi BJ. Analysis of using blockchain to protect the privacy of drone big data. IEEE Network 2021; 35(1): 44–49. doi: 10.1109/MNET.011.2000154
45. Xu C, Wang K, Li P, et al. Making big data open in edges: A resource-efficient blockchain-based approach. IEEE Transactions on Parallel and Distributed Systems 2018; 30(4): 870–882. doi: 10.1109/TPDS.2018.2871449
46. Li J, Wu J, Jiang G, Srikanthan T. Blockchain-based public auditing for big data in cloud storage. Information Processing & Management 2020; 57(6): 102382. doi: 10.1016/j.ipm.2020.102382
47. Salah K, Ur Rehman MH, Nizamuddin N, Al-Fuqaha A. Blockchain for AI: Review and open research challenges. IEEE Access 2019; 7: 10127–10149. doi: 10.1109/ACCESS.2018.2890507
48. Thangaraj M, Suguna S, Sudha G. Big Data Analytics: Concepts, Techniques, Tools and Technologies. PHI Learning Private Limited; 2022. pp. 416
49. Guo L, Xie H, Li Y. Data encryption based blockchain and privacy preserving mechanisms towards big data. Journal of Visual Communication and Image Representation 2020; 70: 102741. doi: 10.1016/j.jvcir.2019.102741
50. Marichamy VS, Natarajan V. Blockchain based securing medical records in big data analytics. Data & Knowledge Engineering 2023; 144: 102122. doi: 10.1016/j.datak.2022.102122
2. Hwang K, Chen M. Big-Data Analytics for Cloud, IoT And Cognitive Computing. Wiley; 2017. pp. 432.
3. Siddiqa A, Hashem IAT, Yaqoob I, et al. A survey of big data management: Taxonomy and state-of-the-art. Journal of Network and Computer Applications 2016; 71: 151–166. doi: 10.1016/j.jnca.2016.04.008
4. Wu J, Ota K, Dong M, et al. Big data analysis-based security situational awareness for smart grid. IEEE Transactions on Big Data 2018; 4(3): 408–417. doi: 10.1109/TBDATA.2016.2616146
5. Tole AA. Big data challenges. Database Systems Journal 2013; 4: 31–40.
6. Liu CH, Lin Q, Wen S. Blockchain-enabled data collection and sharing for industrial IoT with deep reinforcement learning. IEEE Transactions on Industrial Informatics 2019; 15(6): 3516–3526. doi: 10.1109/TII.2018.2890203
7. Liu G, Dong H, Yan X, et al. B4SDC: A blockchain system for security data collection in MANETs. IEEE Transactions on Big Data 2022; 8(3): 739–752. doi: 10.1109/TBDATA.2020.2981438
8. Nakamoto S. Bitcoin: A peer-to-peer electronic cash system. In: 2018 Annual National Seminar; 30 May–1 June 2018.
9. Bernabe JB, Canovas JL, Hernandez-Ramos JL, et al. Privacy-preserving solutions for blockchain: Review and challenges. IEEE Access 2019; 7: 164908–164940. doi: 10.1109/ACCESS.2019.2950872
10. Parkin J. The senatorial governance of bitcoin: Making (de) centralized money. Economy and Society 2019; 48(4): 463–487. doi: doi.org/10.1080/03085147.2019.1678262
11. Casino F, Dasaklis YK, Patsakis C. A systematic literature review of blockchain-based applications: current status, classification and open issues. Telematics and Informatics 2019; 36: 55–81. doi: 10.1016/j.tele.2018.11.006
12. Zhang J, Zhong S, Wang T, et al. Blockchain based systems and applications: A survey. Journal of Internet Technology 2020; 21: 1–14. doi: 10.3966/160792642020012101001
13. Shalini S, Santhi H. A survey on various attacks in bitcoin and cryptocurrency. In: 2019 International Conference on Communication and Signal Processing (ICCSP); 4–6 April 2019; Chennai, India. pp. 0220–0224.
14. Huang H, Kong W, Zhou C, et al. A survey of state-of-the-art on blockchains: Theories, modelings, and tools. arXiv 2020; arXiv:2007.03520. doi: 10.48550/arXiv.2007.03520
15. Dey AK, Akcora CG, Gel YR, Kantarcioglu M. On the role of local blockchain network features in cryptocurrency price formation. The Canadian Journal of Statistics 2020; 48(3): 561–581. doi: 10.1002/cjs.11547
16. Angelis J, da Silva ER. Blockchain adoption: A value driver perspective. Business Horizons 2019; 62(3): 307–314. doi: 10.1016/j.bushor.2018.12.001
17. Chen Y, Bellavitis C. Blockchain disruption and decentralized finance: The rise of decentralized business models. Journal of Business Venturing Insights 2020; 13: e00151. doi: 10.1016/j.jbvi.2019.e00151
18. Moin S, Karim A, Safdar Z, et al. Securing IoTs in distributed blockchain: Analysis, requirements and open issues. Future Generation Computer Systems 2019; 100: 325–343. doi: 10.1016/j.future.2019.05.023
19. Zhang R, Xue R, Liu L. Security and privacy on blockchain. ACM Computing Surveys 2019; 52(3): 1–34. doi: 10.1145/3316481
20. Leonardos S, Reijsbergen D, Piliouras G. PREStO: A systematic framework for blockchain consensus protocols. IEEE Transactions on Engineering Management 2020; 67(4): 1028–1044. doi: 10.1109/TEM.2020.2981286
21. Tang MJ, Alazab M, Luo Y. Big data for cybersecurity: Vulnerability disclosure trends and dependencies. IEEE Transactions on Big Data 2019; 5(3): 317–329. doi: 10.1109/TBDATA.2017.2723570
22. Yu H, Yang Z, Sinnott RO. Decentralized big data auditing for smart city environments leveraging blockchain technology. IEEE Access 2018; 7: 6288–6296. doi: 10.1109/ACCESS.2018.2888940
23. Rahman MA, Rashid MM, Hossain MS, et al. Blockchain and IoT-based cognitive edge framework for sharing economy services in a smart city. IEEE Access 2019; 7: 18611–18621. doi: 10.1109/ACCESS.2019.2896065
24. Dwivedi AD, Srivastava G, Dhar S, Singh R. A decentralized privacy-preserving healthcare blockchain for IoT. Sensors 2019; 19(2): 326. doi: 10.3390/s19020326
25. Vyas JD, Han M, Li L, et al. Integrating blockchain technology into healthcare. In: Proceedings of the 2020 ACM Southeast Conference (ACM SE’ 20); 2–4 April 2020; New York, NY, USA. pp. 197–203.
26. Jabbari A, Kaminsky P. Blockchain and supply chain management. Available online: https://www.mhi.org/downloads/learning/cicmhe/blockchain-and-supply-chain-management.pdf (accessed on 26 July 2023).
27. Liu CH, Lin Q, Wen S. Blockchain-enabled data collection and sharing for industrial IoT with deep reinforcement learning. IEEE Transactions on Industrial Informatics 2019; 15(6): 3516–3526. doi: 10.1109/TII.2018.2890203
28. Xu C, Wang K, Li P, et al. Making big data open in edges: A resource-efficient blockchain-based approach. IEEE Transactions on Parallel and Distributed Systems 2019; 30(4): 870–882. doi: 10.1109/TPDS.2018.2871449
29. Sun J, Yao X, Wang S, Wu Y. Blockchain-based secure storage and access scheme for electronic medical records in IPFS. IEEE Access 2020; 8: 59389–59401. doi: 10.1109/ACCESS.2020.2982964
30. Li H, Han D. EduRSS: a blockchain-based educational records secure storage and sharing scheme. IEEE Access 2019; 7: 179273–179289. doi: 10.1109/ACCESS.2019.2956157
31. Shen M, Zhang J, Zhu L, et al. Secure SVM training over vertically-partitioned datasets using consortium blockchain for vehicular social networks. IEEE Transactions on Vehicular Technology 2020; 69(6): 5773–5783. doi: 10.1109/TVT.2019.2957425
32. Andoni M, Robu V, Flynn D, et al. Blockchain technology in the energy sector: A systematic review of challenges and opportunities. Renewable and Sustainable Energy Reviews 2019; 100: 143–174. doi: 10.1016/j.rser.2018.10.014
33. Rabah K. Convergence of AI, IoT, big data and blockchain: A review. The Lake Institute Journal 2018; 1(1): 1–18.
34. Ionescu L. Big data, blockchain, and artificial intelligence in cloud-based accounting information systems. Analysis and Metaphysics 2019; 18: 44–49. doi: 10.22381/AM1820196
35. Gligor DM, Pillai KG, Golgeci I. Theorizing the dark side of business-to-business relationships in the era of AI, big data, and blockchain. Journal of Business Research 2021; 133: 79–88. doi: 10.1016/j.jbusres.2021.04.043
36. Chen J, Lv Z, Song H. Design of personnel big data management system based on blockchain. Future Generation Computer Systems 2019; 101: 1122–1129. doi: 10.1016/j.future.2019.07.037
37. Hassani H, Xu H, Silva E. Banking with blockchain-ed big data. Journal of Management Analytics 2018. doi: 10.1080/23270012.2018.1528900
38. Baza M, Fouda MM, Nabil M, et al. Blockchain-based distributed key management approach tailored for smart grid. In: Fadlullah Z, Khan Pathan AS (editors). Combating Security Challenges in the Age of Big Data. Advanced Sciences and Technologies for Security Applications. Springer, Cham; 2020. pp. 237–263.
39. Deepa N, Pham QV, Nguyen DC, et al. Survey on blockchain for big data: Approaches, opportunities, and future directions. arXiv 2021; arXiv:2009.00858. doi: 10.48550/arXiv.2009.00858
40. Lv Z, Liang Q, Hossain MS, Choi BJ. Analysis of using blockchain to protect the privacy of drone big data. IEEE Network 2021; 35(1): 44–49. doi: 10.1109/MNET.011.2000154
41. Bhuiyan MZA, Zaman A, Wang T, et al. Blockchain and big data to transform the healthcare. In: Proceedings of the International Conference on Data Processing and Applications (ICDPA 2018); 12–14 May 2018; Guangzhou China. pp. 62–68.
42. Xu C, Wang K, Li P, et al. Making big data open in edges: A resource-efficient blockchain-based approach. IEEE Transactions on Parallel and Distributed Systems 2019; 30(4): 870–882. doi: 10.1109/TPDS.2018.2871449
43. Bandara E, Ng WK, De Zoysa K, et al. Mystiko—Blockchain meets big data. In: 2018 IEEE International Conference on Big Data (Big Data); 10–13 December 2018; Seattle, WA, USA. pp. 3024–3032.
44. Lv Z, Qiao L, Hossain MS, Choi BJ. Analysis of using blockchain to protect the privacy of drone big data. IEEE Network 2021; 35(1): 44–49. doi: 10.1109/MNET.011.2000154
45. Xu C, Wang K, Li P, et al. Making big data open in edges: A resource-efficient blockchain-based approach. IEEE Transactions on Parallel and Distributed Systems 2018; 30(4): 870–882. doi: 10.1109/TPDS.2018.2871449
46. Li J, Wu J, Jiang G, Srikanthan T. Blockchain-based public auditing for big data in cloud storage. Information Processing & Management 2020; 57(6): 102382. doi: 10.1016/j.ipm.2020.102382
47. Salah K, Ur Rehman MH, Nizamuddin N, Al-Fuqaha A. Blockchain for AI: Review and open research challenges. IEEE Access 2019; 7: 10127–10149. doi: 10.1109/ACCESS.2018.2890507
48. Thangaraj M, Suguna S, Sudha G. Big Data Analytics: Concepts, Techniques, Tools and Technologies. PHI Learning Private Limited; 2022. pp. 416
49. Guo L, Xie H, Li Y. Data encryption based blockchain and privacy preserving mechanisms towards big data. Journal of Visual Communication and Image Representation 2020; 70: 102741. doi: 10.1016/j.jvcir.2019.102741
50. Marichamy VS, Natarajan V. Blockchain based securing medical records in big data analytics. Data & Knowledge Engineering 2023; 144: 102122. doi: 10.1016/j.datak.2022.102122
Copyright © 2023 Himani Saraswat, Sanjay Jasola, Mahesh Manchanda
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License