CFP last date
15 May 2024
Reseach Article

Advanced SQL Query To Flink Translator

by Yasien Ghallab Gouda, Hager Saleh Mohammed, Mohamed Helmy Khafagy
International Journal of Applied Information Systems
Foundation of Computer Science (FCS), NY, USA
Volume 10 - Number 8
Year of Publication: 2016
Authors: Yasien Ghallab Gouda, Hager Saleh Mohammed, Mohamed Helmy Khafagy
10.5120/ijais2016451532

Yasien Ghallab Gouda, Hager Saleh Mohammed, Mohamed Helmy Khafagy . Advanced SQL Query To Flink Translator. International Journal of Applied Information Systems. 10, 8 ( April 2016), 11-15. DOI=10.5120/ijais2016451532

@article{ 10.5120/ijais2016451532,
author = { Yasien Ghallab Gouda, Hager Saleh Mohammed, Mohamed Helmy Khafagy },
title = { Advanced SQL Query To Flink Translator },
journal = { International Journal of Applied Information Systems },
issue_date = { April 2016 },
volume = { 10 },
number = { 8 },
month = { April },
year = { 2016 },
issn = { 2249-0868 },
pages = { 11-15 },
numpages = {9},
url = { https://www.ijais.org/archives/volume10/number8/881-2016451532/ },
doi = { 10.5120/ijais2016451532 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2023-07-05T19:02:54.664728+05:30
%A Yasien Ghallab Gouda
%A Hager Saleh Mohammed
%A Mohamed Helmy Khafagy
%T Advanced SQL Query To Flink Translator
%J International Journal of Applied Information Systems
%@ 2249-0868
%V 10
%N 8
%P 11-15
%D 2016
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Information in the digital world, data play an important role in most of Computer Engineering applications. The increasing of data has been more difficult to store and analyze data using the traditional database. Apache Flink is a framework to Big Data Analytics in the large cluster. SQL-likes Query set of rules for make an interface between the user and big database, so very need to SQL To Flink translator that allow the user to run Advanced SQL Query top Flink without need writing JAVA code to reach their request, and also, Complex SQL Query in Flink is limited scalability. 2. In this paper, the system is devolved to run top Flink without changing in Flink framework. This system calls, Advanced SQL Query To Flink Translator This proposed system receives Advanced SQL Query from the user then generate Flink Code for executing this Query. Finally, it returns the results of Query to the user.

References
  1. Apache flink, 2 2016. https://ci.apache.org/projects/flink/flink-docs-master/.
  2. Apache hadoop, 2 2016. http://hadoop.apache.org/.
  3. Mapreduce, 2 2016. https://cloud.google.com/appengine/docs/python/dataprocessing.
  4. Tpc-h, 2 2016. http://www.tpc.org/tpch/.
  5. Marwah N Abdullah, Mohamed H Khafagy, and Fatma A Omara. Home: Hiveql optimization in multi-session environment. In 5th European Conference of Computer Science (ECCS’14), volume 80, page 89, 2014.
  6. Hussien SH. Abdel Azez, Mohamed H. Khafagy, and Fatma A. Omara. Joum: An indexing methodology for improving join in hive star schema. International Journal of Scientific & Engineering Research, 6:111–119, 2015.
  7. Narayan Gowraj, Prasanna Venkatesh Ravi, V Mouniga, and MR Sumalatha. S2mart: smart sql to map-reduce translators. In Web Technologies and Applications, pages 571– 582. Springer, 2013.
  8. Katarina Grolinger, Michael Hayes, Wilson Akio Higashino, Alexandra L’Heureux, David S Allison, Miriam Capretz, et al. Challenges for mapreduce in big data. In Services (SERVICES), 2014 IEEE World Congress on, pages 182–189. IEEE, 2014.
  9. Hesham A Hefny, Mohamed Helmy Khafagy, and M Wahdan Ahmed. Comparative study load balance algorithms for map reduce environment. International Journal of Computer Applications, 106(18):41–50, 2014.
  10. Mohamed Helmy Khafagy. Index to index two-way join algorithm. International Journal of Digital Content Technology and its Applications, 9(4):25, 2015.
  11. Mohamed Helmy Khafagy. Indexed map-reduce join algorithm. International Journal of Scientific & Engineering Research, 6(5):705–711, 2015.
  12. Rubao Lee, Tian Luo, Yin Huai, FushengWang, Yongqiang He, and Xiaodong Zhang. Ysmart: Yet another sql-tomapreduce translator. In Distributed Computing Systems (ICDCS), 2011 31st International Conference on, pages 25–36. IEEE, 2011.
  13. Ebada Sarhan, Atif Ghalwash, and Mohamed Khafagy. Queue weighting load-balancing technique for database replication in dynamic content web sites. In Proceedings of the 9th WSEAS International Conference on APPLIED COMPUTER SCIENCE, pages 50–55, 2009.
  14. Fawzya Ramadan Sayed and Mohamed Helmy Khafagy. Sql to flink translator. IJCSI International Journal of Computer Science Issues, 12(1):169, 2015.
  15. Mina Samir Shanoda, Samah Ahmed Senbel, and Mohamed Helmy Khafagy. Jomr: Multi-join optimizer technique to enhance map-reduce job. In Informatics and Systems (INFOS), 2014 9th International Conference on, pages PDC–80. IEEE, 2014.
  16. Ashish Thusoo, Joydeep Sen Sarma, Namit Jain, Zheng Shao, Prasad Chakka, Suresh Anthony, Hao Liu, Pete Wyckoff, and Raghotham Murthy. Hive: a warehousing solution over a map-reduce framework. Proceedings of the VLDB Endowment, 2(2):1626–1629, 2009.
  17. Yingzhong Xu and Songlin Hu. Qmapper: a tool for sql optimization on hive using query rewriting. In Proceedings of the 22nd international conference on World Wide Web companion, pages 211–212. InternationalWorldWideWeb Conferences Steering Committee, 2013.
Index Terms

Computer Science
Information Sciences

Keywords

Big data Flink SQL Translator Hadoop Hive Advanced SQL Query