Hadoop + Spark Platform Based on Big Data System Design of Agricultural Product Price Analysis and Prediction by HoltWinters

查看全文 作　　者：Yun [1,2]Deng;Yan [1,2]Zhu;Qingjun [1,2]Zhang;Xiaohui [1,2]Cheng 机构地区：[1]Guangxi Key Laboratory of Embedded Technology and Intelligent System, Guilin University of Technology, Guilin 541004, China;[2]Department of Information Science and Engineering, Guilin University of Technology, Guilin 541004, China 出　　处：《国际计算机前沿大会会议论文集》索引2019年第1期,共3页 摘　　要：In the market of agricultural products, the price of agricultural products is affected by production cost, market supply and other factors. In order to obtain the market information of agricultural products, the price fluctuation can be analyzed and predicted. A distributed big data software platform based on Hadoop, Hive and Spark is proposed to analyze and forecast agricultural price data. Firstly, Hadoop, Hive and Spark big data frameworks were built to store the data information of agricultural products crawled into MYSQL. Secondly, the information of agricultural products crawled from MYSQL was exported to a text file, uploaded to HDFS, and mapped to spark SQL database. The data was cleaned and improved by Holt-Winters (three times exponential smoothing method) model to predict the price of agricultural products in the future. The data cleaned by spark SQL was imported and predicted by improved Holt-Winters into MYSQL database. The technologies of pringMVC, Ajax and Echarts were used to visualize the data. 关 键 词：HADOOP SPARK BIG data Analysis and FORECAST of AGRICULTURAL product PRICES Holt-Winters