文献类型：期刊文献

英文题名：Accelerating the image processing by the optimization strategy for deep learning algorithm DBN

作者：Ying, Changtian[1,2];Huang, Zhen[2];Ying, Changyan[2]

机构：[1]Shaoxing Univ, Sch Mech & Elect Engn, Shaoxing 312000, Peoples R China;[2]Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830008, Peoples R China

年份：2018

卷号：2018

期号：1

外文期刊名：EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING

收录：SCI-EXPANDED(收录号：WOS:000448548400002)、、EI(收录号：20184005898689)、Scopus(收录号：2-s2.0-85054126476)、WOS

基金：This paper was supported by the National Natural Science Foundation of China under Grant Nos. 61262088, 61462079, and 61562086.

语种：英文

外文关键词：Deep learning; DBN; Acceleration strategy; Data skew; RDD cache

外文摘要：In recent years, image processing especially for remote sensing technology has developed rapidly. In the field of remote sensing, the efficiency of processing remote sensing images has been a research hotspot in this field. However, the remote sensing data has some problems when processing by a distributed framework, such as Spark, and the key problems to improve execution efficiency are data skew and data reused. Therefore, in this paper, a parallel acceleration strategy based on a typical deep learning algorithm, deep belief network (DBN), is proposed to improve the execution efficiency of the DBN algorithm in Spark. First, the re-partition algorithm based on the tag set is proposed to the relief data skew problem. Second, the cache replacement algorithm on the basis of characteristics is proposed to automatic cache the frequently used resilient distributed dataset (RDD). By caching RDD, the re-computation time of frequently reused RDD is reduced, which lead to the decrease of total computation time of the job. The numerical and analysis verify the effectiveness of the strategy.