[1]朱蔷蔷,张桂芸,刘文龙..基于MapReduce框架一种文本挖掘算法的设计与实现[J].郑州大学学报(工学版),2012,33(05):110-113.[doi:10.3969/j.issn.1671-6833.2012.05.024]
　ZHU Qiangqiang,ZHANG Guiyun,LIU Wenlong.The Design and lmplemention of a Text Mining AlgorithmBased on MapReduce Framework[J].Journal of Zhengzhou University (Engineering Science),2012,33(05):110-113.[doi:10.3969/j.issn.1671-6833.2012.05.024]
点击复制

基于MapReduce框架一种文本挖掘算法的设计与实现()
分享到：

《郑州大学学报(工学版)》[ISSN:1671-6833/CN:41-1339/T]

卷:
33
期数:
2012年05期
页码:
110-113
栏目:
出版日期:
2012-09-10

文章信息/Info

Title:
The Design and lmplemention of a Text Mining AlgorithmBased on MapReduce Framework
作者:
朱蔷蔷; 张桂芸; 刘文龙.
天津师范大学计算机与信息工程学院,天津,300387, 天津师范大学计算机与信息工程学院,天津,300387, 天津师范大学计算机与信息工程学院,天津,300387
Author(s):
ZHU Qiangqiang; ZHANG Guiyun; LIU Wenlong
College of Computer and information Engineering, Tianjin Normal University, Tianjin 300387, China
关键词:
Hadoop;  MapReduce;  相邻词组;  降序输出
Keywords:
Hadoop;  MapReduce;  adjacent phrase ;  descending output
分类号:
TP391
DOI:
10.3969/j.issn.1671-6833.2012.05.024
摘要:
随着文本挖掘在主动信息服务中应用的日益扩展,在文本数据的基础上分析数据的内在特征已经成为目前的研究趋势,本文在Hadoop平台上设计并实现了一种文本挖掘算法,该算法利用MapReduce框架按照自然语料中相邻词组出现的频数进行降序输出,从而有助于用户挖掘大量数据中各项集之间的联系,实验结果体现了该算法的有效性和良好的加速比.
Abstract:
With the expanding applieation of text mining in aetive information serviee, analyzing the inherentcharacteristics of data based on the text data is becoming a current research trend,this paper designs and im.plements a text mining algorithm based on the Hadoop platform which outputs the data aecording to the naturalcorpora adjacent phrase descending frequency ,thus helping the users mine the link between the set in the largequantities of data, In view of the distributed feature of the Hadoop platform, the experimental result shows theefficieney and better speedup.
更新日期/Last Update: 1900-01-01