CAJ | 학술논문

为充分利用大数据时代的海量数据，提出一种基于新浪微博的公交系统数据采集及分析方法。通过Web Crawler从新浪微博抓取所需时空范围内的公交微博，分析公交微博发布的时间与空间分布规律；随后采用KMP算法统计并剔除冗余转发及回复微博，提取并分析公交相关的热点话题；基于中科院ICTCLAS算法进行中文分词处理，删除停用词后统计词频，生成关键词的词云。最后通过南京市范围内的8913条公交微博进行实例验证与分析，结果表明，该方法可以从海量的微博数据中提取公交相关数据并进行分析，分析数据量大且有时效性，分析结果可为公交系统管理的优化与改善、公交政策的制定提供数据支撑。
위충분이용대수거시대적해량수거，제출일충기우신랑미박적공교계통수거채집급분석방법。통과Web Crawler종신랑미박조취소수시공범위내적공교미박，분석공교미박발포적시간여공간분포규률；수후채용KMP산법통계병척제용여전발급회복미박，제취병분석공교상관적열점화제；기우중과원ICTCLAS산법진행중문분사처리，산제정용사후통계사빈，생성관건사적사운。최후통과남경시범위내적8913조공교미박진행실례험증여분석，결과표명，해방법가이종해량적미박수거중제취공교상관수거병진행분석，분석수거량대차유시효성，분석결과가위공교계통관리적우화여개선、공교정책적제정제공수거지탱。
To take full advantage of huge data in big data age,the method is proposed to collect and analysis data in pub?lic transport system with Sina Weibo. In the required time and space range,public transport Weibo is captured from Sina Weibo by web crawler. Time and space distribution rule which is published by public transport Weibo is analyzed,the redundant for?wards and replies in Weibo are calculated and removed by KMP algorithm,and related hot topics of public transport are pulled and analyzed. ICTCLAS algorithm proposed by Chinese Academy of Sciences is applied to process Chine word segmentation,cal?culate word?frequency after delete the stop words,and generate keywords cloud. Verification and analysis on 8913 tips public transport Weibo in Nanjing. The results show that the related data of public transport is captured and analyzed from huge Weibo data,with the character of large data analysis and timeliness of the proposed method. The outcomes of analysis provide data sup?port for optimization and improvement of public transport managing,and set up public transport policy.