应用气象学报
應用氣象學報
응용기상학보
QUARTERLY JOURNAL OF APPLIED METEOROLOGY
2014年
4期
505-512
,共8页
刘一鸣%周自江%远芳%阮宇智%何文春%孙超%刘媛媛
劉一鳴%週自江%遠芳%阮宇智%何文春%孫超%劉媛媛
류일명%주자강%원방%원우지%하문춘%손초%류원원
自动气象站观测资料%实时质量控制%启动策略%计算资源
自動氣象站觀測資料%實時質量控製%啟動策略%計算資源
자동기상참관측자료%실시질량공제%계동책략%계산자원
AWS observation data%real-time quality control%starting strategy%computing resource
利用2012年4月1日-9月30日 IBM P570高性能计算环境 Oracle 11g 数据库平台对全国自动气象站观测资料实时质量控制系统(ARQCS)的运行监控数据,探讨了 ARQCS 的启动策略及其与资料解析入库率、ARQCS 的CPU 耗时、服务时效之间的关系。结果表明:自动气象站资料的解析入库效率呈“几”字型分布,每个观测时次的第5-20分钟入库率方差较大,是制约 ARQCS 质量控制时效的主要时间段。设置观测资料入库率不低于95%为首次启动条件,不仅比传统的第15分钟定时启动提前了20.6 s,而且首次启动时观测资料入库率不低于95%的概率从66.38%提升至95.83%。第20分钟后入库率仅增加1.36%,在此设置首次质量控制的强制启动点,可保证局部异常延时的资料服务时效。动态启动策略使 ARQCS 的启动次数由5次降为2次,平均每日节约 CPU 时间391 min。
利用2012年4月1日-9月30日 IBM P570高性能計算環境 Oracle 11g 數據庫平檯對全國自動氣象站觀測資料實時質量控製繫統(ARQCS)的運行鑑控數據,探討瞭 ARQCS 的啟動策略及其與資料解析入庫率、ARQCS 的CPU 耗時、服務時效之間的關繫。結果錶明:自動氣象站資料的解析入庫效率呈“幾”字型分佈,每箇觀測時次的第5-20分鐘入庫率方差較大,是製約 ARQCS 質量控製時效的主要時間段。設置觀測資料入庫率不低于95%為首次啟動條件,不僅比傳統的第15分鐘定時啟動提前瞭20.6 s,而且首次啟動時觀測資料入庫率不低于95%的概率從66.38%提升至95.83%。第20分鐘後入庫率僅增加1.36%,在此設置首次質量控製的彊製啟動點,可保證跼部異常延時的資料服務時效。動態啟動策略使 ARQCS 的啟動次數由5次降為2次,平均每日節約 CPU 時間391 min。
이용2012년4월1일-9월30일 IBM P570고성능계산배경 Oracle 11g 수거고평태대전국자동기상참관측자료실시질량공제계통(ARQCS)적운행감공수거,탐토료 ARQCS 적계동책략급기여자료해석입고솔、ARQCS 적CPU 모시、복무시효지간적관계。결과표명:자동기상참자료적해석입고효솔정“궤”자형분포,매개관측시차적제5-20분종입고솔방차교대,시제약 ARQCS 질량공제시효적주요시간단。설치관측자료입고솔불저우95%위수차계동조건,불부비전통적제15분종정시계동제전료20.6 s,이차수차계동시관측자료입고솔불저우95%적개솔종66.38%제승지95.83%。제20분종후입고솔부증가1.36%,재차설치수차질량공제적강제계동점,가보증국부이상연시적자료복무시효。동태계동책략사 ARQCS 적계동차수유5차강위2차,평균매일절약 CPU 시간391 min。
AWS Observation Data Real-time Quality Control System (ARQCS)is an operational real-time mete-orological data application system under IBM P570 high performance computing (HPC)Oracle 11g data-base platform.Functions including data decoding,database inserting,quality control (QC),storage man-agement and share service are provided for more than 30000 AWS all over China.In 2009,when ARQCS is firstly built,QC methods including boundary value check,internal consistency check,time consistency check and spatial consistency check is applied to only 1 element of hourly precipitation.And the starting strategy is a static one,which start ARQCS at the 15th,25th,35th,45th and 55th minute every hour. Later in 2010,QC methods of other important meteorological elements including air temperature,air pres-sure,humidity,wind direction and speed get to be applied in ARQCS.Meanwhile,the system computing logic is made more complex after 2 times of updating in 2011 and 2012.Now,it is planned to extend AR-QCS to 158 elements in 11 classes totally,which need more calculating resources accordingly.To guaran-tee QC capability and service timeliness of ARQCS in a high level under limited computing resources,a se-ries of schemes are designed and investigated.System log under IBM P570 HPC Oracle database environ-ment from 1st April to 30th Sep in 2012 is used to analyze ARQCS performance.It is found that the data-base entry rate (ER)of AWS data exhibits a trapezoid shaped distribution,and variance of ER is large from the 5th to the 20th minute in one hour,which means accumulated ER at the 15th minute is unstable and a low accumulated ER may be got if ARQCS starts at this time.It also indicates that an accumulated ER of 95% is very possible (84.89%)to get before the 20th minute,and accumulated ER is increased by only 1.36% after the 20th minute in average.So a new dynamic starting strategy is employed,that AR-QCS starts for the first time when accumulated ER gets more than 95% or until the 20th minute,and starts for the second time at the 55th minute.With this approach,the possibility for accumulated ER over 95% at the 1st QC starting is increased by 29% (from 66.38% to 95.83%).And the average 1st QC starting time is 20.6 seconds before the 15th minute in original static starting strategy.Also,less number of starts from 5 to 2 decrease the CPU time cost from 26.5 minutes to 10.2 minutes per hour,which means saving 391 minutes CPU time per day.It is concluded that the dynamic starting strategy is effective for ARQCS starting adaptively and ensures system robustness.