《電子技術(shù)應(yīng)用》
您所在的位置:首頁(yè) > 模擬設(shè)計(jì) > 設(shè)計(jì)應(yīng)用 > 分布式元數(shù)據(jù)系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)
分布式元數(shù)據(jù)系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)
電子技術(shù)應(yīng)用
郭志超1,張叢旭1,劉曉鵬1,劉瑞2,焦冬冬1
(1.華北計(jì)算機(jī)系統(tǒng)工程研究所,北京 100083;2.中國(guó)人民解放軍航天工程大學(xué)士官學(xué)校,北京 102299)
摘要: 隨著企業(yè)業(yè)務(wù)發(fā)展以及業(yè)務(wù)數(shù)據(jù)的不斷積累,數(shù)據(jù)類型參差不齊,海量數(shù)據(jù)越來(lái)越難以處理。元數(shù)據(jù)系統(tǒng)作為提升數(shù)據(jù)質(zhì)量和數(shù)據(jù)分析的平臺(tái)應(yīng)運(yùn)而生。元數(shù)據(jù)現(xiàn)已成為數(shù)據(jù)倉(cāng)庫(kù)以及商業(yè)智能的核心,各個(gè)廠商針對(duì)元數(shù)據(jù)系統(tǒng)提出了自己的解決方案。現(xiàn)有解決方案目前對(duì)業(yè)務(wù)數(shù)據(jù)的更新操作支持不足。針對(duì)當(dāng)前元數(shù)據(jù)系統(tǒng)面臨的隨著業(yè)務(wù)數(shù)據(jù)的增加,元數(shù)據(jù)系統(tǒng)快速擴(kuò)展支持不夠,造成數(shù)據(jù)無(wú)法及時(shí)處理,以及針對(duì)元數(shù)據(jù)修改無(wú)法同步更新到業(yè)務(wù)數(shù)據(jù)中,導(dǎo)致元數(shù)據(jù)和業(yè)務(wù)數(shù)據(jù)不同步的問題,提出一種分布式元數(shù)據(jù)解決方案,支持系統(tǒng)橫向擴(kuò)展,同時(shí)支持通過元數(shù)據(jù)操作,反向控制業(yè)務(wù)數(shù)據(jù)。通過元數(shù)據(jù)操作,支持業(yè)務(wù)生成。
中圖分類號(hào):TP311.5
文獻(xiàn)標(biāo)志碼:A
DOI: 10.16157/j.issn.0258-7998.223662
中文引用格式: 郭志超,張叢旭,劉曉鵬,等. 分布式元數(shù)據(jù)系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)[J]. 電子技術(shù)應(yīng)用,2023,49(6):84-88.
英文引用格式: Guo Zhichao,Zhang Congxu,Liu Xiaopeng,et al. Design and implementation of distributed metadata system[J]. Application of Electronic Technique,2023,49(6):84-88.
Design and implementation of distributed metadata system
Guo Zhichao1,Zhang Congxu1,Liu Xiaopeng1,Liu Rui2,Jiao Dongdong1
(1.National Computer System Engineering Research Institute of China, Beijing 100083, China; 2.PLA Aerospace Engineering University Non commissioned Officer School,Beijing 102299,China)
Abstract: With the development of enterprise business and the continuous accumulation of business data, data types are uneven, and massive data is becoming more and more difficult to handle. The metadata system emerged as a platform to improve data quality and data analysis. Metadata is now at the heart of data warehouses and business intelligence, and vendors have come up with their own solutions for metadata systems. Existing solutions currently do not support the operation of updating business data. In view of the increase in business data faced by the current metadata system, the lack of rapid expansion support, the inability to process data in time, and the problem that metadata modification cannot be synchronized and updated to business data, resulting in metadata and business data being out of synchronization, this paper provides a distributed metadata solution that supports horizontal expansion of the system and supports reverse control of business data through metadata operations. Support business generation through metadata operations.
Key words : metadata system;distributed system;multi data source access;application generation

0 引言

隨著當(dāng)今信息技術(shù)的飛速發(fā)展以及互聯(lián)網(wǎng)技術(shù)的迅速普及,計(jì)算機(jī)技術(shù)正深刻影響著人們的生活方式。隨著企業(yè)的業(yè)務(wù)擴(kuò)展以及業(yè)務(wù)歷史數(shù)據(jù)的不斷積累,業(yè)務(wù)數(shù)據(jù)種類越來(lái)越繁雜,數(shù)據(jù)量也越來(lái)越大。需求變化大,導(dǎo)致開發(fā)速度趕不上需求的變化速度,企業(yè)數(shù)據(jù)處理的挑戰(zhàn)越來(lái)越大。

元數(shù)據(jù)系統(tǒng)作為提升數(shù)據(jù)質(zhì)量和數(shù)據(jù)分析的平臺(tái)應(yīng)運(yùn)而生。當(dāng)前元數(shù)據(jù)系統(tǒng),主要針對(duì)特定的元數(shù)據(jù)進(jìn)行管理,對(duì)于通用元數(shù)據(jù)的接入表現(xiàn)一般。對(duì)于元數(shù)據(jù)的更新操作,很難同步更新業(yè)務(wù)數(shù)據(jù),導(dǎo)致元數(shù)據(jù)和業(yè)務(wù)數(shù)據(jù)不一致的問題,需要業(yè)務(wù)人員手動(dòng)修改業(yè)務(wù)數(shù)據(jù)適配修改后的元數(shù)據(jù)。此舉產(chǎn)生大量的工作量,容易產(chǎn)生業(yè)務(wù)人員的錯(cuò)誤修改導(dǎo)致業(yè)務(wù)數(shù)據(jù)與元數(shù)據(jù)不同步的問題。另一個(gè)問題是當(dāng)前元數(shù)據(jù)系統(tǒng)針對(duì)業(yè)務(wù)數(shù)據(jù)激增,導(dǎo)致系統(tǒng)資源不足,無(wú)法做到靈活擴(kuò)展,造成數(shù)據(jù)處理不及時(shí),甚至無(wú)法處理的問題。針對(duì)當(dāng)前元數(shù)據(jù)系統(tǒng)存在的不足,本文提出如下設(shè)計(jì)方案.




本文詳細(xì)內(nèi)容請(qǐng)下載:http://theprogrammingfactory.com/resource/share/2000005354




作者信息:

郭志超1,張叢旭1,劉曉鵬1,劉瑞2,焦冬冬1

(1.華北計(jì)算機(jī)系統(tǒng)工程研究所,北京 100083;2.中國(guó)人民解放軍航天工程大學(xué)士官學(xué)校,北京 102299)


微信圖片_20210517164139.jpg

此內(nèi)容為AET網(wǎng)站原創(chuàng),未經(jīng)授權(quán)禁止轉(zhuǎn)載。