A Metadata Management Model in Data Middle-Office

Xicheng Yang, Yong Liu, Yifan Zhang

Data middle-office. Data lake. Data Warehouse. Metadata.

The Data warehouse has been a popular business intelligence storage system for enterprises since its appearance. However, with the development of big data and the Internet of Things (IOT), the need to support the diversity and dynamics of data has become more urgent, so data lakes and data middle-office have been born, especially the data middle office was the most popular concept in China in the past two or three years. All companies are building their own data middle office. To store and analyze data with flexibility and high performance, metadata management is essential for the data middle office. In this article, we have compared and studied the data center architecture, proposed a conceptually rich metadata management model, and verified it through an open-source metadata management system.