數(shù)據(jù)倉庫及應用數(shù)據(jù)倉庫

1、數(shù)據(jù)倉庫數(shù)據(jù)倉庫杭誠方杭誠方 教授教授what is data warehouse data warehouse is a very large database that stores integrated data of one or more business subject areas data warehouse is built to support data analysis for decision making integrated customer data warehouse is a necessary step to the success of the busine

2、ss intelligence strategy data warehouses are also used for many other purposes such as product manufacturing data warehouses data warehouses become the focal point in the enterprise-wide it infrastructurewhat is data warehouse?what is data warehousewhat is data warehousea data warehouse is simply a

3、single, complete, and consistent store of data obtained from a variety of sources and made available to end users in a way they can understand and use in a business context. what is data warehousewhat is data warehousedata warehouse definitionsdata warehouse definitionsthe key elements in the defini

4、tions:subject-oriented: presentation as business subjects, not as computer files.integrated: a single source of information for and about the business.non-volatile: stable information that doesnt change each time an operational process is executed.time-variant: containing a history of the business,

5、as well as current business information.accessible: the primary purpose of a data warehouse is to provide readily accessible information to business people.subject-orientedsubject-orientedintegratedintegratedintegratedintegrated網(wǎng)管系統(tǒng)財務管理系統(tǒng)市場分析決策系統(tǒng)telcom dwsystem分析型大客戶crm系統(tǒng)信用度管理客服系統(tǒng)客服系統(tǒng)(call center 10

6、00/180/112/170）系統(tǒng)）系統(tǒng)其它電信專業(yè)網(wǎng)業(yè)務系統(tǒng)“九七工程九七工程”之營業(yè)管之營業(yè)管理生產調度系統(tǒng)理生產調度系統(tǒng)（配線（配線/配號配號/開通）開通）112故障查修故障查修系統(tǒng)資源管理系統(tǒng)系統(tǒng)資源管理系統(tǒng)170/催繳系統(tǒng)營催繳系統(tǒng)營業(yè)系統(tǒng)業(yè)系統(tǒng)本地公司/ic卡/磁卡管理系統(tǒng)網(wǎng)上營業(yè)系統(tǒng)商務管理層省級計費結算計費帳務系統(tǒng)中心業(yè)務管理層網(wǎng)絡及網(wǎng)元管理層電信網(wǎng)網(wǎng)元non-volatilenon-volatiletime varianttime variantaccessibleaccessibledata warehouse characteristicsdata warehouse c

7、haracteristicsdata warehouse separates functions from operational systems. propertyoperationaldata warehouseresponse timesub-second to secondsseconds to hoursdata operationdmlprimarily read onlynature of data30-60 dayssnapshots over timedata organizationapplicationsubject, timesizesmall to largelarg

8、e to very largedata sourcesoperational, internaloperational, internal, externalactivitiesprocessesanalysisdata warehouse characteristicsdata warehouse characteristicsdata warehouse serves as a central repository for recording everything about the business for information retrieval. data is loaded fr

9、om internal business operational system, and external systems. data warehouse characteristicsdata warehouse characteristicsa data warehouse has a fundamental effect on how the users see the data available about the organization, what to do with it and how to use it for decision making.data warehouse

10、 characteristicsdata warehouse characteristicsdata warehouse characteristicsdata warehouse characteristicsa data warehouse is not a single software or hardware product you purchase to strategic. it is a computing environment where users can find strategic information to make better decisions. it is

11、a user-centric environment.data warehouse characteristicsdata warehouse characteristicsdata warehouse is a blend of many different technologies needed for supporting the various functions of a data warehouse environment. these different technologies all work together in a data warehouse environment.

12、applicationadministrationstorage managementanalysisdata managementdata modelingdata acquisitiondata warehouseenterprise data warehouseenterprise data warehouseenterprise data warehouses are funded on a corporate basis. enterprise data warehouse covers the entire business (corporation), incorporating

13、 data from all operational systems. information is extracted from the operational environment, cleansed, and transformed into a central, integrated enterprise-wide data warehouse environment, so that all the departments and other internal organizations of the corporation can benefit from a consisten

14、t, integrated source of decision support information. data martdata martdata marts are often funded on a departmental basis. data mart is a collection of data tailored to the dss processing needs of a particular department. it is a subset of a enterprise data warehouse that has been customized to fi

15、t the needs of a department. data marts serve users at a specific level, or for a specific department. data warehouse versus data martdata warehouse versus data mart propertydata warehousedata martscopeenterprisedepartmentsubjectsmultiplesingle-subjectdata sourcemanyfewsize (typical) tb tbimplement

16、time months to yearsmonthsdata martdata martdata martdata martcontrol: a department can completely control the data and processing that occurs inside a data mart.cost: the cost of storage and processing is less, because the data marts machine is smaller than dwscustomization: the data marts data is

17、customized to suit the peculiar needs of the department.data martdata martdata martdata martdata martdata martdependent data mart: the source is the data warehouse. the extraction, transformation, and loading process is easy. the data mart is part of the enterprise plan.independent data mart: the so

18、urce are operational system external source. the extraction, transformation, and loading process is difficult. the data mart is built to satisfy analytical needs.operational data store (ods)operational data store (ods) integrate information from the production system. relieve the production systems

19、reporting and analysis demands. provide access to current data.odsodsodsodsods looks very much like a data warehouse, such as subject-oriented, and integration. however, the remaining characteristics of an ods are quite different from a data warehouse:volatile: an ods can be updated as a normal part

20、 of processing.current-values: an ods typically contains daily, weekly, or even monthly data, but the data ages very quickly.detailed data: an ods contains detailed data only.different classes of the odsdifferent classes of the odsclass i: a synchronous interface in which a very, very small amount o

21、f time lapses between an applications transaction and the reflection of the transaction in the ods.class ii: if an hour or two passes from the time a transaction is created and interacted in the application environment until that transaction is reflected in the ods.class iii: there may be a time lag

22、 between 12 hours and a day as transaction data is collected in the i&t interface.class iv: the data is fed into the ods directly from the data warehouse.determining the classdetermining the class speed of movement of data into the ods volume of data that must be moved volume of data that must be stored in intermediate location during i & t processing update of data and integrity of transaction processing the time of day the movement needs to occurdata architecture