Calendars to Chronicles: 6

Data Warehouses are Chronicles

Business enterprises have a major challenge: making efficient and effective decisions all the time. This challenge can only be solved by knowing what the current situation in the organization is and what happened in the past in their organization. Top managers have difficulty understanding their own organization because of the size, but more importantly because the data related to the operation of the enterprise is kept in many different silos. Business enterprises were earliest to adopt computers for data management applications. No surprise that these enterprises were also one of the earliest to explore application of storing data for various applications not only as databases but also to collect data for different applications and then using this data to understand detailed operations and build decision support systems on top of that.

In 1980s the notion of data warehouses started becoming popular. A data warehouse is an integrated and time-varying collection of data acquired from different operational data sources and is primarily used in important decision making of the enterprise. A data warehouse represents the data from disparate sources in a unified schema and provides tools to ask aggregate queries as well as provide powerful analytical tools and visualization of data in flexible formats. Data, which normally lived in different silos of an organization, is imported and integrated to represent it in a unified format thus allowing access to all organizations data. By providing useful analytical and organizational tools on this data, decision makers can gain insights essential to make important decisions. Data warehousing made ETL (Extract, Transform, and Load) paradigm very popular to import data from different operations related databases into the unified schema. Similarly, OLAP (OnLine Analytical Processing) and visualization of a segment of data in appropriate form to help in understanding data related to particular entities during a particular period received significant attention.

As data warehousing tools started appearing, new fields of Business Intelligence and Business Activity Monitoring evolved and became popular in 1990s. Business Intelligence used data warehouse technology and built powerful analytical tools on top of it to provide tools to understand common business situations related to the operation of the whole enterprise. Business Activity Monitoring unified data from different silos to provide holistic real time dashboard for common events in the enterprise. Both these technologies built on pulling data from disparate silos and unifying all this data around entities or events and then building appropriate analytical and visualization tools. These systems helped improve enterprise resource management, supply chain management, as well as customer relationship management .

By realizing importance of storing data related to different operations and then utilizing this data to understand, or model, functioning of the overall enterprise, enterprise warehousing technologies contributed to bringing in efficiency as well as efficacy in different companies. Data warehousing became a powerful infrastructure used by many enterprises.

The rapid success of enterprise warehousing could be attributed to already popular databases used by every enterprise in their different operations. All these databases commonly used structured data to collect and store all information related to the operations. Since this data is ever increasing, because with time more data is being collected, the challenge is to identify trends and models in operations, particularly correlating these for events taking place in different parts of the organization and hence in different databases. Data warehouses took the first step in unifying the logs of information from different parts and providing access to them at the knowledge level. In a sense data warehouses were an effort to provide data, information, and knowledge available in the same framework and to understand and relate them to gain understanding for making good decisions.

Leave a Reply