Digital Symposium Collection 2000  



DynaMat: A Dynamic View Management System for Data Warehouses

Yannis Kotidis and Nick Roussopoulos

  View Paper (PDF)  

Return to Datacubes and Data Warehouses

Pre-computation and materialization of views with aggregate functions is a common technique in Data Warehouses. Due to the complex structure of the warehouse and the different profiles of the users who submit queries, there is need for tools that will automate the selection and management of the materialized data. In this paper we present DynaMat, a system that dynamically materializes information at multiple levels of granularity in order to match the demand (workload) but also takes into account the maintenance restrictions for the warehouse, such as down time to update the views and space availability. DynaMat unifies the view selection and the view maintenance problems under a single framework using a novel “goodness” measure for the materialized views. DynaMat constantly monitors incoming queries and materializes the best set of views subject to the space constraints. During updates, DynaMat reconciles the current materialized view selection and refreshes the most beneficial subset of it within a given maintenance window. We compare DynaMat against a system that is given all queries in advance and the pre-computed optimal static view selection. The comparison is made based on a new metric, the Detailed Cost Savings Ratio introduced for quantifying the benefits of view materialization against incoming queries. These experiments show that DynaMat’s dynamic view selection outperforms the optimal static view selection and thus, any sub-optimal static algorithm that has appeared in the literature.


Note: References link to DBLP on the Web.

Sameet Agarwal , Rakesh Agrawal , Prasad Deshpande , Ashish Gupta , Jeffrey F. Naughton , Raghu Ramakrishnan , Sunita Sarawagi : On the Computation of Multidimensional Aggregates. VLDB 1996 : 506-521
Randall G. Bello , Karl Dias , Alan Downing , James Feenan Jr. , William D. Norcott , Harry Sun , Andrew Witkowski , Mohamed Ziauddin : Materialized Views in Oracle. VLDB 1998 : 659-664
Elena Baralis , Stefano Paraboschi , Ernest Teniente : Materialized Views Selection in a Multidimensional Database. VLDB 1997 : 156-165
Chungmin Melvin Chen , Nick Roussopoulos : The Implementation and Performance Evaluation of the ADMS Query Optimizer: Integrating Query Result Caching and Matching. EDBT 1994 : 323-336
Lyman Do , Pamela Drew , Wei Jin , Vish Jumani , David Van Rossum : Issues in Developing Very Large Data Warehouses. VLDB 1998 : 633-636
Shaul Dar , Michael J. Franklin , Björn Þór Jónsson , Divesh Srivastava , Michael Tan : Semantic Data Caching and Replacement. VLDB 1996 : 330-341
Alex Delis , Nick Roussopoulos : Performance and Scalability of Client-Server Database Architectures. VLDB 1992 : 610-623
Prasad Deshpande , Karthikeyan Ramasamy , Amit Shukla , Jeffrey F. Naughton : Caching Multidimensional Queries Using Chunks. SIGMOD Conference 1998 : 259-270
Jim Gray , Adam Bosworth , Andrew Layman , Hamid Pirahesh : Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Total. ICDE 1996 : 152-159
Himanshu Gupta , Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Index Selection for OLAP. ICDE 1997 : 208-219
Timothy Griffin , Leonid Libkin : Incremental Maintenance of Views with Duplicates. SIGMOD Conference 1995 : 328-339
Ashish Gupta , Inderpal Singh Mumick , V. S. Subrahmanian : Maintaining Views Incrementally. SIGMOD Conference 1993 : 157-166
Himanshu Gupta : Selection of Views to Materialize in a Data Warehouse. ICDT 1997 : 98-112
Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Implementing Data Cubes Efficiently. SIGMOD Conf. 1996 : 205-216
H. V. Jagadish , Inderpal Singh Mumick , Abraham Silberschatz : View Maintenance Issues for the Chronicle Data Model. PODS 1995 : 113-124
Arthur M. Keller , Julie Basu : A Predicate-based Caching Scheme for Client-Server Database Architectures. VLDB Journal 5(1) : 35-47(1996)
Ralph Kimball : The Data Warehouse Toolkit: Practical Techniques for Building Dimensional Data Warehouses. John Wiley 1996, ISBN 0-471-15337-0
Yannis Kotidis , Nick Roussopoulos : An Alternative Storage Organization for ROLAP Aggregate Views Based on Cubetrees. SIGMOD Conference 1998 : 249-258
Inderpal Singh Mumick , Dallan Quass , Barinderpal Singh Mumick : Maintenance of Data Cubes and Summary Tables in a Warehouse. SIGMOD Conference 1997 : 100-111
Nick Roussopoulos , Hyunchul Kang : Preliminary Design of ADMS±: A Workstation-Mainframe Integrated Architecture for Database Management Systems. VLDB 1986 : 355-364
Nick Roussopoulos , Yannis Kotidis , Mema Roussopoulos : Cubetree: Organization of and Bulk Updates on the Data Cube. SIGMOD Conference 1997 : 89-99
Nick Roussopoulos , Daniel Leifker : Direct Spatial Search on Pictorial Databases Using Packed R-Trees. SIGMOD Conference 1985 : 17-31
Nick Roussopoulos : An Incremental Access Method for ViewCache: Concept, Algorithms, and Cost Analysis. TODS 16(3) : 535-563(1991)
Amit Shukla , Prasad Deshpande , Jeffrey F. Naughton : Materialized View Selection for Multidimensional Datasets. VLDB 1998 : 488-499
Sunita Sarawagi , Michael Stonebraker : Efficient Organization of Large Multidimensional Arrays. ICDE 1994 : 328-336
Peter Scheuermann , Junho Shim , Radek Vingralek : WATCHMAN : A Data Warehouse Intelligent Cache Manager. VLDB 1996 : 51-62
Dimitri Theodoratos , Timos K. Sellis : Data Warehouse Configuration. VLDB 1997 : 126-135
Yihong Zhao , Prasad Deshpande , Jeffrey F. Naughton : An Array-Based Algorithm for Simultaneous Multidimensional Aggregates. SIGMOD Conference 1997 : 159-170


  author    = {Yannis Kotidis and
                Nick Roussopoulos},
   editor    = {Alex Delis and
                Christos Faloutsos and
                Shahram Ghandeharizadeh},
   title     = {DynaMat: A Dynamic View Management System for Data Warehouses},
   booktitle = {SIGMOD 1999, Proceedings ACM SIGMOD International Conference
                on Management of Data, June 1-3, 1999, Philadephia, Pennsylvania,
   publisher = {ACM Press},
   year      = {1999},
   isbn      = {1-58113-084-8},
   pages     = {371-382},
   crossref  = {DBLP:conf/sigmod/99},
   bibsource = {DBLP,} } },

Copyright(C) 2000 ACM