Bolder Technology, Inc. Paper:
"Knowing Sooner Rather Than Later: Cost Analysis of Low-Latency Data in Enterprise Data Warehousing"

About this paper: This February 2007 white paper explores the cost factors of acquiring low-latency data from transaction systems into the enterprise data warehouse. Low latency here is defined as data that is less than one day in age. It explores five typical architectures for data acquisitions and estimates the cost factors for each. Although subjective estimates were used in this study, they are based on first-hand experiences with several large systems in production today.

The paper is authored by Dr. Richard Hackathorn, president and founder of Bolder Technology Inc., and Jack Garzella, President of JMG Software Engineering. Dr. Hackathorn has over 30 years of experience in the IT industry with a focus in Business Intelligence and Data Warehouse expertise. Mr. Garzella has experience in overseeing 35 data warehouse projects, including recently at Overstock.com and as professional services leader at Teradata. To help support the findings of this paper, GoldenGate Software provided Bolder Technology with access to its customers who have implemented lower-latency data (including real-time) for enterprise data warehousing.

Table of contents:

• Exeuctive Summary
• Managing Your Business in a Global Economy, and The Time-Value Curve
• Architectures for Data Acquisition
  • Case A: Daily Batch Updates
  • Case B: Intra-Day Batch Updates
  • Case C: Continuous Batch Updates
  • Case D: Continuous Stream Updates with Extra-Database Transform
  • Case E: Continuous Stream Updates with Intra-Database Transform
• Cost Assumptions
  • Sizing of Data Warehouse
  • Platform for Transaction Systems
  • Platform for Database Warehouse
  • Platforms for Development and Disaster Recovery
• Cost Estimations: Cases A-E, and Summary of Costs
• Conclusions
• Appendix A: Cost Estimation Table
• Endnotes

(18 pages)

Download the PDF