Partial Reload of Incrementally Updated Tables in Analytic Database Accelerators

Abstract

The IBM Db2 Analytics Accelerator (IDAA) is a state-of-the art hybrid database system that seamlessly extends the strong transactional capabilities of Db2 for z/OS (Db2z) with very fast column-store processing in Db2 Database for Linux, Unix, and Windows. IDAA maintains a copy of the data from Db2z in its backend database. The data can be synchronized in batch with a granularity of table partitions, or incrementally using replication technology for individual rows. In this paper we present the enablement of combining the batch loading of a true subset of a table’s partitions for replicated tables. The primary goal for such an integration is to ensure data consistency. A specific challenge is that no duplicated rows stemming from the two data transfer paths come into existence. We present a robust and yet simple approach that is based on IDAA’s implementation of multi-version concurrency control.