Incremental data processing of tranasaction details of orders of an e-commerce webiste. 1.Transactions are fetched using confluent kafka, processed and stored in postgres. 2.As a first step, data from kafka consumer is put into raw_transactions table as it is. 3.Then the data from raw_transactions table is fetched at put into dimesions and fact tables.

The high level architecture looks like:

The star-schema of this model in postgres: