BODS – ETL Framework [Part II] Note: this is the second part of the blog. Missed the first part? Read it here. For the extraction of data, a where clause needs to be defined. With the current logic this will be a combination of global variables ($G_Load_Mode, $G_Extraction_From_DT, $G_Extraction_To_DT, $G_Delta_Days). $G_Load_Mode: INIT/DELTA (All or subset of […]
Month: July 2020
BODS – ETL Framework [Part I]
BODS – ETL Framework [Part I] Requirements Each execution step in a job should be logged in a logging table Provide a delta and init mechanism ‣ Extraction from and to date need to be calculated automatically (moving window) ‣ Assign own extraction from and to date ‣ Use sysdate and subtract […]
Consider your pods (Azure)
Consider your pods (Azure) Recently, we ran in some issues when doing training with several trainees on our SAP Datahub environment that is running on a Kubernetes cluster deployed on Azure. If you do a default deployment of Kubernetes with advanced networking, you end up with a pod limit of 30 pods per node. This […]
