Blogs

Getting started with SAP HANA SDI in less than a day

26 oktober 2018

(The Twitter case) Part 1

I was recently asked by a client’s marketing department to figure out how to bring Twitter data to their reporting environment. They are currently using a BW-on-HANA, so I immediately thought of HANA Smart Data Integration (SDI) as a possible candidate. In this blog I’ll cover the basics for the setup and show you that it’s actually quite easy to get up-and-running with SDI. In fact: I was pulling data from Twitter less than 3 hours after starting this SDI adventure 😊.

 

This is part 1 of the series. Herein, we’ll cover the SDI Setup.

(Check out part 2 to see how you can create dataflows within SDI)

 

FYI: I’m going to assume that you have the necessary rights on your HANA box to perform all described steps. For more info on the needed privileges, check out section 2.1 of the official SAP HANA EIM Administration Guide.

 

SDI Architecture:

First, let’s take a look at the basic architecture behind SDI. There are 2 main parts:

  • The ‘Data Provisioning Server’, located in your HANA box
  • A ‘Data Provisioning Agent’, which you typically install on a separate machine

 

DP Server Setup:

The DP Server comes pre-installed with HANA, but you still need to ‘enable’ the service.

  • In the HANA Studio, double-click on the HANA system, go to ‘configuration’ and put the number of dpserver instances to ‘1’ (deamon.ini –> dpserver –> instances)

 

DP Agent Install:

 

FYI: The DP Agent is not always needed.

There are quite a lot of sources covered by

the DP Server already. Here’s the list from

our system:

 

For our Twitter example we do need the DP Agent, so let’s look at the installation & setup:

FYI: For testing purposes it’s perfectly fine to install the agent on your own laptop. As long as you leave your laptop on and connected to the same network as your HANA box, it will work. Later on, when you want to use SDI productively, you’ll have to setup a dedicated machine for the agent.

 

You can get the agent from the SAP Software Center at https://launchpad.support.sap.com/#/softwarecenter

  • Search for ‘DP Agent’
  • Choose the latest available SP/Patch for your HANA platform (2.0 in my case).
  • I’ll go for the Windows version here, as it’s easy for anyone to install

  • Make sure you also download the SAPCAR utility (search for ‘SAPCAR’)

  • To extract the .SAR archive, open a command prompt or PowerShell window and run the SAPCAR executable with option -xvf

  • In the extracted folder, run ‘exe’.
  • For most parts you can just do the usual “Next, Next, Finish” 😊. On the 2nd step you’ll have to give some info though:
    • Your agent will run as a service inside Windows. You have to give this service a name.
    • The service needs an existing Windows user. If your testing on your own machine and want to use you own user, just open a command prompt and type ‘whoami’ to find out your domain and user.

DP Agent Configuration:

  • Open the configuration tool from the desktop shortcut
 

FYI: The 1st time you have to do it with Administrator privileges. Later on, you only need to open it as admin when you want to stop/start the service

The configuration exists of 3 steps:

  1. Connect to HANA
  2. Register your agent with HANA (check your IP with command ‘ipconfig’ in cmd)
  3. Register one or more Adapters with HANA

 

1           2   

3  

That’s it! You’re completely done with the SDI setup. 😊

Check out part 2 to see how you can create dataflows within SDI…

  • Blogs

    so.. SAP Lumira is dead.. now What ?

    As a consultant I’m responsible for the Analytics environment for an Innovative Company in Natural Chemistry and innovative in their IT. Recently I was forced to ponder on the post-Lumira question “ Now what ? ”.

     

    Read more >
  • Blogs

    Fetching XML API data

    Fetching XML API data

    I recently finished a project for which I had to fetch public data of parking lots and load it to a multiprovider to use it in reporting.  The data that I needed to fetch was from an open data API. After successfully finishing this project I thought I would share how I did this as an easy guide for others.

    Read more >
  • Blogs

    Take on the fight with Python

    Take on the fight with Python

    Introduction

    If there is one thing common in everyone’s career than it is that at some point everyone said: “Can’t this be automated or made simple?”. On a given moment at my customer I was asked to do a data-compare of two data providers with over 50 characteristics each and containing millions of records in SAP HANA. At first I started to run queries against the SAP HANA-tables to check the data but soon enough I thought…

    Read more >