database-plugins

In order to run integration tests for these plugins you should have running database instance. It may be running on host machine or in docker container. Tests create tables and sample data, so user configured via system property should have corresponding permissions. To run integration tests execute following command in shell:

mvn clean test \ 
-DauroraMysql.clusterEndpoint=cdap-cluster.xyz.eu-central-1.rds.amazonaws.com -DauroraMysql.port=3306 \
-DauroraMysql.database=cdapdb -DauroraMysql.username=cdap -DauroraMysql.password=cdap \
-DauroraPostgresql.clusterEndpoint=pginstance.cxywmbgwp60k.eu-central-1.rds.amazonaws.com -DauroraPostgresql.port=5432 \
-DauroraPostgresql.database=cdappg -DauroraPostgresql.username=cdap -DauroraPostgresql.password=cdap \
-DjdbcDriversJars="/jdbc/drivers/jars/some.jar, "

Notice that you must change properties for Aurora MySQL and Aurora Postgresql to real before running tests.

Setup Local Environment

MySQL, Postgresql, MSSQL, DB2, MemSQL, SAP HANA are using prebuild images.

Oracle DB image should be build separately.

MemSQL image should be configure after start.

Note that you should login into docker account to pull SAP HANA image. Account can be created here Also, please note SAP HANA is sensitive to some CPU instructions. CPU model "host-passthrough" or similar can be required if running inside VM. SAP HANA requires that password for DB is provided through url. Convenience script docker-compose/db-plugins-env/saphana-password-server.sh provided for this purpose.

Netezza and Teradata require VMware Player for running emulator.

• Install Docker Compose
• Build local docker images
  • Build Oracle DB docker image version 12.1.0.2-ee
• Enter the folder with docker-compose file:

cd docker-compose/db-plugins-env/

• Export your license key for MemSQL to environment variable:

export MEMSQL_LICENSE_KEY=YOUR_LICENSE_KEY

• Initialize Memsql container:

docker-compose up memsql

• Start SAP HANA password service

bash saphana-password-server.sh &

• Start docker environment by running commands:

cd docker-compose/db-plugins-env/
docker-compose up -d

• Connect to MemSQL Studio at http://localhost:8888 The default Username is root and Password should be left blank.
• Create mydb database in MemSQL Studio

create database mydb

• Set password for root user in MemSQL Studio

grant all on *.* to 'root'@'%' identified by 'root' with grant option;

• Install and start Netezza emulator

• Create database mydb in Netezza emulator

• Install and start Teradata Express

• Create database mydb in Teradata Express

• Create user test with password test in Teradata Express

Properties

MySQL

• mysql.host - Server host. Default: localhost.
• mysql.port - Server port. Default: 3306.
• mysql.database - Server namespace for test databases. Default: mydb.
• mysql.username - Server username. Default: root.
• mysql.password - Server password. Default: 123Qwe123.

Postgresql

• postgresql.host - Server host. Default: localhost.
• postgresql.port - Server port. Default: 5432.
• postgresql.database - Server namespace for test databases. Default: mydb.
• postgresql.username - Server username. Default: postgres.
• postgresql.password - Server password. Default: 123Qwe123.

MSSQL

• mssql.host - Server host. Default: localhost.
• mssql.port - Server port. Default: 1433.
• mssql.database - Server namespace for test databases. Default: tempdb.
• mssql.username - Server username. Default: sa.
• mssql.password - Server password. Default: 123Qwe123.

DB2

• db2.host - Server host. Default: localhost.
• db2.port - Server port. Default: 50000.
• db2.database - Server namespace for test databases. Default: mydb.
• db2.username - Server username. Default: db2inst1.
• db2.password - Server password. Default: 123Qwe123.

Oracle

• oracle.host - Server host. Default: localhost.
• oracle.port - Server port. Default: 1521.
• oracle.username - Server username. Default: SYSTEM.
• oracle.password - Server password. Default: 123Qwe123.
• oracle.database - Server sid/database. Default: cdap.
• oracle.connectionType - Server connection type (service/sid) Default: sid.

Netezza

• netezza.host - Server host. Default: localhost.
• netezza.port - Server port. Default: 5480.
• netezza.database - Server namespace for test databases. Default: mydb.
• netezza.username - Server username. Default: admin.
• netezza.password - Server password. Default: password.

MemSQL

• memsql.host - Server host. Default: localhost.
• memsql.port - Server port. Default: 3308.
• memsql.database - Server namespace for test databases. Default: mydb.
• memsql.username - Server username. Default: root.
• memsql.password - Server password. Default: root.

Teradata

• teradata.host - Server host. Default: localhost.
• teradata.port - Server port. Default: 1025.
• teradata.database - Server namespace for test databases. Default: mydb.
• teradata.username - Server username. Default: test.
• teradata.password - Server password. Default: test.

Aurora MySQL

• auroraMysql.clusterEndpoint - Cluster endpoint.
• auroraMysql.port - Server port.
• auroraMysql.database - Server namespace for test databases.
• auroraMysql.username - Server username.
• auroraMysql.password - Server password.

Aurora Postgresql

• auroraPostgresql.clusterEndpoint - Cluster endpoint.
• auroraPostgresql.port - Server port.
• auroraPostgresql.database - Server namespace for test databases. Default: mydb.
• auroraPostgresql.username - Server username.
• auroraPostgresql.password - Server password.