SQLines Data - Database Migration and ETL

SQLines Data is a high performance data transfer, schema conversion and migration validation tool that supports major enterprise databases:

  • Oracle
  • Microsoft SQL Server
  • MySQL
  • MariaDB
  • PostgreSQL
  • IBM DB2 LUW, iSeries (AS/400) and zSeries (S/390)
  • Sybase Adaptive Server Enterprise, Sybase SQL Anywhere, Sybase IQ and Sybase Advantage
  • Informix

SQLines Data is written in C/C++ and uses native low-level in-memory bulk loader APIs to transfer data. It is available for Linux, Windows, both 64-bit and 32-bit platforms.

Database Migration

You can use SQLines Data for cross-platform database migration. The tool migrates table definitions, constraints, indexes and transfers data.

Migration Features:

  • Options to create schema, transfer data, create constraints and indexes to set up flexible migration process
  • UI and command line interface

ETL

You can use SQLines Data in your ETL processes as a data extract-load tool.

ETL Features:

  • Parallel high performance data transfer to target databases
  • Parallel high performance export to flat files
  • Choosing columns to transfer
  • Defining SELECT expressions including computed columns
  • Defining WHERE conditions for tables for incremental transfer
  • Defining SQL SELECT queries to transfer data
  • Command line interface

How To

How to Map Database Schemas

Often you need to change the database schemas during the migration, see -smap option how to do this.

How to Map Table Names

Often you also need to change the table names during the migration, you can use it modifying sqlines_tmap.txt supplied with the tool.

Every line of this file contains a single table name mapping:

source_name, target_name
source_name2, target_name2

Use fully qualified table name to specify source tables, and for Oracle, IBM DB2 it should be in the upper case.

How to Transfer Tables without Constraints and Indexes

Sometime you do not need to move constraints and indexes into the target database. For example, in case when you move data for reporting purpose, or if you want to migrate constraints and indexes later.

Edit sqldata.cfg configuration file, and set -constraints=no and -indexes=no.

How to Specify Filters (WHERE Conditions) on Tables

Edit sqlines_twhere.txt file and specify individual filter for any source table. If a filter is not specified for the table all its data are transferred.

How to Transform Column Data

Edit sqlines_tsel.txt file and specify column expressions (using SQL dialect of the source database), add/remove columns, define computed columns and so on.

If you have any questions, please contact us.