Data Warehouse Migration to Amazon Redshift

Typical challenges that we see

Data Warehouse Migration to AWS is a daunting task with a lot of hidden issues and possible problems. With our extensive experience, we can overcome all of the challenges migration projects have to offer.

Mapping the table index strategy of the source data warehouse to Amazon Redshift

Amazon Redshift does not use indexes for optimizing query performance

Amazon Redshift is different from other data warehouse solutions in that there is no CREATE INDEX command. Instead, Redshift uses features like Sort and Distribution Keys to optimize query performance.

We use the features in Amazon’s Database Migration Service with the Schema Conversion Tool (SCT) to optimize the Sort and Distribution Keys. SCT uses the table statistics to come up with different options to choose from. In most cases, you can pick the recommendation suggested by the SCT tool.

If you do happen to make a mistake a query performance becomes an issue, SCT uses the table statistics to suggest updates and recreates the table to take advantage of the new setting.

How can I migrate terabytes of data to the Amazon cloud?

Imagine you have an 80 TB database that needs to be extracted and imported into AWS Redshift or Aurora database. Normally, it would take up to several weeks for extracting and migrating such databases over the internet. DB Best has worked with Amazon in exposing a Snowball Edge configuration option in the Schema Conversion Tool. With this feature, you can hookup a Snowball Edge device to your on-premises database, extract data and upload data to the Snowball Edge and send it back to Amazon for completing the data import process during your data warehouse migration to AWS.

DB Best Architects are trained to help you configure and extract your data to the Snowball Edge, helping you complete the data transfer much faster.

Getting Started

At DB Best, we have a set of entry-level offers to help you understand your modernization landscape and demonstrate the value of moving your Netezza, Teradata, Vertica or Greenplum data warehouses to Amazon Redshift.

We can help you chose the best option for data warehouse migration to AWS, modifying the architecture of your entire system to add the latest business intelligence and advanced analytics solutions.

AWS Database Migration Service Support

Trust the experts with the best knowledge of AWS DMS and the Schema Conversion Tool (SCT) to help move your on-premises databases to AWS RDS, Amazon Aurora, and Amazon Redshift.

Future-State Architectural Design

Everyone is talking about the need for a digital transformation, but how do you get there? See how our future-state architecture design can use cutting edge technology to meet your organization’s needs.

Amazon Redshift Performance Tuning

Discover best practices to take advantage of Amazon Redshift's columnar technology and parallel processing capabilities, improving data warehouse performance.

Do you like what you see? Please contact us today to see how we can get started!

General Approach to Migration of Data Warehouses to Amazon Redshift

The following video provides an overview on how to migrate your Oracle, Teradata, Greenplum and Netezza data warehouses to Amazon Redshift using the AWS Schema Conversion Tool. The video also covers how AWS SCT provides guidance on creating the appropriate sort and distribution keys for you based on query statistics and runtime query statistics from the source database.

Data Integration Support

Like most organizations running with an existing enterprise data warehouse solution, you have a substantial investment in data integration software for extract-transform-load (ETL) processes.

We have you covered when it comes time to migrate these packages to Redshift. Here is an example of the key data integration platforms.

AWS Glue

See how we can orchestrate the transformation of your data, leveraging the simple, flexible, and cost-effective AWS Glue ETL service.

Amazon Data Pipeline

Configuring Amazon Data Pipeline web service, you can process the data that was locked up in on-premises storages and then efficiently transfer the results to different AWS services.

Oracle Golden Gate

Check out our Oracle Golden Gate technology solutions to facilitate real-time data integration, replication, transformations, and verification in heterogeneous IT environments.

Informatica

Using Informatica solutions we can integrate your data from existing on-premises systems to the cloud, big data, and IoT systems smoothly and cost-effectively. Our solution architects will migrate the data accelerating time to value for your business goals.

IBM DataStage

Learn how we can integrate your data from existing on-premises systems to the cloud, big data, and IoT systems leveraging IBM Datastage solutions. With our experience, you can to migrate your data really quickly.

Talend

We offer a fast and cost-effective way to connect. Clean and share cloud and on-premises data using the architecture that easily scales to respond to growing business requests.

Attunity

Discover how we can help you use Attunity solutions to integrate your data from existing on-premises systems to the cloud, big data, and IoT systems within a short period of time. DB Best can flawlessly replicate your data between different types of databases and handle any data changes.

SQL Server Integration Services

Put our Microsoft SQL Server Integration Services experience to use for seamless data extraction, transformation, and loading operations of any complexity.

Supporting your AWS data warehouse solutions after the migration

Please check out the sample of our services to support your AWS data warehouse solutions after the migration.

Operational Data Management

Are your DBA's stretched thin? Offload your IT needs to a dedicated team with industry-proven processes and world-leading tools and products.

DevOps

Our DevOps services introduce cultural changes, best practices, and new technologies to improve collaboration between business, development, and operations to create an agile application development lifecycle.

Application Modernization

Looking for a reliable partner who knows both application development and data platform migration? We have the people, process, and products to help you move to the cloud or migrate to new platforms.

AWS Business Intelligence Solutions

Take advantage of AWS Business Intelligence capabilities and extend your data analytics to the cloud. See how DB Best can build BI solutions for manufacturing, retail, healthcare, financial services, government, and more.

Database Consulting

Check out the database consulting services we have used to help customers like you get the most out of their database platform.

New Solutions

We'll take your initial app concept and turn it into a beautiful and functional web, mobile, desktop, or Internet of Things solution. Covering the full cycle of software development with optional 24/7 monitoring and support with our new solution services.

Learn more

We have a great set of blog posts and data sheets to help you better understand our capabilities as the leader in database migration services and showcase our expertise in moving Netezza, Teradata, Vertica or Greenplum data warehouses to Amazon Redshift.

Blog posts

Using AWS Snowball Edge to transfer multiple terabytes of data into the Amazon cloud

10 January 2018 admin

One of the main concerns during large-scale database migrations to the cloud is how long will the data transfer last. When you need to move multiple terabytes of data, the migration pr...

Loading Amazon Redshift Data Utilizing AWS Glue ETL service

27 December 2017 Bill Ramos

Your CIO made a strategic decision to move to AWS and you are wondering how to move your Enterprise Data Warehouse (EDW) on Teradata: should you opt for using Teradata Software Tiers ...

AWS Schema Conversion Tool: General Approach to Migration of Data Warehouses to Amazon Redshift

6 December 2016 Bill Ramos

This post continues our video blog series on the AWS Schema Conversion Tool (SCT). In our previous blog posts, we talked about using AWS SCT for transactional database migration projec...

AWS Schema Conversion Tool: Specific Features of Migrating Data Warehouses to Redshift

14 December 2016 Bill Ramos

This continues our video blog series on the AWS Schema Conversion Tool (SCT). In the previous blog post we’ve talked about the general approach of data warehouses migration to Amazon...

Extracting Data from Warehouses with Data Migration Agents in AWS Schema Conversion Tool

15 March 2017 Bill Ramos

Migrating data warehouses to Amazon Redshift represents a serious challenges when you consider what it takes to transfer huge amounts of data in parallel. On February 16, 2017, Amazon ...

Optimizing your Redshift Storage with AWS Schema Conversion Tool

2 March 2017 Bill Ramos

Amazon introduced the new feature called Redshift Optimization for the Schema Conversion Tool (SCT) November 17, 2016 release. You can now use AWS SCT to optimize your Amazon Redshift ...

Database Compare Suite 4.5 Released — Amazon Redshift and SQL Server 2000 support

12 October 2016 Bill Ramos

We are proud to announce the latest version of the Database Compare Suite tool, which now adds support for Amazon Redshift and SQL Server 2000. For customers looking to upgrade their S...

Database Compare Suite update 4.11 with Vertica Analytics Platform support

4 September 2017 Andrey Ivanov

We’re happy to announce the latest release of DB Best Database Compare Suite. The new version marked 4.11 brings support for Vertica Analytics Platform. Learn more about the ultimate...

Using Amazon Redshift performance tuning tips to reduce query times by 800%

14 December 2017 Bill Ramos

Often database administrators experience decreases in query performance with Amazon Redshift as the size of data increases. The problem becomes even more significant when we start talk...

Reference data sheet

Amazon Web Services Migration

17 November 2016 Andrey Ivanov

DB Best Technologies is internationally known for comprehensive Data Management Services, database development and migration, and the creation of highly successful web and mobile syste...

Data Management for Amazon Web Services

8 November 2016 Andrey Ivanov

DB Best Technologies is internationally known for comprehensive Data Management Services, database development and migration, and the creation of highly successful web and mobile syste...

Request a quote