Our customer has been supporting Oracle based online transaction processing (OLTP) system. They decided to take advantage of the modern data analysis capabilities of SQL Server's data ...
Featured technologies
Check out the technologies that we support to help your team optimize moving data from your data center to Azure, between Azure services, and even between Azure and other cloud platforms.
Put our Microsoft SQL Server Integration Services experience to use for seamless data extraction, transformation, and loading operations of any complexity.
Perfectly orchestrate the transformation of your data and provide a wide range of analytical services with DB Best, powered by Azure Data Factory.
In the new world of cloud-based data, you might spend more time looking for data than analyzing it. Find out how DB Best can help your company get the most out of the Azure Data Catalog to make data asset discovery easy.
Discover how DB Best can help your business utilize Microsoft's no-limits data lake to store and analyze petabyte-size files and trillions of objects and power your intelligent applications.
Discover how DB Best can help your business implement Azure HDInsight, Microsoft's deployment of Hadoop on the Azure cloud.
See how DB Best can help you utilize Microsoft's on-demand real-time analytics service to power actionable intelligence.
Additional tools we've used with Azure
Data integration platforms now support moving data between your data center and Azure. Our team has worked with the following data integration solutions with Azure and have a deep understanding of how to build hybrid solutions to optimize performance.
Special getting started offers
As a SQL Server customer, SQL Server Integration Services (SSIS) is likely your default solution since it’s included with your SQL Server license. With the introduction of Azure Data Factory and Azure Stream Analytics, you are likely trying to figure out how all the pieces fit together.
As a Microsoft Gold Partner, we have access to Business Incentive Fund programs where Microsoft can co-invest with us to help you explore new ways of thinking about your data integration projects.
We recommend that you start with our Future-State Architectural Design Engagement to develop a roadmap for your solutions.
If you are looking to migrate from other database platforms like Oracle, DB2, Sybase, you can use our SQL Server Migration Assistant Support offer to work through any issues you might have with migrating data or converting your ETL packages to Microsoft based solutions.
Using SSIS to create standardized Excel reports
DB Best recently completed a complex development project for one of the largest banks in the Middle East. Faced with non-customizable and slow-to-generate reporting, the customer contacted DB Best to develop a new and improved solution.
In this case study video, you can see how we used SSIS in a non-traditional way to extract data from SQL Server Analysis Services and push the data into standardized Excel-based reports.
Open source data integration solutions for Azure
For organizations looking to use open-source data integration solutions, our team supports the following Apache solutions for performing data integration tasks and storage. We can also migrate solutions using the Apache technologies to Azure data integration tools like Azure Data Factory to take advantage of serverless computing, performance, security, and integration with other Azure solutions.
Data Stores
- Apache Hadoop is a distributed computing platform. This includes the Hadoop Distributed Filesystem (HDFS) and an implementation of MapReduce. Implemented on Azure as HDInsight.
- Apache HBase is an open-source, distributed, versioned, column-oriented store modeled after Google’s Bigtable. Azure SQL Data Warehouse supplies similar capabilities.
- Apache Hive is a data warehouse software facilitates querying and managing large datasets residing in distributed storage with tools to enable easy data extract/transform/load (ETL) to HDFS and other data stores like HBase. Implemented as U-SQL on Azure.
- Apache CouchDB is a database that completely embraces the web that stores your data with JSON documents. Implemented on Azure as Cosmos DB.
- Apache Spark is a fast and general engine for large-scale data processing. It offers high-level APIs in Java, Scala, and Python as well as a rich set of libraries including stream processing, machine learning, and graph analytics.
- Apache Cassandra database provides scalability and high availability with linear scalability and fault-tolerance on commodity hardware or cloud infrastructure.
Complex Event Processing
- Apache Storm is a distributed real-time computation system. Similar to how Hadoop provides a set of general primitives for doing batch processing, Storm provides a set of general primitives for doing real-time computations. Implemented as Azure Stream Analytics.
- Apache Beam is a unified programming model for both batch and streaming data processing, enabling efficient execution across diverse distributed execution engines and providing extensibility points for connecting to different technologies and user communities.
General Data Processing
- Apache Sqoop is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases. AWS Glue provides this capability.
- Apache Flume is a distributed, reliable, and available system for efficiently collecting, aggregating and moving large amounts of log data from many different sources to a centralized data store.
- Apache Kafka is a distributed, fault tolerant, publish-subscribe messaging that can handle hundreds of megabytes of reads and writes per second from thousands of clients.
Microsoft Data Integration technology options
At DB Best, we like to think of data integration solutions in following categories.
- Direct connect to external data services like SQL Server Linked Servers and PolyBase.
- One-time data transfer services like the Azure Import/Export service for on-premises to Azure transfers via hard drive.
- Data replication services like SQL Server Replication, Change Data Capture, Backup and Restore, Log Shipping, and Read-Scale Availability groups new to SQL Server 2017.
- Data integration tools like SSIS, Azure Data Factory, and Microsoft PowerApps.
- Complex Event Processing (CEP) solutions like Microsoft StreamInsights 2.1, Azure Stream Analytics, Apache Kafka, and Apache Storm.
- Store and forward messaging solutions like Azure Event Hubs, Azure IoT Hub, Azure Service Bus.
- Metadata management tools like Azure Data Catalog and SQL Server Master Data Services.
- Data cleansing features like SQL Server Data Quality Services.
- Task scheduling capabilities like SQL Server Agent, Azure Scheduler, Microsoft Flow.
- Data gateways for on-premises to Microsoft cloud services like the Azure Gateway Cloud Service and Power BI personal gateway.
We are ready to help you design, implement, test, deploy, and support your post-production Microsoft data integration solutions. This includes migrating from other solutions like Informatica, Talent, and others to the Microsoft platform.
Learn more
Blog posts
Check out our blog post on how we used SSIS to help migrate data from an Oracle database OLTP solution into a SQL Server data warehouse.
Reference white paper
Robert Davis (aka @SQLSoldier) provides clear guidance on the differences between Merge and Peer-to-Peer replication and how to decide which method is the right one to use for your pa...
This whitepaper describes an automatic solution to deploying SQL Server Integration Services packages and projects with Visual Studio Team Foundation Server using PowerShell and T-SQL ...