Wisx’s proprietary data integration framework utilises existing SQL server technology to leverage enterprise level data extraction. The framework is easy to install and administer, reducing development time to a minimum.
The data integration frameworks primary aim is to make the ability to extract data from source to destination as fast as possible both from a development and extraction point of view.
Example:
You require 30 tables to be extracted into a data warehouse, these tables vary in degree of rows from millions of rows to a handful. If developing using standard functionality will take several hours of development time. With the Data Integration Framework, this can be all configured in 30 minutes, with delta loading as standard.
Example Expanded:
Using the above scenario, imagine that some of these tables are so large that extraction of the data during the day is not possible, these can be scheduled with out bespoke system to extract at a weekend, however, still allow the configuration to be performed during the working day. Other examples are new modules of a system will not be ready or implemented out of business hours, again our platform makes this easy to configure and automated without the need of additional out of hours development resources.
The Data Integration framework is a reliable means of base data capture and becomes the foundation for a strong BI data warehouse regardless of the Business Intelligence methodology your business adopts. The solution provides several elements standard out of the box solutions do not:
- Adding New Data Sets/Tables.
A simple one line addition is required for source and destination locations. - Project Schema’s.
Each table being imported is assigned to a Project. This means if your ERP and Financials are on different solutions, they can be all assigned under one security schema to silo data efficiently. - Data Set Schema Changes.
Our solution provides the ability to handle data schema changes, this is a constant challenge with typical extraction solutions, if your data changes with the introduction of new fields over time, these are typically missed or causes failures by standard solutions. The Wisx’s framework handles this as standard; meaning new fields or altered fields are automatically added to the destination. Likewise any fields that have been removed from source, remain in the destination so no data is lost. - Selective Data Extraction.
You can restrict data loading to date specific or data flag specific criteria’s to ensure only the data you require is extracted. - Delta Loading.
The solution by default will identify new, altered, deleted records and capture this detail at row level. This allows the business to identify when data has changed. - Pre-planning
There are times when the business will have a new solution where data will need to be brought across - Enable/Disable Specific Data Set/Tables.
From time to time, business challenges may mean certain tables or data projects need to be deactivated. Examples are ERP upgrades, this may mean stopping data from being loaded at specific point. However, data warehousing may still be required on other aspects (Financials). The framework can handle individual disablement of tables or data projects if required. - Capturing Deleted Data.
The warehouse never actively deletes data, this is retained and marked as deleted. This provides the client with the option to retain the information or alternatively you can simply choose to permanently delete.
All of the above is managed within one solution and requires little SQL knowledge to manage and administer.
For more information and a demo please get in touch.