|
High-Data Volume Pre-Processing Accelerates Information Display
Challenges:
Large data volumes can choke the performance of your business intelligence (BI) or reporting applications; i.e. they may be sluggish in displaying results. These applications are designed for analytics and graphical presentation of information -- not high volume data transformation and preparation. You need to feed these applications filtered, pre-sorted, aggregated and reformatted data subsets so that answers to business questions, and their visual representations, can materialize faster.
Your presentation tool may not integrate well with your ETL tool, Perl script, program or other data drivers. You may find that it takes a long time to configure both back and front-end processes separately, and that the metadata do not match.
You may not have an effective strategy for protecting sensitive field data that finds its way into reports. You may need a more convenient way to secure data at risk.
Solutions:
The CoSort package's SortCL tool pre-process large volumes of data rapidly, taking the transformation burden away from the BI layer. This helps the information build and response times in leading BI applications, as well as emerging contenders specializing in SOA, web services, modeling, security and advanced visualizations.
SortCL can pre-process massive volumes in parallel, allowing you to integrate, interchange, filter and re-map many sequential and indexed files at once. You can filter, scrub, sort, join, aggregate and otherwise transform the data into smaller outputs in one or more formats. Rapidly build the data subsets that your dashboard, scatter plot, scorecard or other analytic tool needs, and can more easily handle.
In addition to taking the transformation load out of the BI layer, the flat file approach can also relieve your database and ETL tool from the recurring overhead of high volume data reduction and preparation. If you are currently using a BI tool to perform your transformations, you may find it easier to offload higher volume jobs to SortCL, and use the Meta Integration Model Bridge to map your input file layout metadata automatically to SortCL Data Definition Files.
If you need to present certain fields, but still protect their contents on a need-to-know basis, SortCL can apply field-level data security. Integrated functions include: anonymization, de-identification, encryption, obfuscation, and pseudonymization.
See also:
Dashboarding
Solutions > Data Transformation
Solutions > Field Protection
FAQ > Flat Files
Products > CoSort > SortCL
Products > CoSort > SortCL Metadata
|
1-800-333-SORT
1-321-777-8889
|