|
Our Claim to Fame: Large File Sort Performance
Challenges:
Sorting remains a critical component of data processing. Sorting is at the heart of database loading, indexing
and searching, data warehouse aggregation, joins, and reporting. Sorting also consumes resources. As file sizes
increase from hundreds of megabytes into terabyte levels, sorting can place an exponential demand on computing
resources. Sort functions built into DB, ETL and standalone applications, operating systems, and compilers
are often unfit for production.
Robustness issues can include:
• sort speed and scalability in volume
• data and file type support
• event monitoring and error handling
• performance tuning and logging
• third-party software and hardware interoperability
Other areas of concern for a commercial sort solution include:
• sorting and other simultaneous functionality
• user interfaces
• sort plug-in or conversion accuracy
• metadata framework
• licensing models
• technical support (speed and availability)
• vendor reputation
Solutions:
As the volume of data grows, so grows the value of CoSort. CoSort offers
standalone utility and API interfaces
for massive, parallel sorts and multiple, simultaneous data transformations
on all Unix, Linux and Windows platforms. Any number,
size, and type of structured fields, keys, records, and files can be sorted
-- including mainframe binary, IP addresses, multi-byte Asian characters,
Unicode, and so on. The CoSort engine scales linearly
in volume, and lets you can tune CPU, memory,
disk and related resources. Multiple gigabytes can be sorted in less than
a minute on multi-CPU Unix servers.
During sort operations, you can simultaneously perform a wide variety of
functions, including: filter, merge, join, aggregate, cross-calculate, convert, de-identify,
encrypt, lookup, reformat, re-map, report, validate, and prototype. With CoSort's SortCL tool, you
can combine these functions as you map multiple inputs and formats to multiple output files and formats.
SortCL is only one of several interfaces in the CoSort package available for standalone or integrated
sort operations. All sorting and tranformation jobs can be monitored, logged, and audited.
CoSort also replaces or converts third-party sort functions with proven libraries, tools or services - saving you time and money.
See also:
FAQ > Sort/Merge
Solutions > Sort Migration
Products > CoSort
Products > CoSort > Sort Plugins
Products > CoSort > SortCL
|
1-800-333-SORT
1-321-777-8889
CoSort was the world's first commercial sort package for open systems.
Today, CoSort continues to be widely adopted by data center managers, and integrated into new
applications. See why.
|