Sort, Aggregate, and Convert Huge Web Logs. Process IP Addresses and Timestemps.

Home » Solutions » Business Intelligence » Clickstream Analytics

Analyze Huge Web Logs

» Solutions

Business Intelligence

BI Tool Acceleration

Reporting Functions

Clickstream Analytics

Customer Segmentation

CDC/Delta Reporting

Dashboarding

Streamline Data Webhouse Staging and Reporting

Challenges:

Data webhousing, or clickstream data warehousing (CDW), is a specialize practice used for:

• web site traffic reports
• clickstream pattern analysis
• customer segmentation
• business decisions

You may also need good information to improve your website's:

• navigation and effectiveness
• referral sources
• banner ads
• page content
• product offerings

But because the volume of clickstream data can be so high, it can be slow -- or even impossible -- to perform such analyses. You may need a specialized data reduction, integration, manipulation, and reporting tool for web logs.

Solutions:

A CDW supports essential decision making around web traffic by parsing, cleansing, reformatting, and loading data based on massive text log files. Only a specialized file integration tool like CoSort Sort Control Language (SortCL) program can:

• process these web log files directly
• apply selection logic to filter and segment logs
• manipulate URL and other text and substrings
• leverage PCRE (pattern matching) logic
• reduce the bulk to be transformed and stored
• join related transaction data from other files
• compare files and capture/report changed data
• sort rows to speed aggregations, joins, loads
• create custom detail and summary reports

CoSort therefore supports and speeds regular CDW refreshment out-of-the-box, and at a fraction of the time and cost of more complex data integration (ETL) and BI tools. High performance, parallel data transformation and I/O techniques optimize the efficiency of these operations in the file system, and have no effect on on-line web or database operations.

Within the same product -- and even within the same job definition and I/O pass -- CoSort facilitates the analysis and presentation of clickstream data through:

• metadata and processing support for C/ELF
• IP address and timestamp data support
• multiple output targets and formats for BI tools
• web-ready reports (via embedded HTML tags)
• reducing and reformatting data for dashboards

If you need to cull, process, analyze, and report on massive amounts of web log data, turn to CoSort's proven technologies and professional services to create a time- and cost-effective solution that is customized for your business requirements, and optimized in your operating environment.

IRI, The CoSort Company