Better Business Through Data Analysis & Monitoring My Account

Using IDEA to Convert CRM Data

Go-Live Data Loaded in Record Time

Here at Audimation, we use IDEA to assist our customers with complex imports projects, analysis projects, and development of customized IDEA scripts. We also use IDEA for ourselves as a data import tool into our enterprise CRM system. This month, we’re presenting a case study of how we converted all of our CRM data from a customer management system that had been in place for over 12 years to our current enterprise, cloud-based CRM – and ran the actual go-live data load in under 6 hours.

If you are entering into a data conversion project, this case study may give you ideas, no pun intended, on how you could speed up your data conversion efforts, particularly the go-live data load, using some of these methods.

CHALLENGE:

Audimation Services, Inc. provides data analytics software and professional services to thousands of auditors, IT auditors, fraud examiners, accounts, financial analysts, and consultants across the US. We had outgrown our customer management tool. We needed a customizable, cloud-based solution that our sales staff could easily access while on the road. Most importantly, we needed a solution that would give a 360° view of each of our customers. Finding a cost-effective software product was the easy part. Getting the data out of one system and loaded into another system was going to be tough.

  • We found our data to be inconsistent. For example, we found the state of Texas had been input 6 different ways in the old customer management system. These types of data inconsistencies made queries return poor quality information. As a result, one aspect of our conversion project was to clean up the data that would go into the new CRM system.
  • Improving operations by making data entry and data search more efficient was another requirement for this project. This meant the review and revision of every drop-down option list in the old system and mapping it to the appropriate choice in the new system.
  • We couldn’t afford for our customer management system to be down for even a day, so we had to identify a way to perform the go-live data load and the post-load data reconciliation in 48 consecutive hours or less. In other words, we had to make it happen over a weekend. And we did not have the luxury of running in parallel. There was too much risk that a customer might be incorrectly charged if one of the sales staff accidentally used a test instance versus the production instance when helping a customer.
  • User adoption is always an issue when converting to a new system. Data integrity would play a big part in successful use of the new system. If the sales team couldn’t trust the new data, our project would fail.

SOLUTION:

Kurt Johnson, our Solutions Development Manager, envisioned using IDEA to perform the following:

  • Analyze the data in the customer management system to find all the data issues.
  • Use IDEA to develop the logic that would scrub the data to make it consistent.
  • Use IDEA to develop the logic that would take the scrubbed data and map it to the appropriate values in the new CRM system.
  • Use the history feature in IDEA to create IDEAScripts that used ODBC to import the “old” data, scrub it, map it, and export it to .csv files to be uploaded into the new system.
  • Use IDEA to test the remapped data
  • Use the history feature in IDEA to create IDEAScripts that would test the remapped data. These IDEAScripts would be used to reconcile the data after it was uploaded into the new CRM system.

RESULTS:

Kurt spent several weeks analyzing the inconsistencies in the old customer management system. He tested the resultant IDEAScripts and was able to fine-tune them such that they could import the data, manipulate it, and export it in under 3 hours.

On the appointed day, we started our go-live data load at 5:00 PM. Our first step was to lock the users out of the old system. This was to prevent any data being input into the old system after the data was extracted from it. We wanted no data left behind.

We ordered pizza at about 7 PM, expecting to be there until the next morning because not only did the data have to be migrated from the old to the new system, it had to be reconciled in the new system before the users could have access to it.

At 8:00 PM, Kurt announced that the data had been extracted from the old system, scrubbed, manipulated, and was ready to be imported into the new system. After a couple of unexpected import challenges that were immediately resolved, the data import was completed in about two hours. The team reconciled the data and we went home at 11:00 PM – six hours from turning off the users’ access to the old system and turning on their access to the new system.

We planned a 6-week “data observation” period to be sure the data had been imported correctly. After 2 weeks, we were able to relax as the users reported the data to be accurate. We’ve been using the “new” CRM for 5 years now and believe IDEA was the means to completing our project successfully with no disruption of service to our customers.

If you have any questions about this, or other questions about IDEA, please give our help desk a call at 888-641-2800 Option 4. Or email us at helpdesk@audimation.com.

Print

Number of views (1817)/Comments (0)

Tags:
Brad Newman

Brad Newman

Other posts by Brad Newman
Contact author

Please login or register to post comments.

Name:
Email:
Subject:
Message:
x
Take a Lean Six Sigma Approach Using Data Analytics
16 October 2018

Take a Lean Six Sigma Approach Using Data Analytics

Read More

Infusing Python into Your Analysis with IDEA
6 October 2018

Infusing Python into Your Analysis with IDEA

IDEA Tech Tip

This Tech Tip we share some examples of how equivalent tasks in IDEAScript can be made much simpler in Python.

Read More

Global Chemical Company Automates Risks Identification with CaseWare IDEA
14 September 2018

Global Chemical Company Automates Risks Identification with CaseWare IDEA

Global corporation used IDEA to standardize & develop an automated process to comply with anti-corruption policy.

Read More

Telecommunications Provider Turns Two Days of Work Into 20 Minutes with CaseWare IDEA®
14 September 2018

Telecommunications Provider Turns Two Days of Work Into 20 Minutes with CaseWare IDEA®

Auditors Analyzing Hundreds of Millions of Records to Track Buying and Usage Patterns

One of the world’s largest telecom companies' internal audit team leverages tech to analyze trends, tendencies & patterns within customer & financial data.

Read More

Exploring IDEA's Built-In Power of Python
20 August 2018

Exploring IDEA's Built-In Power of Python

IDEA Tech Tip

With the release of version 10.3, IDEA created a buzz with its implementation of the Python scripting language, thereby taking a huge step towards having a more robust coding environment.

Read More

Sharing IDEA Data Using IDEA's ODBC Driver
18 July 2018

Sharing IDEA Data Using IDEA's ODBC Driver

IDEA Tech Tip

Read More

Oncor Achieves Operational Efficiencies with CaseWare IDEA
25 June 2018

Oncor Achieves Operational Efficiencies with CaseWare IDEA

Oncor's internal audit team needed to acquire years of data from different environments and formats to help improve processes and efficiency levels.

Read More

Analyzing the Past to Predict the Future with Trend Analysis
18 June 2018

Analyzing the Past to Predict the Future with Trend Analysis

In business, predicting the future is never an easy task. But IDEA can help as long as you have the right data, and Trend Analysis can help.

Read More

2018 IDEA® User of Excellence Award Winner Selected
15 June 2018

2018 IDEA® User of Excellence Award Winner Selected

Jennifer Girard, CIDA with American Red Cross Recognized for Exceptional Use of Data Analytics

Jennifer Girard, Sr Auditor with the American Red Cross is the recipient of the 2018 US IDEA UoE Award. She utilized IDEA to assist Finance Department during a natural disaster.

Read More

The Rules of Nature and Audit
6 June 2018

The Rules of Nature and Audit

What’s missing is often as important as what’s present. The rules of nature apply very well to audit if you consider, “Everyone knows it, but do you test for it?”

Read More

Using IDEA to Import QuickBooks General Ledger Data
4 June 2018

Using IDEA to Import QuickBooks General Ledger Data

The General Ledger is typically the starting point to an expanse of detailed information, see a step-by-step guide on how to get a readable version in idea.

Read More

New Features in IDEA 10.3 Part II
10 May 2018

New Features in IDEA 10.3 Part II

IDEA Tech Tip

In a recent article, we introduced the improvements to Stratified Random Samples and Python integration added in IDEA 10.3. But that’s just a small part...

Read More

Cargo Company Swaps Programming-Intensive Data Analytics Software for CaseWare IDEA
10 May 2018

Cargo Company Swaps Programming-Intensive Data Analytics Software for CaseWare IDEA

Auditors Achieve More Success in First Year with IDEA Than 5+ Years with Other Tool

With the entire audit team up and running using data analytics, they are finding new ways to integrate IDEA into other areas of the business and automate repeatable processes.

Read More

Maximizing Your Environment - Global Variables
8 May 2018

Maximizing Your Environment - Global Variables

Consider scope to be a building in which people work. The tools required to accomplish their tasks will of course be housed in that building, but in scripting it’s important to determine which tools need to be shared among the buildings.

Read More

RSS