Better Business Through Data Analysis & Monitoring My Account

Using IDEA to Convert CRM Data

Go-Live Data Loaded in Record Time

Here at Audimation, we use IDEA to assist our customers with complex imports projects, analysis projects, and development of customized IDEA scripts. We also use IDEA for ourselves as a data import tool into our enterprise CRM system. This month, we’re presenting a case study of how we converted all of our CRM data from a customer management system that had been in place for over 12 years to our current enterprise, cloud-based CRM – and ran the actual go-live data load in under 6 hours.

If you are entering into a data conversion project, this case study may give you ideas, no pun intended, on how you could speed up your data conversion efforts, particularly the go-live data load, using some of these methods.

CHALLENGE:

Audimation Services, Inc. provides data analytics software and professional services to thousands of auditors, IT auditors, fraud examiners, accounts, financial analysts, and consultants across the US. We had outgrown our customer management tool. We needed a customizable, cloud-based solution that our sales staff could easily access while on the road. Most importantly, we needed a solution that would give a 360° view of each of our customers. Finding a cost-effective software product was the easy part. Getting the data out of one system and loaded into another system was going to be tough.

  • We found our data to be inconsistent. For example, we found the state of Texas had been input 6 different ways in the old customer management system. These types of data inconsistencies made queries return poor quality information. As a result, one aspect of our conversion project was to clean up the data that would go into the new CRM system.
  • Improving operations by making data entry and data search more efficient was another requirement for this project. This meant the review and revision of every drop-down option list in the old system and mapping it to the appropriate choice in the new system.
  • We couldn’t afford for our customer management system to be down for even a day, so we had to identify a way to perform the go-live data load and the post-load data reconciliation in 48 consecutive hours or less. In other words, we had to make it happen over a weekend. And we did not have the luxury of running in parallel. There was too much risk that a customer might be incorrectly charged if one of the sales staff accidentally used a test instance versus the production instance when helping a customer.
  • User adoption is always an issue when converting to a new system. Data integrity would play a big part in successful use of the new system. If the sales team couldn’t trust the new data, our project would fail.

SOLUTION:

Kurt Johnson, our Solutions Development Manager, envisioned using IDEA to perform the following:

  • Analyze the data in the customer management system to find all the data issues.
  • Use IDEA to develop the logic that would scrub the data to make it consistent.
  • Use IDEA to develop the logic that would take the scrubbed data and map it to the appropriate values in the new CRM system.
  • Use the history feature in IDEA to create IDEAScripts that used ODBC to import the “old” data, scrub it, map it, and export it to .csv files to be uploaded into the new system.
  • Use IDEA to test the remapped data
  • Use the history feature in IDEA to create IDEAScripts that would test the remapped data. These IDEAScripts would be used to reconcile the data after it was uploaded into the new CRM system.

RESULTS:

Kurt spent several weeks analyzing the inconsistencies in the old customer management system. He tested the resultant IDEAScripts and was able to fine-tune them such that they could import the data, manipulate it, and export it in under 3 hours.

On the appointed day, we started our go-live data load at 5:00 PM. Our first step was to lock the users out of the old system. This was to prevent any data being input into the old system after the data was extracted from it. We wanted no data left behind.

We ordered pizza at about 7 PM, expecting to be there until the next morning because not only did the data have to be migrated from the old to the new system, it had to be reconciled in the new system before the users could have access to it.

At 8:00 PM, Kurt announced that the data had been extracted from the old system, scrubbed, manipulated, and was ready to be imported into the new system. After a couple of unexpected import challenges that were immediately resolved, the data import was completed in about two hours. The team reconciled the data and we went home at 11:00 PM – six hours from turning off the users’ access to the old system and turning on their access to the new system.

We planned a 6-week “data observation” period to be sure the data had been imported correctly. After 2 weeks, we were able to relax as the users reported the data to be accurate. We’ve been using the “new” CRM for 5 years now and believe IDEA was the means to completing our project successfully with no disruption of service to our customers.

If you have any questions about this, or other questions about IDEA, please give our help desk a call at 888-641-2800 Option 4. Or email us at helpdesk@audimation.com.

Print

Number of views (1686)/Comments (0)

Tags:
Brad Newman

Brad Newman

Other posts by Brad Newman
Contact author

Please login or register to post comments.

Name:
Email:
Subject:
Message:
x
2018 IDEA® User of Excellence Award Winner Selected
15 June 2018

2018 IDEA® User of Excellence Award Winner Selected

Jennifer Girard, CIDA with American Red Cross Recognized for Exceptional Use of Data Analytics

Jennifer Girard, Sr Auditor with the American Red Cross is the recipient of the 2018 US IDEA UoE Award. She utilized IDEA to assist Finance Department during a natural disaster.

Read More

The Rules of Nature and Audit
6 June 2018

The Rules of Nature and Audit

What’s missing is often as important as what’s present. The rules of nature apply very well to audit if you consider, “Everyone knows it, but do you test for it?”

Read More

Using IDEA to Import QuickBooks General Ledger Data
4 June 2018

Using IDEA to Import QuickBooks General Ledger Data

The General Ledger is typically the starting point to an expanse of detailed information, see a step-by-step guide on how to get a readable version in idea.

Read More

New Features in IDEA 10.3 Part II
10 May 2018

New Features in IDEA 10.3 Part II

IDEA Tech Tip

In a recent article, we introduced the improvements to Stratified Random Samples and Python integration added in IDEA 10.3. But that’s just a small part...

Read More

Cargo Company Swaps Programming-Intensive Data Analytics Software for CaseWare IDEA
10 May 2018

Cargo Company Swaps Programming-Intensive Data Analytics Software for CaseWare IDEA

Auditors Achieve More Success in First Year with IDEA Than 5+ Years with Other Tool

With the entire audit team up and running using data analytics, they are finding new ways to integrate IDEA into other areas of the business and automate repeatable processes.

Read More

Maximizing Your Environment - Global Variables
8 May 2018

Maximizing Your Environment - Global Variables

Consider scope to be a building in which people work. The tools required to accomplish their tasks will of course be housed in that building, but in scripting it’s important to determine which tools need to be shared among the buildings.

Read More

Tips on Acquiring Data
8 May 2018

Tips on Acquiring Data

An IDEA User Shares Frequent Practices

When working with rows and columns of data to spot suspicious behaviors, fraud and errors can look very similar to one another. While Yeriazarian often uses Excel as an interim format for data, he also understands there are several avenues to navigate before getting the right data.

Read More

Identifying Churn in AR
19 April 2018

Identifying Churn in AR

IDEA Tech Tip

Customer churn (customer attrition, turnover, or defection) is when a customer decides to stop engagement with your company. IDEA can help easily identify “churn” in accounts receivable by following these steps...

Read More

Jeremy Clopton Joins Integration Partnership Program to Help Professionals State & Sustain Their Use of Data Analytics
18 April 2018

Jeremy Clopton Joins Integration Partnership Program to Help Professionals State & Sustain Their Use of Data Analytics

Data analytics & fraud detection expert Jeremy Clopton joins the Audimation Integration Partnership program to help organizations leverage data analytics.

Read More

Think Like a Thief to Catch One
11 April 2018

Think Like a Thief to Catch One

Apply Logic to Detect Peculiar Behavior

When working with rows & columns of data to spot suspicious behaviors, fraud & errors can look very similar to one another. Tips on sniffing out fraud.

Read More

5 Elements of a Successful Data Analytics Program
12 March 2018

5 Elements of a Successful Data Analytics Program

Building a successful, sustainable data analytics program takes effort…and a few other elements.

Read More

The Power of Field Statistics
7 March 2018

The Power of Field Statistics

IDEA Tech Tip

IDEA’s Field Statistics can save you a wealth of time. It should be the first thing you go to after importing a file. Why?

Read More

Using Data Analytics to Prepare for Fieldwork
20 February 2018

Using Data Analytics to Prepare for Fieldwork

Automating High-Risk Transactions with IDEA

See how a global corporation used IDEA to develop an automated process to prepare auditors for on-site work.

Read More

People. Processes. Tools.
5 February 2018

People. Processes. Tools.

Successful Integration of Data Analytics

Expert IDEA users share their experiences and advice for building and sustaining a successful data analytics program.

Read More

RSS