Cruscille,
Doing this matrix and scoring items based on criteria is OK. But what you need to do first is to get "the essential process". This is an offshoot from the old Data Flow Diagrams days. Many a time when products are evaluated, the focus shifts to HOW functions are satisfied. eg. How the invoice is entered in product A, B and C.
To put it in perspective, you have a choice of three solutions to satisfying the essential processes. Each of these products will satisfy the essential processes in a unique way. Here is the dilemma, when you ask stakeholders they will tell you their HOW instead of WHAT they do. So when you say, that you have 50-70 "core functionality" - it might be that this core functionality is mapped to HOW things are done NOW. Most stakeholders are not conceptual thinkers, they want to do an "Invoice" in the same way they did it years ago. This is the Subject Matter Expert dilemma, he or she will always tell you HOW they do things
Its your job to derive the "essential process", FIRST, then evaluate products A,B and C against these processes and ascertain the gap or improvement.I trust that you have a high-level business process for the core business activity and somewhere in your arsenal of things, you have end-to-end "essential" processes defined. These "essential" processes constrain the requirements (ie, the system selection are governed by the essential requirement, NOT the HOW). So before you do your step 1, get the business experts in a room and map the "essential" process - the focus is on WHAT needs to be achieved (This conversation is normally technology agnostic).
Lets take a simple essential process statement: "When we ship goods we invoice the customer, right?".
A SME might say "After I've packed the goods, I print an invoice of the items delivered and include a copy with the goods. Some customers want an email of the invoice as well, so I create a PDF of the invoice and email it to them". The essential process here is " When we ship goods we invoice the customer and we use various means to send the invoice to the customer".So when you discuss the "functional" requirements with the Warehouse SME, the SME might insist that they have the capability to create a PDF of the invoice (which is a HOW). Later, In conversation with the Debtor department, you find out that the Debtor SME wants a way to match the warehouse invoice PDF (which is a HOW) against the remittance advice received from the Customer. In fact the entry of the PDF at the customer end to create the remittance advice causes problems and if you now want to replicate this issue in the new systems, you perpetuating a problem.
So you not only need to identify gaps, you also need to identify problem/opportunity areas. Dealing with functional SMEs without the context of an essential process, might mean that you'll perpetuate their issues and select a new system that perpetuates these problems.
Heres a suggestion:
1. get the groups together and identify the high-level processes.
2. identify the issues/opportunities and gaps
3. Consider a new WOW (way of working), perhaps a new process for the warehouse/debtor process
4. Define the functions and new responsibilities; and
5. then map the new systems against the these new WOW and existing functions
All the best.
warm regards,
K