ERP satisfaction analyses. What's behind it?

Every year, the appropriately placed ERP providers can be happy about the basically free advertising. Even the media pounce on the advertising Consulting- and analyst firms conducted ERP satisfaction analyses.

Numerous, varied reports in trade magazines with comments from the providers of the award-winning ERP are the result. Naturally, the crowned ERP providers have become experts in topics such as Mobility, Cloud capabilityBusiness Intelligence or Big Data have to be qualified first. Nevertheless, ERP satisfaction analyses are actually carried out for customers, aren't they? But how big is the benefit for the selection of an own ERP solution?

Are ERP systems really comparable?

First of all, the question arises: Which ERP systems can you make a meaningful comparison in a multitude? Is it even possible? If, for example, some systems are widely used on the market while others are hardly used at all, it is difficult to use this as a basis for a good evaluation of the system landscape. In order to carry out a reliable comparison, a sufficient number of "equal" systems must be available.
A distinction is again made between global and non-global ERP providers. However, the "global" as a basis for comparison should be treated with caution. Because "global" can mean that it is actually distributed globally by the provider, the ERP system alone has this distribution or is available globally through so-called local packages.

Who is asked in ERP satisfaction analyses?

In addition to the ERP providers as a basis for comparison, the evaluating companies in the ERP satisfaction analyses are interesting. How are these companies selected, contacted and surveyed? From the direct operator of the satisfaction analysis or via the ERP provider? It is also unclear which persons are assessing, i.e. what position or function they hold in the company. Or are companies being surveyed twice over the years? Did the survey differentiate between business users and operators? Can the assessor really assess every area of the ERP system? All these questions are not sufficiently documented, but they have an influence on the result of the satisfaction analysis.

Staff or user?

What is included in the evaluation is the size of the companies surveyed. Here, the size of a company refers to the number of employees. But not to that of the ERP system users. For example, a manufacturing company with 100 employees has far fewer users than a service provider. It is also not apparent how the company sizes are distributed among the ERP systems to be assessed.

Do not compare apples with oranges

Whether the results from the surveys of these companies are sufficient to adequately assess an ERP system?
So is an ERP satisfaction analysis even an option when selecting your own ERP system?
In these analyses, small industry-specific ERP solutions, with a handful of users, compared with the large standard systems. The satisfaction of the retail group is compared with that of the service specialist. It also appears that ERP providers with three ratings are placed on an equal footing with others with 80 responses. In addition, the unbiased reader often interprets terms that the "ERP world" does not yet clearly define very "independently. Depending on the user's point of view, the "cloud capability" of an ERP system is very different. All in all: not a very useful basis for selecting an ERP system. They can be helpful to orientate oneself on the general offerings on the market, but are no substitute for an independent search and comparison of a suitable ERP system.

SAP B1 blog