Gartner’s “Ability to Execute” is objective, quantitative, verifiable and less subject to opinions, particularly those of non-customers. The objectivity of Gartner’s “Ability to Execute” allows you to compare and contrast vendors based on an unbiased third party definition. The information used to measure this dimension is based on actual customers’ success with the solution, their customer satisfaction, and usability of the product day to day. Customer success can be objectively determined across all vendors by tools and metrics like “Net Promoter Score (NPS)” and Gartner Peer Insights. Both of these measures come directly from customers of the vendor who are using the product to solve their real-world problems.
Although the Gartner “Completeness of Vision” dimension is more subjective than Gartner’s “Ability to Execute,” this dimension can be used as a valuable tool. For example, if you have niche location requirements, understanding a vendor’s geographic strategy may be useful.
One of the challenges with the “Completeness of Vision” factor is that what is considered “important” changes over time as the industry and market evolves. Industry analysts’ jobs are to see where the industry is headed and how it will address the needs of their client bases, which makes the criteria subjective and fluid over time. For example, until a few years ago, Software-as-a-Service (SaaS) was preferred by many customers but considered less favorable to on-premise solutions by industry pundits, and as such resulted in a lower ranking on “Completeness of Vision.” Today however, Software-as-a-Service is considered vastly superior to on-premise and cloud hosted solutions and is favored by both customers and industry analysts for the time-to-value, flexibility, and total cost of ownership. Vendors with true vision and commitment to that vision pushed forward with huge infrastructure and business model investments years ago that are only now being recognized. Over the last three years the perception of “Completeness of Vision” has changed. It is important to identify which vendors truly align with your own company’s values and goals and ensure they are, in fact, relevant.