Article: Friday, 12 March 2021

Online shopping is now bigger than ever, and although e-commerce offers both sellers and consumers many benefits, one significant drawback is that consumers cannot try out or physically evaluate products or services before deciding to buy. Online ratings can help guide their purchases – but how robust is the design of those online rating systems? People often assume that online ratings accurately reflect consumer satisfaction, but new research by Dr Markus Weinmann of Rotterdam School of Management, Erasmus University (RSM), Dr Christoph Schneider of IESE Business School, Barcelona, Dr Peter Mohr of Free University Berlin, and Prof. Jan vom Brocke of University of Liechtenstein found that ratings can be influenced by the design of the rating system.

In other words, webpage design can influence how consumers report their experiences and surprisingly, ratings do not necessarily reflect consumer satisfaction. This has implications for businesses that invite customers to leave their feedback online, and the consumers looking to use online ratings from other customers to guide their own purchasing decisions.

The same restaurant can get vastly different ratings depending on which dimensions – such as food or atmosphere – a rating platform asks for

Different platforms, different ratings

Interestingly, the same products or services often receive different ratings on different websites – for example, reviews of the same restaurant appearing on TripAdvisor and Yelp. Given the widespread use of online ratings, these differences are an interesting and important issue, so the researchers were curious to discover the underlying reasons for them – in particular the rational and irrational human behaviour for giving ratings on online platforms.


Seven experiments

They conducted seven experiments in which they asked two groups of participants to provide ratings for restaurants, movies, or their universities. One group of participants was asked only for an overall rating; the other was asked to provide ratings on several qualities; food, atmosphere, service for restaurants, and other appropriate aspects for movies and universities, in addition to being asked to give an overall rating.

Comparing the overall ratings from both groups allowed the researchers to test the hypothesis that even just mentioning individual qualities – or ‘sub-ratings’ – when asking for a review brings them to the front of participants’ minds, and in this way, the ratings of individual qualities influence overall ratings.


Sub-ratings influence overall rating

The researchers expected that overall ratings from both groups — with and without asking for dimensional ratings — would not differ, and that asking for dimensional ratings would not change overall ratings. But their research shows that asking consumers to provide dimensional ratings on other qualities in addition to providing an overall rating can systematically influence the overall rating, positively and negatively.

If consumers provide high scores for dimensional ratings, their overall ratings tend to be higher than those of consumers who were not asked for dimensional ratings. Conversely, if consumers provide low scores for dimensional ratings, their overall ratings tend to be lower than those of consumers who did not rate those dimensions.

Ratings are not universal

These findings provide a better understanding of online rating systems, particularly for providers of products or services. Any service or product provider must carefully consider which dimensions to include in the rating system because scoring very low on one dimension can dampen the overall rating.

There’s also a word of caution for consumers when using information from online feedback left by others to make their purchasing decisions. The research from Dr Markus Weinmann and his colleagues shows that consumers should be careful when comparing online ratings, and be wary – or even avoid – comparing ratings from different websites.

There can be significant differences in ratings between websites just because different websites use different rating systems, and customers being asked to rate individual qualities are influenced by the system that’s used.

To be able to rely on online ratings, it is important for consumers to be aware of how overall ratings are constructed, and to ensure that the dimensions and qualities rated are aligned with the qualities the consumer wants to know more about.

Prof. Marcus Weinmann

Professor of Business Analytics

University of Cologne

Dr. Christoph Schneider

Assistant Professor of Operations, Information and Technology

IESE Business School

Profile picture of Dr. Christoph Schneider.

Prof. Peter Mohr

Professor of Behavioral Economics

Free University Berlin

Profile picture of Professor Peter Mohr.

Prof. Jan vom Brocke

Professor Information Systems & Business Process Management

University of Liechtenstein

Profile picture of Professor Jan vom Brocke.
Pile of books with vibrant bookmarks protruding from various pages, symbolizing in-depth research.

Related articles

RSM Discovery

Want to elevate your business to the next level using the latest research? RSM Discovery is your online research platform. Read the latest insights from the best researchers in the field of business. You can also subscribe to the newsletter to receive a bimonthly highlight with the most popular articles.

Do you want to learn more about this subject?

Check out these RSM education programmes

Your contact for more information:

Danielle Baan

Science Communication and Media Officer

Portrait of Erika Harriford-McLaren

Erika Harriford-McLaren

Corporate Communications & PR Manager

Erasmus University campus in autumn, showcasing its iconic red trees, viewed from across the campus pool.