Journal Consensus Ranking

1. Introduction

This online appendix provides additional information and reproduces many figures and tables of the article:

Stefan Theußl, Thomas Reutterer, and Kurt Hornik. How To Derive Consensus Among Various Marketing Journal Rankings? Submitted to the Journal of Business Research.

Additionally, it provides the full data set used in the article. Data from various journal rankings has been collected and compiled as an R package named JQL. This package can be installed in R using install.packages("JQL", repos = "http://datacube.wu.ac.at", type = "source").

2. Rankings

Table 1: Rankings used (R code). This table extends Table 3 in the paper. Rankings with no source given have been transcribed from the 34th edition of the Harzing Journal Quality list.

Abbreviation Institution Country Source
ABDC08 Australian Business Deans Council New South Wales http://www.abdc.edu.au/3.37.0.0.1.0.htm
ABS09 Association of Business Schools United Kingdom http://www.the-abs.org.uk/?file=467
Ast08 Aston Business School United Kingdom
Bjm04 Business and Management 2001 RAE/UK United Kingdom http://www3.interscience.wiley.com/cgi-bin/fulltext/118797525/PDFSTART
Cnrs08 Comite National de la Recherche Scientifique France http://www.gate.cnrs.fr/spip.php?article198& lang=fr
Cra09 Cranfield University School of Management United Kingdom http://www.som.cranfield.ac.uk/som/p10597/research/journal-rankings
EJL06 Erasmus Research Institute of Management The Netherlands
Hkb05 Hong Kong Baptist University School of Business Hong Kong
Theo05 ALBA Journal Ranking Greece http://www.alba.edu.gr/Survey/Documents
UQ07 University of Queensland Queensland
Vhb08 Verband der Hochschullehrer fuer Betriebswirtschaft Germany http://pbwi2www.uni-paderborn.de/WWW/TEMP/VHB/NEW/VHB_Web.NSF/894ebb414952bc5fc12568f500675e92/342c4316776cc292c1256d0300528b01?OpenDocument
Wie01 WU Vienna University of Economics and Business Austria http://bach.wu-wien.ac.at/bachapp/cgi-bin/fides/fides.aspx?journal=true;lang=DE

Scale level of rankings:

3. Data Set

Table 2: Full data set used in the article (R code).

Wie01 Bjm04 Hkb05 Theo05 EJL06 UQ07 ABDC08 Ast08 Cnrs08 Vhb08 ABS09 Cra09
Academy of Marketing Science Review 3 B D 2
Advances in Consumer Research B 7.00 13.80 3 B 1 C 2 2
Advances in International Marketing A 5 C 1 C 1
Annals of Tourism Research A 5.00 A S A+ 3 4
Asia-Pacific Journal of Marketing and Logistics 3 B 1
Australasian Marketing Journal 3 B 1 D 1
Betriebswirtschaftliche Forschung und Praxis B
Business Ethics: A European Review 4.00 S 5 B D 2 1
Business Ethics Quarterly 6.50 B- 3 A 4 B 3 2
California Management Review A 6.00 B 17.59 P 2 A+ 4 C 3 4
Computers & Operations Research A 5.50 B S 4 A 3 2 B 2 1
Cornell Hotel and Restaurant Administration Quarterly B 3.50 B 2
Corporate Reputation Review 5.00 S 4 C D 1
Data Base A B 16.09 S 3 2 2 3
Data & Knowledge Engineering A+ 3 A C
Decision Sciences A 7.00 B+ 30.42 P 2 A+ 4 2 B 3 4
Decision Support Systems A 5.00 B+ 25.23 P 1 A+ 3 2 B 3 3
Electronic Commerce Research A 1
Electronic Markets A 5.29 3 A 1 C 1 1
European Journal of Information Systems A 5.00 B 22.13 P 1 A+ 4 1 C 3 3
European Journal of Innovation Management 5.00 5 C 4 D 1 1
European Journal of Marketing A 5.00 B 18.40 S 3 A+ 3 4 C 3 3
European Journal of Operational Research A 6.00 B 5.23 P A 4 1 A 3 3
European Management Journal A 5.00 S 3 C 1 3 C 1 1
European Management Review C 1 3 1
Expert Systems with Applications 2 C 2 3 3
Harvard Business Review A 7.00 B 33.50 P 2 A+ 4 D 3 4
IEEE Transactions on Knowledge & Data Engineering B 34.17 P 2 3 2 3
Industrial Marketing Management A 5.00 B+ 10.70 S 2 A 3 3 C 3 3
Interfaces A 7.00 B 4.27 P 4 B 1 C 2 2
International Business Review A 5.00 B+ S 3 B B 2 2
International Journal of Advertising B 5.00 B 3.50 4 C 1 3 D 2
International Journal of Bank Marketing B 4.00 4 C 0 D 1
International Journal of Electronic Business 4 C C
International Journal of Electronic Commerce B 9.62 P 2 A 3 2 B 3 2
International Journal of Entrepreneurship and Innovation 4 C 4 2 1
International Journal of Hospitality Management B 2.50 A 2
International Journal of Innovation Management 5.00 3 B 1 4 2 2
International Journal of Logistics Management A 5.00 S 3 B 1 3 D 2 3
International Journal of Logistics: Research and Applications 4 B 1 4 C 2 2
International Journal of Market Research A 4.00 B 3.90 S 3 B 2 3 D 2 2
International Journal of Research in Marketing 5.00 B+ 35.30 STAR 2 A+ 4 2 A 3 3
International Journal of Retail & Distribution Management B 4.00 S 4 C 1 3 D 1 1
International Journal of Service Industry Management A 5.00 S 3 B 2 4 C 2 2
International Marketing Review B 4.50 B 2.60 S 2 A 2 4 C 3
International Review of Retail Distribution & Consumer Research A 5.00 B 1 1 1
Journal of Advertising B 5.00 B+ 17.90 P 2 A 4 3 C 3 2
Journal of Advertising Research A 4.00 B+ 19.40 S 2 A 3 3 C 3 2
Journal of Applied Psychology A 6.50 A 38.53 STAR 1 A+ 4 A 4 4
Journal of Brand Management (The) 4.00 S 3 B 0 D 1
Journal of Business Communication B 4 C 0 E 1
Journal of Business Ethics A 3.00 B P 3 A 3 3 C 3 3
Journal of Business & Industrial Marketing (The) 5.00 4 B 1 D 2 1
Journal of Business Logistics A S 3 B 2 B 2 3
Journal of Business Research C 6.00 B+ 23.30 S 2 A 4 3 B 3 3
Journal of Business Strategy 3 B 0 3 C 1
Journal of Business to Business Marketing B 4.00 S 5 B 1 C 1
Journal of Business Venturing A 6.00 5.53 P 2 A+ 3 1 A 4 3
Journal of Communication 2 A
Journal of Communication Management 4.00 B 1
Journal of Consumer Affairs B S 3 A D 2
Journal of Consumer Behaviour 3 B 0 C 2
Journal of Consumer Marketing B 4.00 3.80 4 B 1 4 D 1 1
Journal of Consumer Psychology B B+ 26.60 P 2 A 3 2 B 3
Journal of Consumer Research A 7.00 A 75.90 STAR 1 A+ 4 1 A+ 4 4
Journal of Database Management 2 B 1 3 2
Journal of Economics & Management Strategy B 5.00 S A 1 1 A 3
Journal of Electronic Commerce Research C 3 C C
Journal of Euromarketing 4.00 4 C 1 E 1
Journal of Forecasting A 6.00 B 3 A 3 3 B 3 3
Journal of Global Marketing A B 4 C 1 D 1
Journal of Hospitality & Leisure Marketing B A 0 3
Journal of Information Systems B 6.84 S 2 A 3 2
Journal of Interactive Marketing 7.00 S 3 B 1 4 B 1 1
Journal of International Consumer Marketing B S 4 C 0 1
Journal of International Marketing A 6.00 B+ 6.10 S 2 A 3 4 B 3 3
Journal of International Marketing and Marketing Research B 5 C 1
Journal of Macromarketing B 5.00 S 3 C 0 4 C 2
Journal of Market-Focused Management B 3.20 4 B
Journal of Marketing A 5.00 A 82.60 STAR 1 A+ 4 1 A+ 4 4
Journal of Marketing Channels S 4 C 1 D 1
Journal of Marketing Communications 4.00 B- 4 B 1 2
Journal of Marketing Education 3 B 1 D 2
Journal of Marketing Management B 5.00 B 7.40 3 A 1 4 D 3 3
Journal of Marketing Research A+ 7.00 A 86.70 S 1 A+ 4 1 A+ 4 4
Journal of Marketing Theory and Practice B- 4 C 1 4 C 1
Journal of Nonprofit & Public Sector Marketing B 4.00 4 B 0 B 1
Journal of Personal Selling and Sales Management 5.00 B 4.40 3 B 3 3 C 2 3
Journal of Product and Brand Management 4.00 3 B 1 4 D 1 1
Journal of Product Innovation Management A 6.00 B 12.20 P 2 A+ 4 1 A 4 4
Journal of Public Policy & Marketing A 8.80 S 2 A 3 4 B 3 2
Journal of Relationship Marketing C 0 D 1
Journal of Retailing A 5.00 B+ 32.30 P 1 A+ 4 2 A 4 3
Journal of Retailing and Consumer Services A 5.00 S 3 B 1 3 C 1
Journal of Service Research 4.40 S 2 A+ 4 4 A 3 3
Journal of Services Marketing B 4.00 B 3.80 3 B 2 3 C 3
Journal of Small Business Management B 5.00 B- S 3 A 2 2 B 3 1
Journal of Strategic Marketing B 5.00 S 3 A 3 C 2 2
Journal of Supply Chain Management A S 3 B 3 B 1 1
Journal of Sustainable Tourism B 5.00 B- A 1
Journal of Systems and Software B S C
Journal of the Academy of Marketing Science A 6.00 B+ 27.50 P 1 A+ 4 2 A 4 4
Journal of the Operational Research Society A 6.00 B S 3 A 4 2 B 3 2
Journal of Travel Research A 4.00 B+ S A+ 4 3
Journal of World Business A 6.00 B S 2 A 3 3 B 3 3
Knowledge Based Systems 2 C
Leisure Sciences B A 3
Management Science A+ 6.00 A 42.74 STAR 1 A+ 4 1* A+ 4 4
Managing Service Quality B 4.00 B- B 0 C 1
Marketing Intelligence & Planning B 4.00 B- 4 B 0 1
Marketing Letters A 7.00 B+ 23.80 P 2 A 3 2 B 3
Marketing Management 4 1
Marketing Science A+ 7.00 A 65.90 STAR 1 A+ 4 1 A+ 4 4
Marketing Theory 3 A 0 C 2 1
McKinsey Quarterly D E
MIS Quarterly 6.00 A 77.71 STAR 1 A+ 4 1 A 4 4
Nonprofit and Voluntary Sector Quarterly A S A+ 3 3 B 3
Nonprofit Management and Leadership B 4.00 S B 2 B 1
Operations Research A 7.00 A 5.79 STAR 2 A+ 4 1 A+ 4 4
Operations Research Letters A B+ S 3 A 2 B 2
OR Spectrum B S B 3 A 3
Psychological Bulletin A 10.89 1 A+ A 4
Psychological Research A 2 3
Psychological Review A A+ A+ 4
Psychology and Marketing 6.00 B 9.10 S 2 A 2 3 B 3 2
Psychometrika A B 2 A 2
Public Opinion Quarterly 2 A+ 4
Public Relations Review 4 A 2
Qualitative Market Research: An International Journal B 4.00 5 C 1 C 1
Quantitative Marketing and Economics P C B 1
Quarterly Journal of Business & Economics B 2 2
R& D Management A 4.50 S 3 B 2 3 C 3 3
Research Policy A 6.00 P 1 A+ 4 2 A 4 4
Research Technology Management B S 3 A 3 D 2 3
Schmalenbach Business Review A B 2
Service Industries Journal B 5.00 B- S B 3 D 2 2
Services Marketing Quarterly 4 B 0 1
Sloan Management Review A 7.00 B 22.41 P 2 A 4 D 3 4
Small Business Economics A 6.00 P 3 A 2 2 C 3 3
Strategic Management Journal A 6.00 A 39.93 STAR 1 A+ 4 1 A 4 4
Structural Equation Modeling B 2 B
Supply Chain Management: An International Journal A S 4 A 3 4 C 3 3
Technometrics A B 29.79 A
Thunderbird International Business Review B 5.00 B 4 B 2 D 2 2
Total Quality Management & Business Excellence B 4.00 B- S 3 C 1 1 1
Tourism and Hospitality Planning & Development B 2
Tourism Economics B 4.00 B A 2
Tourism Management B 5.00 B+ A+ 2 3 3
TQM Journal B 4.00 C 2
Transportation Research Part E: Logistics and Transportation Review S A B 3 3
Zeitschrift für Betriebswirtschaft A SD B
Zeitschrift für Betriebswirtschaftliche Forschung B

4. Consensus and Naive Ranking Using Sample Data

Table 3: Extended list after excluding journals from the data set showing missing observation in more than three quarter of the rankings. This table additionally includes the naive (NR) and consensus (CR) ranking derived as described in the paper (R code, results.rda).

abbr Wie01 Bjm04 Hkb05 Theo05 EJL06 UQ07 ABDC08 Ast08 Cnrs08 Vhb08 ABS09 Cra09 NR CR
Advances in Consumer Research (c) ACR B 7.00 13.80 3 B 1 C 2 2 6.39 52.50
California Management Review CMR A 6.00 B 17.59 P 2 A+ 4 C 3 4 -4.37 16.50
Computers & Operations Research COR A 5.50 B S 4 A 3 2 B 2 1 4.94 43.00
Decision Sciences DS A 7.00 B+ 30.42 P 2 A+ 4 2 B 3 4 -9.61 16.50
Decision Support Systems DSS A 5.00 B+ 25.23 P 1 A+ 3 2 B 3 3 -5.76 16.50
European Journal of Information Systems EJIS A 5.00 B 22.13 P 1 A+ 4 1 C 3 3 -4.83 16.50
European Journal of Marketing (c) EJM A 5.00 B 18.40 S 3 A+ 3 4 C 3 3 3.54 32.50
European Journal of Operational Research EJOR A 6.00 B 5.23 P A 4 1 A 3 3 -3.61 16.50
European Management Journal EMJ A 5.00 S 3 C 1 3 C 1 1 9.55 59.00
Harvard Business Review HBR A 7.00 B 33.50 P 2 A+ 4 D 3 4 -5.75 16.50
Industrial Marketing Management (c) IMM A 5.00 B+ 10.70 S 2 A 3 3 C 3 3 1.44 32.50
Interfaces Int A 7.00 B 4.27 P 4 B 1 C 2 2 6.67 52.50
International Business Review IBR A 5.00 B+ S 3 B B 2 2 4.05 41.00
International Journal of Advertising (c) IJA B 5.00 B 3.50 4 C 1 3 D 2 12.89 60.00
International Journal of Electronic Commerce IJEC B 9.62 P 2 A 3 2 B 3 2 0.34 32.50
International Journal of Logistics Management IJLM A 5.00 S 3 B 1 3 D 2 3 7.48 52.50
International Journal of Market Research (c) IJMR A 4.00 B 3.90 S 3 B 2 3 D 2 2 11.55 52.50
International Journal of Research in Marketing (c) IJRM 5.00 B+ 35.30 STAR 2 A+ 4 2 A 3 3 -7.84 16.50
International Journal of Retail & Distribution Management (c) IJRDM B 4.00 S 4 C 1 3 D 1 1 14.24 63.00
International Journal of Service Industry Management (c) IJSIM A 5.00 S 3 B 2 4 C 2 2 8.22 52.50
International Marketing Review (c) IMR B 4.50 B 2.60 S 2 A 2 4 C 3 9.41 47.50
Journal of Advertising (c) JA B 5.00 B+ 17.90 P 2 A 4 3 C 3 2 1.32 32.50
Journal of Advertising Research (c) JAR A 4.00 B+ 19.40 S 2 A 3 3 C 3 2 2.95 32.50
Journal of Applied Psychology JAP A 6.50 A 38.53 STAR 1 A+ 4 A 4 4 -14.13 5.00
Journal of Business Ethics JBE A 3.00 B P 3 A 3 3 C 3 3 3.34 32.50
Journal of Business Research (c) JBR C 6.00 B+ 23.30 S 2 A 4 3 B 3 3 -0.26 32.50
Journal of Business Venturing JBV A 6.00 5.53 P 2 A+ 3 1 A 4 3 -6.38 16.50
Journal of Consumer Marketing (c) JCM B 4.00 3.80 4 B 1 4 D 1 1 15.55 63.00
Journal of Consumer Psychology (c) JCP B B+ 26.60 P 2 A 3 2 B 3 -2.00 24.00
Journal of Consumer Research (c) JCR A 7.00 A 75.90 STAR 1 A+ 4 1 A+ 4 4 -16.87 5.00
Journal of Forecasting JOF A 6.00 B 3 A 3 3 B 3 3 0.57 32.50
Journal of Interactive Marketing (c) JIntMar 7.00 S 3 B 1 4 B 1 1 7.38 58.00
Journal of International Marketing (c) JIM A 6.00 B+ 6.10 S 2 A 3 4 B 3 3 0.73 32.50
Journal of Macromarketing (c) JMK B 5.00 S 3 C 0 4 C 2 10.75 61.00
Journal of Marketing (c) JM A 5.00 A 82.60 STAR 1 A+ 4 1 A+ 4 4 -14.93 5.00
Journal of Marketing Management (c) JMM B 5.00 B 7.40 3 A 1 4 D 3 3 8.96 47.50
Journal of Marketing Research (c) JMR A+ 7.00 A 86.70 S 1 A+ 4 1 A+ 4 4 -16.05 5.00
Journal of Personal Selling and Sales Management (c) JPSSM 5.00 B 4.40 3 B 3 3 C 2 3 7.05 45.00
Journal of Product Innovation Management (c) JPIM A 6.00 B 12.20 P 2 A+ 4 1 A 4 4 -8.73 16.50
Journal of Public Policy & Marketing (c) JPPM A 8.80 S 2 A 3 4 B 3 2 2.99 32.50
Journal of Retailing (c) JR A 5.00 B+ 32.30 P 1 A+ 4 2 A 4 3 -9.44 16.50
Journal of Retailing and Consumer Services (c) JRCS A 5.00 S 3 B 1 3 C 1 7.34 52.50
Journal of Service Research (c) JSR 4.40 S 2 A+ 4 4 A 3 3 -0.23 25.00
Journal of Services Marketing (c) JS B 4.00 B 3.80 3 B 2 3 C 3 9.65 47.50
Journal of Small Business Management JSBM B 5.00 B- S 3 A 2 2 B 3 1 7.50 43.00
Journal of Strategic Marketing (c) JSM B 5.00 S 3 A 3 C 2 2 6.89 43.00
Journal of the Academy of Marketing Science (c) JAMS A 6.00 B+ 27.50 P 1 A+ 4 2 A 4 4 -11.66 16.50
Journal of the Operational Research Society JORS A 6.00 B S 3 A 4 2 B 3 2 0.40 32.50
Journal of World Business JWB A 6.00 B S 2 A 3 3 B 3 3 0.34 32.50
Management Science MS A+ 6.00 A 42.74 STAR 1 A+ 4 1* A+ 4 4 -17.77 5.00
Marketing Letters (c) ML A 7.00 B+ 23.80 P 2 A 3 2 B 3 -5.36 16.50
Marketing Science (c) MkS A+ 7.00 A 65.90 STAR 1 A+ 4 1 A+ 4 4 -18.35 5.00
MIS Quarterly MISQ 6.00 A 77.71 STAR 1 A+ 4 1 A 4 4 -15.07 5.00
Operations Research OR A 7.00 A 5.79 STAR 2 A+ 4 1 A+ 4 4 -13.03 5.00
Psychology and Marketing (c) PM 6.00 B 9.10 S 2 A 2 3 B 3 2 3.41 32.50
R& D Management RM A 4.50 S 3 B 2 3 C 3 3 5.51 47.50
Research Policy RP A 6.00 P 1 A+ 4 2 A 4 4 -10.07 16.50
Service Industries Journal SIJ B 5.00 B- S B 3 D 2 2 10.01 56.50
Sloan Management Review SMR A 7.00 B 22.41 P 2 A 4 D 3 4 -3.67 16.50
Small Business Economics SBE A 6.00 P 3 A 2 2 C 3 3 -0.29 32.50
Strategic Management Journal SMJ A 6.00 A 39.93 STAR 1 A+ 4 1 A 4 4 -15.17 5.00
Supply Chain Management: An International Journal SCMAIJ A S 4 A 3 4 C 3 3 4.19 40.00
Thunderbird International Business Review TIBR B 5.00 B 4 B 2 D 2 2 10.25 56.50
Total Quality Management & Business Excellence TQMBE B 4.00 B- S 3 C 1 1 1 13.41 63.00

Table 4: This table shows a more detailed examination of the actual positions the journals occupy in the aggregated rankings. It shows the results of the naive meta-ranking (NR, sorted based on the scores of this ranking) and the corresponding positions in the consensus solution (CR).

NR..scores. CR..ranks
MkS -18.35 1
MS -17.77 1
JCR -16.87 1
JMR -16.05 1
SMJ -15.17 1
MISQ -15.07 1
JM -14.93 1
JAP -14.13 1
OR -13.03 1
JAMS -11.66 2
RP -10.07 2
DS -9.61 2
JR -9.44 2
JPIM -8.73 2
IJRM -7.84 2
JBV -6.38 2
DSS -5.76 2
HBR -5.75 2
ML -5.36 2
EJIS -4.83 2
CMR -4.37 2
SMR -3.67 2
EJOR -3.61 2
JCP -2.00 3
SBE -0.29 5
JBR -0.26 5
JSR -0.23 4
IJEC 0.34 5
JWB 0.34 5
JORS 0.40 5
JOF 0.57 5
JIM 0.73 5
JA 1.32 5
IMM 1.44 5
JAR 2.95 5
JPPM 2.99 5
JBE 3.34 5
PM 3.41 5
EJM 3.54 5
IBR 4.05 7
SCMAIJ 4.19 6
COR 4.94 8
RM 5.51 10
ACR 6.39 11
Int 6.67 11
JSM 6.89 8
JPSSM 7.05 9
JRCS 7.34 11
JIntMar 7.38 13
IJLM 7.48 11
JSBM 7.50 8
IJSIM 8.22 11
JMM 8.96 10
IMR 9.41 10
EMJ 9.55 14
JS 9.65 10
SIJ 10.01 12
TIBR 10.25 12
JMK 10.75 16
IJMR 11.55 11
IJA 12.89 15
TQMBE 13.41 17
IJRDM 14.24 17
JCM 15.55 17

5. Visualization of Consensus Rankings

Figure 1: Hasse diagram for the consensus ranking derived from the extended list (R code).

Figure 2: Hasse diagram for the consensus ranking derived from the extended list (R code).