{"id":7651,"date":"2019-02-19T00:17:35","date_gmt":"2019-02-19T05:17:35","guid":{"rendered":"http:\/\/www.servsig.org\/wordpress\/?p=7651"},"modified":"2019-02-20T15:25:28","modified_gmt":"2019-02-20T20:25:28","slug":"three-acid-tests-to-evaluate-your-research","status":"publish","type":"post","link":"https:\/\/www.servsig.org\/wordpress\/2019\/02\/three-acid-tests-to-evaluate-your-research\/","title":{"rendered":"Three \u201cAcid Tests\u201d to Evaluate Your Research"},"content":{"rendered":"

\"\"<\/a>
\nby\u00a0Yany Gr\u00e9goire, HEC Montr\u00e9al. He received in 2018 the Journal of Service Research \u201cBest Reviewer\u201d Award.<\/em><\/p>\n

First, I would like to thank Werner for inviting me to write this short essay on reviewing in Service Marketing. I have been a professor for almost 15 years now, and I realized early in my career that Service Marketing was MY community, MY academic family. Sharing some insights about reviewing with you is an immense pleasure. I hope these few tips will be helpful to some of you, especially the younger researchers.<\/p>\n

I\u2019m almost mid-career now, which means that I review about 30-40 manuscripts a year. I do this for various reasons. First, I believe it is part of our duty as scholars to review the research of others; it just seems fair if we want others to review our own work. It is also a good way to serve and be part of my favorite academic community. In addition, it is an excellent way to learn and to stay up-to-date on recent research and the fast-evolving game of publishing. At the end of the day, it is a privilege to sit on the board of quality journals\u2014such as JSR<\/em>, JAMS<\/em>, and JBR<\/em>\u2014which have at heart the wellbeing of the service community. It is very rewarding to be part of this knowledge creation process.<\/p>\n

Over time, I have realized that experienced reviewers share similar heuristics that create a kind of \u201csecret\u201d language and set of \u201cunspoken\u201d criteria to evaluate research. Such reviewers quickly realize\u2014often in the first 2 or 3 pages\u2014if the authors speak the same \u201clanguage\u201d they do. My objective here is to try to communicate such tacit criteria and heuristics for new authors so that they can become more fluent in the \u201creviewing language.\u201d Specifically, I discuss three unspoken \u201cacid tests\u201d used to measure the quality of the positioning<\/em>, theory<\/em>, and method<\/em>.<\/p>\n

    \n
  1. The positioning<\/em> (or the introduction) is a critical part. Its length typically varies between 2 and 4 pages. A quality manuscript regularly starts by discussing a \u201csexy\u201d topic or current event (e.g., social media crises, big data challenges, liquid possession, etc.) and by highlighting a large gap for managers or researchers. Then, the authors present between two and four concrete solutions\u2014often called contributions\u2014to address this large gap. The way these contributions are framed is crucial. They need to relate directly to the model or the hypotheses. The positioning can almost be viewed as a form of executive summary in which the authors present upfront their key findings and recommendations. The authors need to be assertive, clear, and precise about their specific contributions. This is not a place for generalities and empty sentences; each word should be carefully selected and weighed. As an author, I always spend an unreasonable number of hours writing (and rewriting) this part. As a reviewer, I expect to see the same concern for quality and precision. It is probably the first \u201cacid test\u201d of a manuscript.<\/li>\n<\/ol>\n
      \n
    1. Then comes the theory section<\/em>. Here, I would recommend avoiding the expression \u201cliterature review\u201d and replacing it by \u201cresearch background.\u201d A sign that the authors do not speak the \u201clanguage\u201d is when they discuss in detail various tangential notions that are not directly related to the positioning. For instance, if you\u2019re interested in the outcomes related to online complaining, there is no point in having a lengthy discussion about its antecedents. Try to write the background section economically, using a linear and concise style. The background section should focus on defining new core concepts (e.g., engagement, brand hate, etc.), or foundational theories that are essential to the formulation of the hypotheses (e.g., resource-based view, broaden-and-build theory, etc.). It is difficult to make a substantial contribution in this section; it should be written clearly, effectively, and should be to the point.It is my sense that tightly written articles move quickly to the conceptual model or the hypotheses (maybe after 5 or 6 pages in total, including the positioning). If you have a figure\u2014which is common in marketing strategy and service marketing\u2014present it early and use it as a \u201croadmap\u201d to expose your logic. If you conduct behavioral research (i.e., field studies, experiments, etc.), you should probably avoid predicting main effects as your core hypotheses. Main effects in behavioral research are like the \u201ckiss of the death\u201d; these are likely to be viewed as too simplistic and intuitive. Try to emphasize \u201ccool\u201d interaction or moderation effects, which present strong reversal effects or interesting counterintuitive patterns. Reviewers will also expect to see hypotheses about the process\u2014this is almost mandatory for experimental work\u2014and some discussion about ruling out rival explanations. It is by presenting counterintuitive interaction effects and rich mediation effects that the reviewers will conclude that you are making a sufficient theoretical contribution. A word of caution here: a lack of theoretical contribution is probably the most common reason for rejection, as well as the easiest way for a reviewer to dismiss your manuscript. The aspects related to the richness of your model compose the second \u201cacid test\u201d of your manuscript.<\/li>\n<\/ol>\n
        \n
      1. The third and final \u201cacid test\u201d is not the least. There is a growing expectation for multi-methods research<\/em> (including at least one special data collection), and for the use of sophisticated analytical approaches. In managerial and behavioral research, the combination of different methods is becoming a best practice. However, it is probably not sufficient to combine a basic cross-sectional survey with a few basic scenario-based experiments in order to get published in a top journal. In my opinion, the authors need to go the extra mile to conduct at least one special data collection. The harder it is to collect data, the more the data will be considered by the review team. For instance, it is now common to see dyadic or triadic data, longitudinal design, multilevel design, neurophysiological measures, textual data, voice data, financial data, etc. In addition, along with the collection of \u201cnewer\u201d data, it is expected that enhanced statistical analyses, going beyond ANOVAS, SEM, and PROCESS, will be used. There is certainly a growing demand for mixed models, multilevel models, event studies, and sophisticated econometric models accounting for endogeneity, to name a few.<\/li>\n<\/ol>\n

        I hope these three \u201cacid tests\u201d do not look too stringent for new researchers. They should not be. They are merely part of doing good and fun research. New researchers should give it some time and enjoy the process of knowledge creation. By doing research one day at a time, you will see that this academic language will become yours in no time.<\/p>\n

        I look forward to seeing you, my dear service friends, at a conference this summer.<\/p>\n

        \"\"<\/a>Yany Gr\u00e9goire
        \n<\/em>Chair Omer DeSerres in Retailing at HEC Montr\u00e9al
        \n<\/em>HEC Montreal, Canada<\/em><\/p>\n

         <\/p>\n

         <\/p>\n

         <\/p>\n

        Photo:\u00a0https:\/\/www.britannica.com\/science\/acid<\/a><\/p>\n

         <\/p>\n