Welcome to the course website for the course, “From Idea to Research and Publishing in the Social Sciences,” taught by Dr. Joshua Kjerulf Dubrow at the Graduate School for Social Research in Warsaw, Poland 2013-2104. In this website you will find more information about the course and readings.
From 80,000 Hours:
Like many new academics, you want to do important research; research that makes the world a better place. The problem is there’s virtually no guidance out there. All you can do is ask experts in specific fields, while there’s no-one providing an overview of which areas might be best.
A high impact research question has three characteristics:
It’s important: If we make progress, then the world will become a better place.
It needs talent: If more people work on it, then more progress will be made. And in particular…
It needs your talent: If you work on it, then more progress will be made
A good research question needs to be both important and in need of more researchers. Building a perpetual motion machine is extremely important – if we could do it, then we’d solve our energy problems – but we have good reason to think it’s impossible, so it’s not worth working on. Similarly, a problem can be important but already hold the attention of many extremely talented researchers, meaning your extra efforts won’t go very far.
Instead, we want to find questions that are important and where one extra person’s efforts can go a long way. What matters is the importance of the problem weighted by the extent to which you can make a difference to the problem.
Finding these questions, however, is difficult. Often, the only way to identify a particularly promising research question is to be an expert in that field! That’s because (when researchers are doing their jobs), they will be taking the most promising opportunities already. The only way for you to have more impact than the average is to have more informed views about what’s important to work on.
Nevertheless, it seems that there are some types of question that tend to get unfairly neglected. So, for someone who prioritises impact, there are special opportunities to uncover. What follows is one way to start narrowing down the huge range of options available.
The process of turning an idea into a manageable product is not linear. It may start with a fixed idea, but that idea can change as you collect more information, do more reading, and write-up what you have. New information changes old ideas. And your story changes.
Inspiration comes from anywhere, and everywhere. Take the story of a guy from Lisbon who is traveling the world and making hand-drawn sketches of everything he sees (the full story is here).
“Luis Simoes has visited 29 countries in the past two years, traversing Europe and Asia and documenting every step. But not in the usual way — there’s no snapping of thousands of photos with his smartphone, or making friends back home jealous with interminable Facebook posts. Instead, Simoes, a 35-year-old former 3D motion designer from Lisbon, Portugal, is sketching his way around the world…”
Why? Because others travel, so why not him?
“After ten years in the same job he decided that he’d had enough; he wanted to be out there doing what he loved. And that thing, he discovered, was sketching. “I had a friend who was traveling around the world and I was jealous, but then I thought, if he’s doing this then I can also do this.”
How he started, and how he changed. He says:
“Up until now as I’ve been traveling around I do a lot of sightseeing but I try to capture the mood of a traveler when he’s sightseeing. So I’m not just drawing a beautiful building, I’m trying to capture the life around the building, and how people connect with that building. So I try, with my sketches, to bring these moments. I try to build a story behind every sketch.”
His style has changed, he reflects. He no longer draws tourist attractions like the Sagrada Familia in Barcelona or the Eiffel Tower. “Now I’m drawing a story… I don’t have to tell everything, but I give you the subject. I’ve learned how to go sketch faster but keep all the ingredients to keep the viewer interested. Of course the more you sketch the more you grow, so it’s an evolution.”
Your own research is an evolution, not a straight line from a fixed, beginning idea that is ultimately realized.
And it requires a leap into the unknown. Luis is on a five year sketching journey, and he says:
“I needed the ambition — I wanted something big, for myself. Five years is a long time but I want to search for the unknown.”
For more on the evolution of research, see this TED video, “Uri Alon: Why truly innovative science demands a leap into the unknown.”
Lewis Coser, American sociologist, wrote in preface to his book, The Functions of Social Conflict (1956: 7):
Before the “facts” can speak, they have to be arranged though some conceptual scheme. The divorce between research, conceived as a quest for “facts,” and theories which too often soar beyond the reach of facts, is responsible for many of the shortcomings of American sociology. And this divorce is responsible as well for the lack of cumulation and continuity in American sociology. Periodic conceptual analysis, in our view, serves to mitigate these two kinds of shortcomings.”
Students are to attend a session at the upcoming conference, “Nationalism and Conflict: Interdisciplinary Methodological Approaches,” held at PAN December 10 – 12. The conference website, and program, are available online.
One of the assignments for the “From Idea to…” class was to review an article. Several classes were devoted to discussions of the structure of empirical articles in the social sciences, and one class was devoted to writing article reviews; students were given a review of an article as an example. Everyone in the class (N = 15) reviewed the same article.
What is striking is how many different views there are about the same article. Here are some examples of student reviews.
On the style of writing:
— “Article is written very clearly and precisely, all data is analyzed very carefully, research question is answered, all hypotheses are verified.”
— “The structure of the article is clear and simple. The language is academic, hence demanding, but not too hard to understand even for a general public. ”
— “The paper is written clearly and in a manner that makes it easy to follow also for a non-specialist in the field.”
— “Values of this in a way pioneer analysis are undermined however by serious shortcomings in the presentation of the study and its results, its chaotic structure, lack of definitional clarity and theoretical profoundness.”
— “My main comment towards the article is that it uses too many intellectual shortcuts, both in theoretical explanation of hypothesis and in the results interpretation. Therefore, I perceived it as more journalistic than academic, despite of being based on the survey data.”
— “The results that follow each other are sometimes describe in such a modest way, that a reader could easily miss some important information or understand it incorrectly.”
Most identified problems such as:
— Article fails to adequately answer, “So what?”
— Article does not cite enough previous literature, and thus the theory and expectations section suffers
— Article does not describe the data used in adequate detail
— Author should not assume that “party image” is a valid indicator of “party system”; a clearer link should be made.
Others thought that the political parties were not adequately described:
— “The descriptions of the political parties are very journalistic and too simplistic. What does it mean that PO is pragmatic? Or PiS nationalistic? Again it sounds more like repeating the clichés.”
— “[need] to improve the characteristics of the Polish parties, which is not very precise (Samooborona as a “traditionalist Catholic” party, or controversial characteristic of PiS as a nationalistic party).”
Others question whether women and the old are disadvantaged groups:
— “Why women, the old and the poor have been chosen? Are they really disadvantaged in Poland? How do we know that?”
— “The [assumption of the] article is … the idea that women, the old and the poor are disadvantaged social groups and that those groups are less visible during the political process. In terms of a large number of socio-economic indicators those groups definitely have certain disadvantages in their social life, but their little visibility in political process is very questionable.”
A very interesting criticism is this:
— “Another point is that data was collected in 2008, one year after Parliamentary elections: it is known that parties care much more about their image before elections. Perhaps, research during ongoing PR campaign could show different results.”
Most recommended to revise & resubmit or even conditionally accept the article. Perhaps the students thought that the course instructor is also the author of the article, and decided to be kind; or, the students are too kind anyway, even if their criticisms are direct and rather unfavorable to the work.
On writing article reviews:
Key to understanding how to write an article for review for a journal is that the editor of the journal, the reviewer and the author are all engaged in a debate over the author’s work. The author presents their research and is supposed to do so clearly and in a detailed fashion. The editor of the journal asks a “reviewer” to enter this debate; the reviewer’s job is to (a) demonstrate that they understood the article as best they could, (b) present their criticisms in as clear and detailed way as the author had done (or sometimes in an even clearer and more detailed way if the author’s article is insufficiently clear and detailed), and (c) tell the editor whether the article should be rejected outright, rejected but invited to revise the article and resubmit it for a second review (so-called “Revise & Resubmit”), conditionally accept the article (meaning the article has so few flaws that only minor revisions are needed), or accept as is (this almost never happens).
The reviewer has a professional and ethical responsibility to the editor, the author, and the larger scientific community to be clear and detailed in their criticisms.
Remember, too, the audience for reviews: it is for the editor and the author, both of whom are your colleagues in the scientific community. You have a responsibility to be respectful to them. Reviews should be direct and honest, but language used by the reviewer can impede the points the reviewer wants to make. Reviewers should be as careful in their reviews as the author was in writing the article. Criticisms should be constructive, an attempt to help the author of the article do better.
The beginning of a professional article review necessarily begins with a summary of the article. This is so that the editor of the journal – the one who makes a decision as to whether the article will be published in their journal – and the author who receives the review are both confident that the reviewer understood the article.
Important to note that in articles which contain tables and figures, editors and reviewers expect that the tables and figures are listed as “– Table 1 about here –“ in the place where the table would be, and that the table or figure is placed in the back of the paper.
In modern scientific writing in English, it is acceptable to use the first person singular, „I.” (if the work is co-authored, then “we” is used). This is called, “active writing,” and most modern journals prefer active writing.
As an example, let’s take this sentence from the December 2010 issue of the American Sociological Review, the most prestigious English language journal in sociology (emphasis added):
“Applying this strategy to several different cases, we identify three trajectories scientific propositions assume on their way through contestation to consensus among practicing scientists…”
And these two sentences from a different article in this same issue:
“In this article, I explain variation in token experiences by demonstrating that tokenism is contingent on the local cultural context in which it is embedded. I develop this argument by comparing the experiences of female and African American male investors in the leveraged buyout (LBO) industry.”
You can see these examples here: http://asr.sagepub.com/content/75/6/817.full.pdf+html
Unfortunately or not, in modern science writing it is not necessary for authors to state how their research might be “useful for the world.” World-usefulness is not a criterion for inclusion into social science journals.
The point that the writing style is too “journalistic” can be valid, but you would need to provide a specific example of a sentence where the style impedes on understanding the author’s thought. At what point is “too journalistic” also “too unscientific?”