Skip to main content

Data Driven



“What is the continuing role of the qualitative in an era devoted to data?” – Gideon Lewis-Kraus The Trials of Alice Goffman

Data vs Metrics: Sacrificing depth?
If an accent challenge video has more dislikes than likes what does that tell us? That more people responded negatively to the video’s content? But what is the sample? The sum of the likes and dislikes? The number of views? Is it possible to determine how many of those views are unique views? Does any of this help us to determine whether approval or disapproval is the general response to the video?

While the lure of vast amounts of data available through the internet may be enticing for researchers, they run the risk of limiting their research agenda or research methods by the availability of data or by the metrics used on online platforms. The superficial data collection tools of online platforms (comment sections, likes and dislikes, share buttons etc.), whose primary function is to better inform marketing strategies, should not be the most influential factor in determining the research questions being asked.

Starting with the question or starting with data? Where to look?

In their article on the commodification of linguistic stereotypes in Volkswagen’s 2013 Super Bowl commercial, Quiana Lopez and Lars Hinrichs undertake a research project whose approach could be considered some form of Citizen Sociolinguistics. One of their research questions sought to understand how the commercial was interpreted by American and Jamaican viewers and they collected comments from websites as shown below: 


The researchers determined commenters’ “right to speak” by their self identification as Jamaican or as “an American of color”  or by claims of having family members that belonged to these groups. They then used discourse analysis to determine the overall reception of the commercial by Jamaicans and Americans.  


When I first reviewed this list, it was striking to me that there are no Jamaican websites listed, despite the fact that the debate about the commercial was taken up by Jamaican media, with one outlet going as far as interviewing the main actor. For me, this presents issues of validity and ethics. How does the choice of websites impact the sample of comments analyzed and ultimately the findings of Lopez and Hinrichs’ study? Additionally, how reliable is anonymous self-identification? Can the findings be considered a fair portrayal of American and Jamaican reactions based on the websites used?


The study’s findings stated that, although the majority of Jamaicans did not think that the commercial was racist, the inauthentic use of a non-American stereotype by an American production company to create a commercial for an American audience, meant that the commercial could be considered “a vehicle for indirect racism”. They also add that from a methodological standpoint, “pronouncements on the social indexicality of linguistic forms have often leaned too heavily on subjective interpretive reading alone” and call for additional analysis of data from those involved on the production side of mediatized speech (Lopez & Hinrichs 2017 p. 153).

The phrase "subjective interpretive reading" has stuck with me and I think the researchers' criticism comes from their inability to deal with the complexity offered by the perspectives of netizens. By treating the comments as decontextualized data, instead of perspectives of real people, the researchers were limited in their ability to interpret the comments beyond their face value. I find it difficult to conceive of a similar study, done with participants in real life, where such short fragments of text/speech would be deemed independently sufficient for discourse analysis and/or representative of perspectives of entire nations. Culling online data of this kind, without using complementary data collection methods such as interviews should be an immediate red flag. It is unacceptable to treat metrics or online artifacts as reliable independent sources when it is nearly impossible to verify online authorship. 

Questions
Should Citizen Sociolinguistics be aligned with qualitative or quantitative methodologies exclusively? What would be the pros and cons for either choice?

Is Citizen Sociolinguistics amenable to all traditional research methods? What would a CS ethnography look like?

Markham & Buchanan call for a process-based approach to ethics for internet research, what guidelines would you propose as a starting point for Citizen Sociolinguistics?  


References 
Lopez, Q. & Hinrichs, L. (2017). C’mon, Get Happy: The Commodification of Linguistic Stereotypes in a Volkswagen Super Bowl Commercial. Journal of English Linguistics. 45(2) 130- 156.






Comments

Post a Comment

Popular posts from this blog

Acts of citizen[ship] sociolinguistics

In Acts of Citizenship, professor Isen discusses how 'citizenship' has been studied in terms of 'status', where ideas of legality, boundaries, rights and obligations are the focus of study, and 'habitus' which are the "ways of thought and conduct that are internalized over a relatively long period of time" (p. 15). Instead of these two ways of studying 'citizenship,' he proposes a new perspective that focuses on "acts," meaning "the moments when subjects constitute themselves as citizens" (p.18).  These acts seem to be characterized by breaking with habitus and creating ruptures like the Montgomery Bus Boycott and Marion Wallace Dunlop's hunger strike did. Additionally, acts of citizenship seem to be oriented towards justice and involve acting and reacting with others (p. 39).    In Acts of Citizen Sociolinguistics, professor Rhymes explains that citizens sociolinguistics acts are ruptures that ma...
6 comments
Read more

Sharing and performing on Instagram stories

Rushkoff (2019) talks about the sense of inauthenticity that we encounter in the real world, when we see poorly simulated objects or roles. And when we take on a persona that is not authentic to who we are, we get the sense of alienation from ourselves. I often experience this alienating sensation whenever I see people’s Instagram stories that are very well-curated to consecutively capture all moments of an event that are exciting and appealing, with a perfect caption and visual effects for each of them. A typical example would be stories from a surprise birthday party, where they post a video after another from getting together, decorating the room, and setting up the cake, to finally bringing the birthday girl/boy into the room who then makes a happy scream when everyone in the room shouts out “Happy Birthday!”. The climax is when everyone captured in the frame is staring at their own smartphone screen to record while the birthday person blows the candles on the cake. ...
10 comments
Read more

Stranger than Fiction: On the Ethics of Cultural Artifacts and Cross-Talk

In my blog post last week, I used the debates surrounding the song “Baby, It’s Cold Outside” to highlight a focal question of mine: How do we responsibly study and address difficult issues embedded in cultural artifacts, especially those that still wield sociocultural influence today? For the purpose of this post, I wish to consider Goffman’s On the Run both as a work of research and as a cultural artifact as well. One major problem I have perceived is that nobody can be fully knowledgeable in everything culture and society, but we all have to navigate complex sociocultural situations and make decisions and judgements every day. Different individuals possess different biographies, come from different perspectives, care about different artifacts and within them, different aspects, and therefore reach different interpretations and end up debating at complete cross-purposes. And thus, wherever there is fanfare, controversy, or some other point of interest, there is a very common ...
7 comments
Read more