The ‘neutrality’ of search engines

The past two weeks I had a “presentation skills training” where we had to choose a topic that was completely new to us. Because I was quite interested in looking at a tool most of us use every day, I decided to take a closer look at the Anatomy and Workings of Search Engines. Since one of those search engines has become a common verb in most languages, let’s start from the Oxford English Dictionary’s definition of “to google”:

Pronunciation:Brit. /ˈɡuːɡl/, U.S. /ˈɡuɡ(ə)l/

1. intr. To use the Google search engine to find information on the Internet.

2. trans. To enter (a search term) into the Google search engine to find information on the Internet; to search for information about (a person or thing) in this way.

Since people use Google and other search engines regularly, they tend to rely on four common assumptions as identified by Bettina Fabos in 2003:

  1. Search engines are impartial information tools.
  2. Search engines search the entire Web, gleaning the most relevant results.
  3. Search engines vary greatly, thus offering choice and a competitive marketplace.
  4. Search engines are the only place to go for relevant information on the web.

Before I can contradict these four assumptions, it is important to understand the structure of the search engine industry.

 

Search Industry Structure

LESSON 1: Search Engines are not impartial, they are part of an industry.
Screen Shot 2017-06-22 at 10.21.04
Search Industry structure, based on the article by Bettina Fabos in 2003, using the Eleanor template from slides carnival.com
Directories are quite simply databases that contain information. In this case they contain web pages in indexed lists to feed the search engine providers. Search engine providers may use existing directories, or build their own directories by crawling the web. In order to understand the workings of search engine providers, a good starting point is the famous paper dating back to 1998 by Sergey Brin and Lawrence Page, PhD students at Stanford University and founders of Google. You can understand crawling as spiders that are sent out over the web to the location that the URL server gave them in order to gather the information in a web repository.  After collecting web pages, the indexer will convert web pages (also called documents) into a list of word occurrences or hits and add sufficient metadata which is stored in barrels. The sorter than needs to invert this index by converting the list of words attached to each document into a list of documents for each word.
So imagine looking for Katy Perry (famous example in this video). Simply put, the search engine provider will compare a list of documents containing the word ‘Katy’ to a list containing the word ‘Perry’ and feed back only those documents containing both words, preferably close to each other. However, you don’t want just any document that contains Katy Perry, you need relevant web pages. This is where the ranking algorithm comes into place, especially Google’s PageRank algorithm. The algorithm looks at the ‘popularity’ of a web page based on how many other (relevant) web pages refer to it.
Finally, the search engine portal is any website containing a search bar, which means even this page could be understood as a search engine portal. The importance of portals lies in their usability and their user friendliness.

 

Sponsorship

LESSON 2: Search engines do not search the entire web, especially not the deep web. Some directories only include paid-for content.
Screen Shot 2017-06-22 at 13.32.26
Models of sponsorship, based on the article by Bettina Fabos in 2003, using the Eleanor template from slides carnival.com

 

Google’s initial strategy was selling their technology as a search engine provider not only to other search engines, but also to other websites that use Google’s technology to power search on their own website. This strategy brings in some money, but it’s not a continuous flow of cash. Therefor, some other search engines chose to focus more on marketing agencies trading for space thus including sponsored links. Within the search industry structure, it is clear that the best way to appear in search results over different search engines, is to pay in order to add (commercial) content to the repository. However, in order to determine the efficiency of advertisements, search engines and marketeers have agreed to a pay-by-performance strategy, which means advertisers only pay the search engine when someone actually clicks on a link. Other search engines have gone for more aggressive strategies such as paid inclusion, where the advertisement appears in every search, but had to sacrifice users because of it.

 

‘Googlearchy’

LESSON 3: There is little competition in the marketplace, with mainly American companies dominating the search industry.

The search engine industry used to be dominated by three main companies: Google, Yahoo!, and Microsoft. Add to that the current trends in voice search and as this infographic beautifully demonstrates. Amazon might not be the richest company, but they certainly have the first-mover advantage and are quickly connecting their Alexa voice assistant to cars and home devices, effectively taking over parts of our lives.

 

Screen Shot 2017-06-22 at 13.55.09
Infographic showing companies leading the space race in voice search (search engine watch).

This beautiful infographic also shows the challenges related to monitising voice search. Noble as the goals of Google may be in its promises of search engine integrity, the main thing that counts at the end of the day, is money. The reason Amazon holds such a large segment of the market, could be due to the connection with their online store possibilities and connections to apps and services such as music streaming services.

Conclusion

LESSON 4: There are other places to go for information other than search engines. - perhaps the library? -

Independent institutions such as the university, but also public libraries should warrant access to knowledge that does not necessarily have a commercial value. Therefore, these public institutions need to counteract the commercial interests of search engines by focussing on Open Access. In this regard, the Digital Humanities field is one of the first and most important advocates for Open Access. It is this years main theme of the Alliance of Digital Humanities conference in Montréal Another important yet political and legal institution working on Open Access is the Open Access Infrastructure for Research in Europe or OpenAIRE. Preferably Open Access information is accessible through Google, but we also need to think about back-ups and other ways of disseminating information.

Advertisements

Hidden Figures: Black Women in the History of Computing

After the first full week of “being a PhD student” Eva and I went to the screening of Hidden Figures in Kirchberg. Because this film is so closely related to my research, I decided to write my first official blogpost about these extra-ordinary women. Now for the first question: what is the film about?

HIDDEN FIGURES is the incredible untold story of Katherine Johnson (Taraji P. Henson), Dorothy Vaughan (Octavia Spencer) and Mary Jackson (Janelle Monáe)—brilliant African-American women working at NASA, who served as the brains behind one of the greatest operations in history: the launch of astronaut John Glenn into orbit, a stunning achievement that restored the nation’s confidence, turned around the Space Race, and galvanized the world. The visionary trio crossed all gender and race lines to inspire generations to dream big.[1]

In order to understand underlying and sometimes clear tensions, four main themes arise: segregation and race, gender and class, American society, and finally the IT culture. Although these themes seem clearly defined, in reality and in the film they often create complex narratives and scenes with hidden messages. Therefore, it does not make sense to discuss each theme separately, but to embrace their intersection.

The exception: education past the eighth grade

In the opening scene we see a meeting of Katherine’s parents with the principal of her school and her teacher, urging them to accept a scholarship and some money for the trip to send her to the West Virginia Collegiate Institute. In a reaction to an insult, Katherine proudly responds, “I was the first Negro female student at West Virginia University Graduate School.” [2] Starting around the turn of the century, “growing numbers of Black women had the opportunity to enter college and the professions,” but “the masses of Black women were still relegated to domestic and menial work.”[3] By 1952 62.4% of degrees from Black colleges went to women.[4] However, “Black women were caught between the two functions they were expected to fulfill: enhancing the material quality of life for their families, and at the same time behaving like housewives.”[5] Another important remark here is the fact that the three protagonists were educated and belonged to the middle-classes.  Even though the film does not mention or show the poorer classes, the women in this film do not represent American Black women in the 1960s, and their position was an exception, rather than the rule.

The East Group vs. the West Group at NASA

When the three women arrive at NASA, they go to the West Group for coloured people where the toilets are not clean, the desks put closely together, and the building blocks exposed. This stands in stark contrast to the architectural details and finishes at the East Group for White people, who get a nicely decorated office and even an armchair in the bathroom. Furthermore, Dorothy has to work a supervisor for the Coloured group, but because they are not assigning a permanent supervisor, she does not get the title or the pay. When she finds out about the construction of an IBM mainframe computer which will eventually take over the function of human “Computers”, she decides to take matters into her own hands. At the library the book on FORTRAN does not belong to the Coloured section, but before the guards can turn her out, she manages to put the book in her purse. She then teaches herself and her division all about working with the machine in order to keep their jobs at NASA, since “somewhere down the line a human being is going to have to hit the buttons.”[6]

In the meantime she gets Mary into a permanent position, and she sends Katherine to the Space Task Computer group. In a group of White men, Katherine faces discrimination on several levels. When she first enters, someone hands her the dustbins assuming she is the cleaning lady. When she puts the bin back down to go to her place, she is stared at as if she is an alien from outer space. Followed by that awkward entry, Katherine faces another challenge, since the bathroom for coloured women is 40 minutes away. After her boss confronts her about her constant absence, she bursts out:

Mr. Harris:            Now where the hell do you go every day?
Katherine:             To the bathroom, sir.
Mr. Harris:            The bathroom! To the damn bathroom! For 40 minutes a day!? What do you do in there!? We are T-minus zero here. I put a lot of faith in you.
Katherine:             There’s no bathroom for me here.
Mr. Harris:            What do you mean there’s no bathroom for you here?
Katherine:             There is no bathroom! There are no colored bathrooms in this building, or any building outside the West Campus. Which is half a mile away! Did you know that? I have to walk to Timbuktu just to relieve myself! And I can’t use one of the handy bikes. Picture that, Mr. Harrison? My uniform. Skirt below the knees and my heels. And simple string of pearls. Well, I don’t own pearls. Lord knows you don’t pay the coloreds enough to afford pearls! And I work like a dog day and night, living of coffee from a pot none of you want to touch! So, excuse me, if I have to go to the restroom a few times a day![7]

When her boss understands that the racism and discrimination is hindering her work, he personally goes to the West Wing to break down the sign reading “colored bathroom”. In front of surprised Black women he shouts “There you have it! No more colored restrooms. No more white restrooms. Just plain old toilets. Go wherever you damn well please. Preferably closer to your desk. At NASA…We all pee the same color!”[8]

Hierarchical Structures: “Fast with rocket ships. Slow with advancement.”

At NASA, there are several hierarchies, starting with Women of Colour being addressed by their first name, whereas White women and men were addressed by their last name. One finding I could not have made manually occurred to me after inserting the text in the Voyant tool.[9] Through textual analysis, it became clear that the most frequent words are Yes (71 instances) and sir (69 instances), often occurring together.[10] When talking to supervisors or other staff higher on the hierarchical ladder, others need to address them in the polite, but almost submissive “Yes Sir.”

Even middle-class and educated women were restricted to female fields, clearly demonstrated twice. Firstly, all Computers were female, and all engineers were male, accompanied by a female secretary. This restriction also shows in the tension between Mr. Stafford and Katherine twice. When Katherine arrives, one of her first jobs is to double-check Mr. Stafford’s math, which he immediately sees as an insult to his work. As a result, he makes her job difficult by crossing out all classified information, and effectively doubling her workload. Later, she has to type his reports and when she adds her name to the list of authors because she contributed, he viciously responds “Computers don’t author reports,” telling her to retype the front page.[11]

[1] “Hidden Figures,” 20th Century Fox, accessed March 16, 2017, http://www.foxmovies.com/movies/hidden-figures.

[2] “Hidden Figures,” 20th Century Fox.

[3] Paula J. Giddings, When and Where I Enter: The Impact of Black Women on Race and Sex in America (Harper Collins, 2009), 73-74.

[4] Giddings, When and Where I Enter, 235.

[5] Giddings, When and Where I Enter, 248.

[6] “Hidden Figures,” 20th Century Fox.

[7] “Hidden Figures,” 20th Century Fox.

[8] “Hidden Figures,” 20th Century Fox.

[9] “Voyant Tools,” Stéfan Sinclair and Geoffrey Rockwell, last modified 2017, voyant-tools.org.

[10] Ibid.

[11] “Hidden Figures,” 20th Century Fox.