Coke vs. Pepsi vs. Humans at Double Fine

Last week, Double Fine Productions was host to a critical scientific research event. It was documented by programmer Brandon Dillon. Here are his findings.


Abstract
Many humans claim to have a preference between the soft drinks Coca-Cola® and Pepsi-Cola® (hereafter referred to as Coke and Pepsi). We conducted an experiment on humans in the employ of Double Fine Productions to look for evidence that humans are even capable of distinguishing between the two sodas.


Hypothesis
Participant convictions towards their capacity for soda differentiation will be consistently strong, but will not be borne out by empirical trials. In layman’s terms, everyone is full of crap.


Experimental Apparatus
Analysis proceeded via a double-blind taste test.

Two eight-packs of 8-oz cans of Coke and Pepsi were purchased from a local grocery store and refrigerated side-by-side in Double Fine’s drink refrigerator for a period of 24 hours.


An image from the Double Fine archive.


The trials were run by two experimenters.

The first experimenter labeled five otherwise unmarked cups A-E. The experimenter then flipped a fair coin and recorded the results of the flip. For each corresponding “head” flip, a finger of Coke was poured into one cup; Pepsi was poured for each tail. Precise measuring tools were not necessary because the experimenter has a master bartender’s pour.


An image from the Double Fine archive.


The trial setup was done in a room separate to the other experimenter and all trial participants. To heighten the quality of the experiment, the room featured dimly lit mood lighting and a large collection of rad black velvet paintings.

Once a trial was prepared, the other experimenter was called in, transferred the five glasses to the testing chamber (known colloquially as “the lunch room”) and administered the test to a participant.


An image from the Double Fine archive.


Participants were free to approach the tasting via means of their choosing for any length of time.

Techniques chosen by participants included judging exclusively by smell, drinking carbonated water as a palette cleanser between sips, and a number of different wine tasting-derived swirling motions.


An image from the Double Fine archive.


Participants would then record which product they believed were contained in each cup. Some participants chose to place question marks (?) next to guesses to express a lower relative confidence level of a given claim.


Results and Analysis


Trial configurations:

Trial Cup A Cup B Cup C Cup D Cup E
1 Coke Coke Pepsi Pepsi Coke
2 Pepsi Pepsi Pepsi Pepsi Coke
3 Pepsi Pepsi Coke Coke Pepsi
4 Pepsi Pepsi Pepsi Coke Coke
5 Pepsi Coke Pepsi Pepsi Pepsi
6 Pepsi Coke Pepsi Coke Pepsi
7 Pepsi Pepsi Coke Pepsi Coke
8 Coke Pepsi Coke Coke Pepsi
9 Pepsi Pepsi Coke Coke Pepsi


Participant survey results:

Trial Participant Cup A Cup B Cup C Cup D Cup E
1 Gabe Cinquepalmi Coke Coke Pepsi Coke? Coke
2 Jeremy Natividad Pepsi Coke Coke Pepsi Coke
3 Kjeld Pedersen Pepsi Coke Coke Pepsi Coke
4 Ray Crook Pepsi Coke Coke Pepsi Pepsi
5 Patrick Hackett Pepsi Pepsi Coke Coke Pepsi
6 Paul Du Bois Pepsi Coke Coke Pepsi Pepsi
7 Dan McGarry Coke Coke Coke Pepsi Pepsi
8 Drew Skillman Coke? Coke? Coke? Pepsi? Pepsi?
9 Matt Hansen Coke Coke Pepsi Coke Coke


All participants expressed confidence in their ability to distinguish brands prior to trials.

No single participant correctly guess every cup’s contents in their trial.

Furthermore, no participant incorrectly guessed every cup’s contents. This result would correlate with the ability to effectively distinguish between the products, despite an ability to correctly assign differentiated tastes, which would have been evidence in opposition to the hypothesis. That is to say, a participant who incorrectly guessed every single cup’s contents would still have consistently identified a difference between the two products.


An image from the Double Fine archive.


Participants offered excuses including the following (not an exhaustive list):
• “I could definitely distinguish the first two, but then the flavors mixed too much in my mouth.”
• “I’m sure I could’ve done it if I had a reference can of Coke or Pepsi with me while doing the trial.”
• “If I keep practicing, I can get good enough to tell the difference.”
• “I went to the dentist this morning and the fluoride is messing with my taste buds.”

The most successful participant was Gabe Cinquepalmi, who correctly analyzed all cups but one, and expressed less confidence in his single incorrect answer.


Conclusion
Gabe Cinquepalmi is not human.