Building Apps & Bots for Social Science Research

Chris Bail
Duke University

Part I: APPS

Salganik's list of the weaknesses of digital trace data:

 

Incomplete
Inaccessible
Non-Representative
Drifting
Algorithmic Confounding
Dirty
Sensitive

But what are the alternatives?

 

But what are the alternatives?

 

-Survey response rates continue to drop

But what are the alternatives?

 

-Survey response rates continue to drop

-Many of the most important questions require longitudinal/relational/qualitative data

But what are the alternatives?

 

-Survey response rates continue to drop

-Many of the most important questions require longitudinal/relational/qualitative data

-Digital trace data have a number of major advantages that conventional sources do not (big, always on, non-reactive)

Can we have our cake and eat it too?

Apps can Address Many Limitations

 

Incomplete
Inaccessible
Non-Representative
Drifting
Algorithmic Confounding
Dirty
Sensitive

Example: The Viralgorithm

Social Media Survey Apps (SMSAs)

 

Social Media Survey Apps (SMSAs)

 

A web or mobile-based tool built by a researcher in order to:

Social Media Survey Apps (SMSAs)

 

A web or mobile-based tool built by a researcher in order to:

a) collect public and/or private data produced by social media users from an API;

Social Media Survey Apps (SMSAs)

 

A web or mobile-based tool built by a researcher in order to:

a) collect public and/or private data produced by social media users from an API;

b) collect supplemental information from such users (e.g. demographics) using more conventional survey methods;

Social Media Survey Apps (SMSAs)

 

A web or mobile-based tool built by a researcher in order to:

a) collect public and/or private data produced by social media users from an API;

b) collect supplemental information from such users (e.g. demographics) using more conventional survey methods;

c) offer something back to the user as an incentive to share their data (e.g. analysis or financial incentives)

Social Media Survey Apps (SMSAs)

 

A web or mobile-based tool built by a researcher in order to:

a) collect public and/or private data produced by social media users from an API;

b) collect supplemental information from such users (e.g. demographics) using more conventional survey methods;

c) offer something back to the user as an incentive to share their data (e.g. analysis or financial incentives)

For additional information, see:

Bail, Christopher A. 2015. “Taming Big Data: Using App Technology to Study Organizational Behavior on Social Media.” Sociological Methods and Research: 1-29

Workflow of a Social Media Survey App

Workflow of the Viralgorithm

Response Rate

 

  1. Approximately 40% of all organizations contacted installed the app (across two fields)

Minimal Evidence of Selection