How I Data Mined My Text Message History

By: Joe CannattiPuppy Sound LLCjoe@puppysound.com@JoeCannatti

Friday, January 18, 13

How I Data Mined My Text Message History

By: Joe CannattiPuppy Sound LLCjoe@puppysound.com@JoeCannatti

Friday, January 18, 13

Know thyself...

Friday, January 18, 13

Know thyself...

Friday, January 18, 13

Know thyself...

γνῶθι σεαυτόν

Friday, January 18, 13

Know thyself...

γνῶθι σεαυτόν

Temple of Apollo at Delphi

Friday, January 18, 13

Know thyself...

γνῶθι σεαυτόν

Temple of Apollo at Delphi

Plato

Friday, January 18, 13

Know thyself...

γνῶθι σεαυτόν

Temple of Apollo at Delphi

Plato

Our memories are poor

Friday, January 18, 13

Know thyself...

γνῶθι σεαυτόν

Temple of Apollo at Delphi

Plato

Our memories are poor

We are not good at summing up our experiences

Friday, January 18, 13

Know thyself...

γνῶθι σεαυτόν

Temple of Apollo at Delphi

Plato

Our memories are poor

We are not good at summing up our experiences

Enter.....DATA

Friday, January 18, 13

Text Messages

Friday, January 18, 13

Text Messages

Increased use

Friday, January 18, 13

Text Messages

Increased use

Is it a good subset of your overall communication?

Friday, January 18, 13

Text Messages

Increased use

Is it a good subset of your overall communication?

What can we learn from it?

Friday, January 18, 13

Text Messages

Increased use

Is it a good subset of your overall communication?

What can we learn from it?

SCIENCE!!!

Friday, January 18, 13

Tools Used

Friday, January 18, 13

Tools Used

R

Friday, January 18, 13

Tools Used

R

RStudio

Friday, January 18, 13

Tools Used

R

RStudio

Navicat for Sqlite

Friday, January 18, 13

Tools Used

R

RStudio

Navicat for Sqlite

Bash

Friday, January 18, 13

So, what are we going to do?

Friday, January 18, 13

iTunes backup

Backup your phone to your machine (unencrypted)

Friday, January 18, 13

Where dem bitz at?

~/Library/Application Support/MobileSync/Backup/

3d0d7e5fb2ce288813306e4d4636395e047a3d2

Friday, January 18, 13

Hmmm...what else is in there?

Bash to the rescuefind . -name \*3d0d7e5fb2ce288813306e4d4636395e047a3d2\*

for i in $(find . -type f); do sqlite3 $i ".databases" &> /dev/null; if [[ $? == "0" ]]; then echo $i; fi; done

190 sqlite DBs

Friday, January 18, 13

Bash Fu

Friday, January 18, 13

Getting ready to open the project

Download the RSQLite .tar.gz

R CMD INSTALL RSQLite-<version>.tar.gz

install.packages(‘DBI’)

Friday, January 18, 13

Tables

Friday, January 18, 13

Our main view

Friday, January 18, 13

Adding Contact data

Friday, January 18, 13

A note about R

Friday, January 18, 13

A note about R

Friday, January 18, 13

Problems with the Language

Friday, January 18, 13

Problems with the Language

Friday, January 18, 13

Problems with the Language

ANY APL OR J PROGRAMMERS HERE?

Friday, January 18, 13

My besties

Friday, January 18, 13

Result

MY BABY MOMA

Friday, January 18, 13

Result

MY BABY MOMA

Friday, January 18, 13

Result

MY BABY MOMAMARK G’S GIRL

Friday, January 18, 13

Friday, January 18, 13

Friday, January 18, 13

HISTORGRAMS CAN BE PRETTY WACK

Friday, January 18, 13

THE FREEDMAN-DIACOIS RULE

HISTORGRAMS CAN BE PRETTY WACK

Friday, January 18, 13

THE FREEDMAN-DIACOIS RULE

HISTORGRAMS CAN BE PRETTY WACK

Friday, January 18, 13

Friday, January 18, 13

Demo Frequency

Friday, January 18, 13

Our main Data.Frame

Friday, January 18, 13

colnames(message_data)

Friday, January 18, 13

Codez

Friday, January 18, 13

Text Frequency By Month

Friday, January 18, 13

Demo send/receive

Friday, January 18, 13

Friday, January 18, 13

Saving to a file

Friday, January 18, 13

Let Talk About Sex

Friday, January 18, 13

Let Talk About SexGET YOUR MIND OUT OF

THE GUTTER!!!

Friday, January 18, 13

Friday, January 18, 13

Friday, January 18, 13

R?

Friday, January 18, 13

R

Friday, January 18, 13

Friday, January 18, 13