Language models that stimulate creativity. by Matthew Huebert

Transcription

1 Language models that stimulate creativity by Matthew Huebert

2

3 BrainTripping

4

5

6

7

8

9

10

11

12

13 Building BrainTripping + Lessons Learned + Observations

14 makin brains

15

16

17

18

19

20

21

22

23

24

25

26

27

28 Corpus Length Dr. Seuss Justin Bieber Jesus Christ Paris Hilton Queen Elizabeth II Kurt Cobain Rihanna Mother Teresa Steve Jobs Beethoven Donald Trump Stephen Hawking Lil Wayne Charles Darwin Helen Keller Sarah Palin Pope Benedict XVI Tupac Shakur Albert Einstein Maya Angelou Jane Goodall Mitt Romney George Bush Paul Graham Condoleeza Rice Dr. Phil Chairman Mao Friedrich Nietzsche Bill Gates Edgar Allan Poe Stephen Colbert L. Ron Hubbard Jane Austen Barack Obama Sigmund Freud Shakespeare Kim Jong Il Vocabulary size Authors are listed in order of corpus length

29 Corpus Length Dr. Seuss Justin Bieber Jesus Christ Paris Hilton Queen Elizabeth II Kurt Cobain Rihanna Mother Teresa Steve Jobs Beethoven Donald Trump Stephen Hawking Lil Wayne Charles Darwin Helen Keller Sarah Palin Pope Benedict XVI Tupac Shakur Albert Einstein Maya Angelou Jane Goodall Mitt Romney George Bush Paul Graham Condoleeza Rice Dr. Phil Chairman Mao Friedrich Nietzsche Bill Gates Edgar Allan Poe Stephen Colbert L. Ron Hubbard Jane Austen Barack Obama Sigmund Freud Shakespeare Kim Jong Il Musicians

30 Corpus Length Dr. Seuss Justin Bieber Jesus Christ Paris Hilton Queen Elizabeth II Kurt Cobain Rihanna Mother Teresa Steve Jobs Beethoven Donald Trump Stephen Hawking Lil Wayne Charles Darwin Helen Keller Sarah Palin Pope Benedict XVI Tupac Shakur Albert Einstein Maya Angelou Jane Goodall Mitt Romney George Bush Paul Graham Condoleeza Rice Dr. Phil Chairman Mao Friedrich Nietzsche Bill Gates Edgar Allan Poe Stephen Colbert L. Ron Hubbard Jane Austen Barack Obama Sigmund Freud Shakespeare Kim Jong Il Politicians

31

32

33

34 portraits

35

36 Scott McLeod

37 Scott McLeod Devoir-de-Philosophie.com Copyright 2010 Creators Syndicate

38 Keith Kasnot / National Geographic Image Collection [left] The Unit of Art in Medicine/The University of Manchester [right] BBC Photo Library

39 Keith Kasnot / National Geographic Image Collection [left] The Unit of Art in Medicine/The University of Manchester [right] BBC Photo Library

40 suggestion algorithm

41 Zipf s Law

42 Zipf s Law

43 Zipf s Law High Frequency glue words Low Frequency unexpected, random

44

45 speed

46 10 seconds Speed of Word Lookup

47 Speed of Word Lookup 10 seconds read; synthesize; produce

48 Speed of Word Lookup 10 seconds 100 milliseconds read; synthesize; produce

49 Speed of Word Lookup 10 seconds 100 milliseconds read; synthesize; produce real-time interaction

50 Shared Authorship user algorithm source author

51 Anonymity yellow_frog_1982 Real Identity Matthew Huebert

52 Anonymity yellow_frog_1982 Real Identity Matthew Huebert Mask Matt tripping on Freud

53 Mask

54 intuition for data

55 In a cave in Kartoom lives a beast called the Natch

56 In a cave in Kartoom lives a beast called the Natch In a cave in Kartoom lives a beast called the Natch

57 In a cave in Kartoom lives a beast called the Natch In a cave in Kartoom lives a beast called the Natch 3 7 In 1 a 2 cave beast called the Natch 4 6 Kartoom 5 lives

58 One fish, two fish, red fish, blue fish.

59 One fish, two fish, red fish, blue fish. One 1 fish 2 two 3 fish 4 red 5 fish 6 blue 7 fish

60 One fish, two fish, red fish, blue fish. One 1 fish 2 two 3 fish 4 red 5 fish 6 blue 7 fish One 1 two 2 red fish 6 7 blue

61

62

63 Implementation

64 speed (developer, response time) simplicity Heroku (managed servers, simple to scale) Node.js (same language on client and server) In-memory language models

65 human process

66 Hacking BrainTripping Node.js hackathon in Montréal Hisako, Gina Cook, Brian Doherty, Mary Ellen Cathcart, Jon Volkmar, Martin Provencher, Jeff Marshall

67 Experiment Quickly PITCH HACK PRESENT

68 Thanks! BrainTripping.com Matthew

69 Future Structured creative writing: constrain and suggest Foreign language training wheels