LING 388: Computers and Language. Lecture 10

Size: px

Start display at page:

Download "LING 388: Computers and Language. Lecture 10"

Daniel Burns
5 years ago
Views:

1 LING 388: Computers and Language Lecture 10

2 Administrivia Homework 4 graded Thanks to Colton Flowers for Python exercises for the last two weeks! Homework 4 Review Quick Homework 5

3 Floating point representation of!

Text Summarization Software: available on Macs (turned off by default?) Open Text Summarizer (OTS) (on Linux) The open text summarizer is an open source tool for summarizing texts.

4 Text Summarization Software: available on Macs (turned off by default?) Open Text Summarizer (OTS) (on Linux) The open text summarizer is an open source tool for summarizing texts. The program reads a text and decides which sentences are important and which are not. OTS will create a short summary or will highlight the main ideas in the text. (code: read about how it works) OTS Web interface:

5 Open Text Summarizer (ots) OTS Web interface:

6 Apple's Text Summarizer System Preferences (10.12 or 10.13) Keyboard Shortcuts Services Summarize

Human Summarization Read this article now: http://fortune.

7 Human Summarization Read this article now: Let's summarize it!

8 Elon Musk on AI

9 Elon Musk on AI

10 Open Text Summarizer (ots)

11 Apple's Text Summarizer 1. Highlight text 2. Control-click for menu

12 Apple's Text Summarizer

Quick Homework 5 due Wednesday by midnight Questions: 1. Read the following article about trepanation. http://www.bbc.com/earth/story/20160826-why-ourancestors-drilled-holes-in-each-others-skulls 2.

13 Quick Homework 5 due Wednesday by midnight Questions: 1. Read the following article about trepanation Write one or two sentences in your own words to summarize the article. 3. Run the OTS (or the Apple summarizer) on it. What does it report for 5% (1 sentence, resp.) summarization? (You should copy and paste the text in rather than use the URL.) Did it do a good job summarizing the article or not? Explain. 4. Read the How It Works (scroll down!) in Then explain whether it s plausible that a computer program could come with your sentence(s), or something similar. Source: wikipedia

14 Python: basic data types Numbers Strings Lists set(..) for loop with zip().append().extend().insert().pop() Dictionaries del.keys().values().items() - tuples (key, value)

15 Exercise 1 Enter this (1 st paragraph in "Alice's Adventures in Wonderland" by Lewis Carroll) into Python 3: paragraph1 = 'Alice was beginning to get very tired of sitting by her sister on the bank, and of having nothing to do. Once or twice she had peeped into the book her sister was reading, but it had no pictures or conversations in it, "and what is the use of a book," thought Alice, "without pictures or conversations?"' 1. len(paragraph1) counts what? 2. What does paragraph1.split() do? Store the result of split into a variable paragraph2 3. len(paragraph2) counts what? 4. Calculate the average number of characters per word

16 Exercise 2 paragraph2 ['Alice', 'was', 'beginning', 'to', 'get', 'very', 'tired', 'of', 'sitting', 'by', 'her', 'sister', 'on', 'the', 'bank,', 'and', 'of', 'having', 'nothing', 'to', 'do.', 'Once', 'or', 'twice', 'she', 'had', 'peeped', 'into', 'the', 'book', 'her', 'sister', 'was', 'reading,', 'but', 'it', 'had', 'no', 'pictures', 'or', 'conversations', 'in', 'it,', '"and', 'what', 'is', 'the', 'use', 'of', 'a', 'book,"', 'thought', 'Alice,', '"without', 'pictures', 'or', 'conversations?"'] 1. Write a for loop to print each word on a separate line Notice some words end in punctuation, e.g. bank, or do. or book," Notice some words begin in punctuation, e.g. "and or "without. Try the following: import re word = 'conversations?"' re.sub(r"[?\"'.]","",word) 2. Write a for loop to print the each word of paragraph2 (with punctuation deleted) on a separate line

17 Exercise 2 Enter this: [x.lower() for x in paragraph2] [re.sub("[?\"'.]","",x) for x in paragraph2] 3. What does this kind of for loop do? (It's called a list comprehension.)

18 Exercise 2: Examples >>>[x.lower() for x in paragraph2] ['alice', 'was', 'beginning', 'to', 'get', 'very', 'tired', 'of', 'sitting', 'by', 'her', 'sister', 'on', 'the', 'bank,', 'and', 'of', 'having', 'nothing', 'to', 'do.', 'once', 'or', 'twice', 'she', 'had', 'peeped', 'into', 'the', 'book', 'her', 'sister', 'was', 'reading,', 'but', 'it', 'had', 'no', 'pictures', 'or', 'conversations', 'in', 'it,', '"and', 'what', 'is', 'the', 'use', 'of', 'a', 'book,"', 'thought', 'alice,', '"without', 'pictures', 'or', 'conversations?"'] >>>paragraph3 = [x.lower() for x in paragraph2] >>>paragraph3 ['alice', 'was', 'beginning', 'to', 'get', 'very', 'tired', 'of', 'sitting', 'by', 'her', 'sister', 'on', 'the', 'bank,', 'and', 'of', 'having', 'nothing', 'to', 'do.', 'once', 'or', 'twice', 'she', 'had', 'peeped', 'into', 'the', 'book', 'her', 'sister', 'was', 'reading,', 'but', 'it', 'had', 'no', 'pictures', 'or', 'conversations', 'in', 'it,', '"and', 'what', 'is', 'the', 'use', 'of', 'a', 'book,"', 'thought', 'alice,', '"without', 'pictures', 'or', 'conversations?"'] >>>[re.sub("[,.?'\"]", "", x) for x in paragraph3] ['alice', 'was', 'beginning', 'to', 'get', 'very', 'tired', 'of', 'sitting', 'by', 'her', 'sister', 'on', 'the', 'bank', 'and', 'of', 'having', 'nothing', 'to', 'do', 'once', 'or', 'twice', 'she', 'had', 'peeped', 'into', 'the', 'book', 'her', 'sister', 'was', 'reading', 'but', 'it', 'had', 'no', 'pictures', 'or', 'conversations', 'in', 'it', 'and', 'what', 'is', 'the', 'use', 'of', 'a', 'book', 'thought', 'alice', 'without', 'pictures', 'or', 'conversations'] >>>[re.sub("[.,?'\"]", "",x.lower()) for x in paragraph2] ['alice', 'was', 'beginning', 'to', 'get', 'very', 'tired', 'of', 'sitting', 'by', 'her', 'sister', 'on', 'the', 'bank', 'and', 'of', 'having', 'nothing', 'to', 'do', 'once', 'or', 'twice', 'she', 'had', 'peeped', 'into', 'the', 'book', 'her', 'sister', 'was', 'reading', 'but', 'it', 'had', 'no', 'pictures', 'or', 'conversations', 'in', 'it', 'and', 'what', 'is', 'the', 'use', 'of', 'a', 'book', 'thought', 'alice', 'without', 'pictures', 'or', 'conversations'] >>>[re.sub("[.,?'\"]", "",x).lower() for x in paragraph2] ['alice', 'was', 'beginning', 'to', 'get', 'very', 'tired', 'of', 'sitting', 'by', 'her', 'sister', 'on', 'the', 'bank', 'and', 'of', 'having', 'nothing', 'to', 'do', 'once', 'or', 'twice', 'she', 'had', 'peeped', 'into', 'the', 'book', 'her', 'sister', 'was', 'reading', 'but', 'it', 'had', 'no', 'pictures', 'or', 'conversations', 'in', 'it', 'and', 'what', 'is', 'the', 'use', 'of', 'a', 'book', 'thought', 'alice', 'without', 'pictures', 'or', 'conversations'] >>>[re.sub("[.,?'\"]", "",x) for x.lower() in paragraph2] File "<stdin>", line 1 SyntaxError: can't assign to function call

Note for all these experiments it is important to observe your subject's physical eye movements.

Experiment HM-3: Electroculogram Activity (EOG) Note for all these experiments it is important to observe your subject's physical eye movements. Exercise 1: Saccades Aim: To demonstrate the type of electrical