syntax of international frame building - wouter van...

32

Upload: others

Post on 10-Mar-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Syntax of International Frame Building

Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

28 March 2014

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 2: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Theory

International Frame Building

� Contest over frames as part of international con�ict

� Parties try to in�uence media coverage in third countries

� Can we measure e�ect of mediated public diplomacy?

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 3: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Theory

Measuring framing

� Frames essentially relations between concepts

� "Hamas caused the problem by attacking civilians"� "Georgia violated the status quo by invading Ossetia"

� Dictionary approaches fail in con�ict situation

� no distinction between attacker and attacked

� Can we use syntactic information?

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 4: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Determining Prefered Framing

� Actors try to push their 'prefered' framing

� What are these frames?

� Inductive / qualitative analysis of subjective messsages

� Speeches: Georgia, Russia (on Ossetia), US (on Iraq)� Internal messages: Israel (on Gaza)

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 5: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Georgian vocabulary

word pos georgia russia chiGeorgia N 287 44 88.05world N 94 11 34.39government N 57 2 30.41Russians N 38 0 23.56freedom N 35 0 21.7European A 40 2 19.97society N 33 1 17.96tanks N 36 2 17.53should V 68 13 16.94democracy N 27 0 16.74free A 25 0 15.5

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 6: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Russian Vocabularyword pos georgia russia chiOssetia N 28 72 48.34peacekeepers N 6 38 43.17citizens N 8 37 36.88principles N 3 26 32.46states N 5 26 27.33cooperation N 3 21 24.66SCO N 0 15 24.22case N 5 22 21.38Kosovo N 2 17 21.11recognize V 1 15 20.87agreements N 2 16 19.55genocide N 0 12 19.38

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 7: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Russian Speeches

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 8: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Georgian Speeches

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 9: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Russian topics

cooperation Armed Ossetia course Meetingstates thank peacekeepers case courseSCO Forces citizens Kosovo ensureOrganisation achieved principles relations consequencesrelations comrades humanitarian recognize problems

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 10: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Georgian topics

whole Georgia ethnic Europe police's was cleansing democracy planningget were invasion society PutinGori world Davitashvili civilized airtimes had minister free had

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 11: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Gaza: Israel's framing

1 Problem de�nition:

� Hamas �res rockets and causes harm to Israeli civilians.

2 Moral justi�cation:

� Hamas is a terrorist organization.

3 Solution: goals:

� Stop the rocket attacks� Dismantle Hamas' terror infrastructure

4 Solution: means:

� Israeli military operation in Gaza

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 12: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Ossetia: Russian framing1 Problem de�nition:

� There is a humanitarian crisis in South Ossetia� Citizens and peasekeepers in Ossetia are under attack� Georgia is a threat to the whole Caucasus region� Georgian leaders have de�ed agreements

2 Moral justi�cation:� Georgian is barbaric, commits genocide

3 Solution: goals:� Georgia must cease �re and withdraw� Russia will protect its citizens in Ossetia� Ossetians should decide for themselves

4 Solution: means:� Russian military operation as a solution� Russia will supply whatever help necessary

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 13: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Ossetia: Georgian framing1 Problem de�nition:

� Russia invaded and is illegally annexing� Russia is a threat to all small countries in the region.

2 Moral justi�cation:� Russia's brutal actions caused a humanitarian crisis� Russia is committing ethnic cleansing in South Ossetia� Georgia is a liberal European democracy, Russia is a

dictatorship

3 Solution: goals:� Russia must withdraw immediately� Georgia's must keep territorial integrity and statehood� Georgia needs to protect all ethnic groups

4 Solution: means:� The international community must support Georgia

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 14: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Framing International Con�ict (qualitative analysis)

Iraq: American framing

1 Problem de�nition:

� Saddam is a threat to the US, its allies and the region.

2 Moral justi�cation:

� Saddam is an evil dictator who represses his own people� Saddam can't be trusted

3 Solution: goals:

� Disarming Saddam from weapons of mass destruction� Freeing the Iraqi people from Saddam's rule� Building a democratic regime in Iraq

4 Solution: means:

� International pressure to make Saddam disarm� If diplomatic e�orts fail � entering Iraq by force

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 15: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Generalizing frames as patterns on a Semantic Network

Frames as Patterns

� Text expresses a semantic network

� Who does what to whom (according to whom)?

� Frames can be generalized as patterns in semanticnetwork

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 16: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Generalizing frames as patterns on a Semantic Network

Function Semantic Role Use of Framing

Subject Predicate Object R. G. Iq. Il.

1. Problem de�nition

opp. attacks citizens x x x xopp. attacks me x x x

2. Moral justi�cation

opp. is/does evil x x x3. Solution: goals

opp. stop x x xopp. disarm x x

3. Solution: means

me attack opp. x x xint'l pressure opp. x x

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 17: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Automatic Semantic Network Analysis: pipeline

General setup

1 Parsing with Stanford CoreNLP

2 Add argument patterns from FrameNET using Semafor

3 Identify actors/concepts using dictionary (+coreference)

4 Identify semantic roles using transformation rules

5 Extract frames

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 18: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Automatic Semantic Network Analysis: pipeline

RUSSIA has promised to begin pulling its troops out ofGeorgia at midday today.

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 19: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Automatic Semantic Network Analysis: pipeline

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 20: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Automatic Semantic Network Analysis: pipeline

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 21: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Automatic Semantic Network Analysis: pipeline

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 22: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Automatic Semantic Network Analysis: pipeline

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 23: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Additional examples

Russia's Deputy Foreign Minister Grigory Karasin said morethan 2,000 people have been killed in South Ossetia sinceFriday, most of them Ossetians with Russian passports.

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 24: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Additional examples

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 25: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Additional examples

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 26: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Additional examples

Their only credible truth was that Saddam was a brutal despotwho tortured his ethnic majorities of Shiites and Kurds.

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 27: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Additional examples

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 28: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Technical Details and Validation

Technical Details

� All steps implemented as graph transformations

� O� the shelf modules

� Stanford CoreNLP parser + coreference� Semafor semantic tagger� Fuseki SPARQL engine

� 'Glue' Source code available

� http://github.com/vanatteveldt/xtas

� http://github.com/vanatteveldt/syntaxrules

� Rule �les available on request, will be published aftervalidation

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 29: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Technical Details and Validation

Validation: Israel (earlier project)

F1 Cohen Kripp.Frame Prec. Recall Score κ α

Problem def. 0.94 0.74 0.83 0.79 0.79Means 0.79 0.65 0.71 0.58 0.58Goals 0.88 0.70 0.78 0.76 0.76Evaluation 0.75 0.75 0.75 0.74 0.74

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 30: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Technical Details and Validation

Sunstantive outcome: Israel (earlier project)

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 31: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Conclusion

Conclusion

� Overlaps in prefered framing of di�erent con�icts

� Framing functions can be de�ned as patterns on semanticnetwork

� Semantic Network can be extracted automatically

� Next steps:

� Validation� Substantive analysis

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav

Page 32: Syntax of International Frame Building - Wouter van Atteveldtvanatteveldt.com/wp-content/uploads/2014_vanatteveldt... · 2014. 9. 27. · 3 Identify actors/concepts using dictionary

International Frame Building Framing Con�ict Automatic SNA Conclusion

Conclusion

Thanks

� Paper/presentation available from:

� http://vanatteveldt.com/

� Source code available from:

� http://github.com/vanatteveldt/xtas

� http://github.com/vanatteveldt/syntaxrules

Syntax of International Frame Building Wouter van Atteveldt, Tamir Sheafer, Shaul Shenhav