This paper seeks to develop a process to extract causal relationship from text, for use in causal modeling. Currently there is a gap between available the requirements for causal modeling and information resources. Causal models require causal relationship information but causal relationships are difficult to produce with certainty. This usually leads to causal models being dependent on mental databases. Improved access to causal information, through text resources, would advance existing modeling and allow for greater access to causal modeling. Complex systems, like urban resilience, can be better understood through causal modeling.
Depending on the relationship type, causal and non-causal relationships can be applied to models such as Directed Graphs, Bayesian Models, and System Dynamics Models. To improve understanding and better utilize relationship extraction, relationship types and their information requirements are defined. Relationship requirements are based on three elements - relation (correlation), direction (dependence), and polarity (change relative to other variables). All three elements are required to define a causal linkage within a causal model. Methods proposed to extract relationships, both causal and non-causal, include human identification, linguistic pattern recognition, and word embedding methods. To support extraction and classification efforts, linguistic patterns were adapted to fit the requirements of causal models. While the process is intended to be independent of a particular domain, the topic of urban resilience was used as a case study for this work. Causal extraction of appropriate natural text was performed, producing explicit and implicit relationships. The resulting causal relationships were translated into causal models of various depth and focus.

Angeli, Gabor, Melvin Johnson Prekumar, and Christopher D. Manning. 2015. “Leveraging Linguistic Structure For Open Domain Information Extraction.” Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), no. 1: 344–54. doi:10.3115/v1/P15-1034.
Arup. 2012. “ASPIRE: A Sustainable Poverty and Infrastructure Routine for Evaluation.” Aspire Research And Development.
Arup. 2014a. “City Resilience Index. Research Report Volume 3 Urban Measurement Report” 3 (May).
Arup. 2014b. “Research Report Volume 1 Desk Study.” City Resilience Index. Vol. 1.
Arup. 2014c. “Research Report Volume 2 Fieldwork Data Analysis.” Arup. Vol. 2.
Arup. 2016a. “Inside the CRI : Reference Guide.”
Arup. 2016b. “Research Report Volume 4 Measuring City Resilience.” Vol. 4.
Asghar, Nabiha. 2016. “Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Survey.” arXiv Preprint.
Bach, Nguyen, and Sameer Badaskar. 2007. “A Review of Relation Extraction.” Literature Review for Language and Statistics II.
Bang-Jensen, Jørgen, and Gregory Z. Gutin. 2007. Digraphs. Springer Monographs in Mathematics. London: Springer-Verlag. doi:10.1007/978-1-84800-998-1.
Barlas, Yaman. 2002. “System Dynamics: Systemic Feedback Modeling For Policy Analysis.” In Knowledge for Sustainable Development: An Insight into the Encyclopedia of Life Support Systems. UNESCO.
Beck, Abby, and Krystyna Stave. 2012. “Understanding Urban Quality of Life and Sustainability: Model Development and Validation.” In Proceedings of the 30th International Conference of the System Dynamics Society. Vol. 0.
Bird, Steven, Ewan Klein, and Edward Loper. 2009. Natural Language Processing with Python. O’Reilly Media, Inc.
Bruijne, Mark de, Arjen Boin, and Michel van Eeten. 2010. “Resilience Exploring the Concept and Its Meanings.” In Designing Resilience. University of Pitsburgh Press.
Buckle, Philip. 2006. “Assessing Social Resilience.” In Disaster Resilience An Integrated Approach, edited by Douglas Paton and David Johnston, 88–104. Charles C Thomas.
Burton, Christopher G. 2014. “A Validation of Metrics for Community Resilience to Natural Hazards and Disasters Using the Recovery from Hurricane Katrina as a Case Study.” Annals of the Association of American Geographers 105 (1): 67–86. doi:10.1080/00045608.2014.960039.
Butnariu, Cristina, and Tony Veale. 2008. “On the Categorization of Cause and Effect in WordNet.” Afflatus.Ucd.Ie.
CARRI. 2013. “Definitions of Community Resilience.” Community and Regional Resilience Institute (CARRI).
Chang, Angel X, and Christopher D Manning. 2014. “TOKENSREGEX: Defining Cascaded Regular Expressions over Tokens.” Tech.
Cole, S.V., M.D. Royal, M.G. Valtorta, M.N. Huhns, and J.B. Bowles. 2006. “A Lightweight Tool for Automatically Extracting Causal Relationships from Text.” In Proceedings of the IEEE SoutheastCon 2006, 2006:125–29. IEEE. doi:10.1109/second.2006.1629336.
Comfort, L, B Wisner, S Cutter, R Pulwarty, K Hewitt, A. Oliver-Smith, J Wiener, M Fordham, W Peacock, and F Krimgold. 1999. “Reframing Disaster Policy: The Global Evolution of Vulnerable Communities.” Environmental Hazards 1 (1): 39–44. doi:10.3763/ehaz.1999.0105.
Cutter, Susan. 2016. “The Landscape of Disaster Resilience Indicators in the USA.” Natural Hazards 80 (2). Springer Netherlands: 741–58. doi:10.1007/s11069-015-1993-2.
Cutter, Susan, Kevin D. Ash, and Christopher T. Emrich. 2014. “The Geographies of Community Disaster Resilience.” Global Environmental Change 29. Elsevier Ltd: 65–77. doi:10.1016/j.gloenvcha.2014.08.005.
Cutter, Susan, Lindsey Barnes, Melissa Berry, Christopher Burton, Elijah Evans, Eric Tate, and Jennifer Webb. 2008. “A Place-Based Model for Understanding Community Resilience to Natural Disasters.” Global Environmental Change 18 (4): 598–606. doi:10.1016/j.gloenvcha.2008.07.013.
Cutter, Susan, Lindsey Barnes, Melissa Berry, Christopher Burton, Elijah Evans, Eric Tate, Jennifer Webb, and South Carolina. 2008. “Community and Regional Resilience: Perspectives from Hazards, Disasters, and Emergency Management.” CARRI Research Report. Vol. 1.
Cutter, Susan, B J Boruff, and W L Shirley. 2003. “Social Vulnerability to Environmental Hazards.” Social Science Quarterly 84 (2): 242–61. doi:10.1111/1540-6237.8402002.
Cutter, Susan, Christopher G. Burton, and Christopher T. Emrich. 2010. “Disaster Resilience Indicators for Benchmarking Baseline Conditions.” Journal of Homeland Security and Emergency Management 7 (1). doi:10.2202/1547-7355.1732.
Cutter, Susan , Jerry T. Mitchell, and Michael S. Scott. 2000. “Revealing the Vulnerability of People and Places: A Case Study of Georgetown County, South Carolina.” Annals of the Association of American Geographers 90 (4): 713–37. doi:10.1111/0004-5608.00219.
Durland, Maryann M. 2006. “Introduction To Social Network Analysis.” New Directions for Evaluation 12 (107): 1–13. doi:10.1002/ev.157.
Falcon, Andrea. 2015. “Aristotle on Causality.” The Stanford Encyclopedia of Philosophy. Metaphysics Research Lab, Stanford University.
Fitzgibbon, Catherine, Yuko Karauchi, Francis Opiyo, and Courtenay Cabot Venton. 2014. “Building Disaster Resilience for Sustainable Human Development.”
Ford, Andrew. 2010. Modeling the Environment. 2nd ed. Washington D.C.: Island Press.
Forrester, Jay W. 1994. “Learning through System Dynamics as Preparation for the 21st Century by.” Social Change 10 (2–3): 1–22. doi:10.1002/sdr.4260100211.
Forrester, Jay W. 1969. Urban Dynamics. MIT Press.
Forrester, Jay W. 1971. “Counterintuitive Behavior of Social Systems.” Simulation 16 (3): 61–76. doi:10.1177/003754977101600202.
Forrester, Jay W. 1992. “Policies, Decisions and Information Sources for Modeling.” European Journal of Operational Research 59 (1): 42–63. doi:10.1016/0377-2217(92)90006-U.
Gallopín, Gilberto C. 2006. “Linkages between Vulnerability, Resilience, and Adaptive Capacity.” Global Environmental Change 16 (3): 293–303. doi:10.1016/j.gloenvcha.2006.02.004.
Girju, Roxana. 2003. “Automatic Detection of Causal Relations for Question Answering.” In Proceedings of the ACL 2003 Workshop on Multilingual Summarization and Question Answering -, 12:76–83. Morristown, NJ, USA: Association for Computational Linguistics. doi:10.3115/1119312.1119322.
Girju, Roxana, and Dan Moldovan. 2002. “Text Mining for Causal Relations.” In Proceedings of the FLAIRS Conference, 360–364.
Granger, C. W. J. 1980. “Testing for Causality. A Personal Viewpoint.” Journal of Economic Dynamics and Control 2 (C): 329–52. doi:10.1016/0165-1889(80)90069-X.
Hanneman, Robert a, and Mark Riddle. 2005. Introduction to Social Network Methods. Riverside, CA: University of California, Riverside. On-Line Textbook. doi:10.1016/j.socnet.2006.08.002.
Hartmann, Alexander K, and Martin Weigt. 2006. “Introduction to Graphs.” Phase Transitions in Combinatorial Optimization Problems: Basics, Algorithms and Statistical Mechanics, February, 25–67.
Hidalgo, Daniel, and Jasjeet S Sekhon. 2011. “Causality.” International Encyclopedia of Political Science, no. 1751: 204–11. doi:10.4135.
Hitchcock, Christopher. 2006. “Probabilistic Causation.” The Stanford Encyclopedia of Philosophy. doi:10.1111/1467-9973.00225.
Holling, C. S. 1973. “Resilience and Stability of Ecological Systems.” Annual Review of Ecology and System Systems 4 (1973): 1–23. doi:10.1146/annurev.es.04.110173.000245.
IFRC. 2012. “Characteristics of a Safe and Resilient Community: Community Based Disaster Risk Reduction Study.” ARUP International Development. doi:1224200 E.
IPCC. 2014. Climate Change 2014: Synthesis Report. In Contribution of Working Groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. Geneva, Switzerland: IPCC.
Ittoo, Ashwin, and Gosse Bouma. 2011. “Extracting Explicit and Implicit Causal Relations from Sparse , Domain-Specific Texts.” In Application of Natural Language to Information Systems, 52–63. Springer Berlin Heidelberg.
Jurafsky, Dan. 2012. “Introduction to NLP.” Stanford University.
Kennedy, C., S. Pincetl, and P. Bunje. 2011. “The Study of Urban Metabolism and Its Applications to Urban Planning and Design.” Environmental Pollution 159 (8–9). Elsevier Ltd: 1965–73. doi:10.1016/j.envpol.2010.10.022.
Khoo, C. S. G., J. Kornfilt, R. N. Oddy, and S. H. Myaeng. 1998. “Automatic Extraction of Cause-Effect Information from Newspaper Text Without Knowledge-Based Inferencing.” Literary and Linguistic Computing 13 (4): 177–86. doi:10.1093/llc/13.4.177.
Khoo, C S G. 1995. “Automatic Identification of Causal Relations in Text and Their Use for Improving Precision in Information Retrieval.” Syracuse University.
Kleinberg, Samantha. 1996. “Inferring Causality.” In Causality, Probability, and Time, 11:111–41. Cambridge: Cambridge University Press. doi:10.1017/CBO9781139207799.005.
Kleinberg, Samantha. 2016a. “A Brief History of Causality.” In Causality, Probability, and Time, 11–42. Cambridge: Cambridge University Press. doi:10.1017/CBO9781139207799.002.
Kleinberg, Samantha. 2016b. “Defining Causality.” In Causality, Probability, and Time, 65–110. Cambridge: Cambridge University Press. doi:10.1017/CBO9781139207799.004.
Lee Rodgers, Joseph, and W Alan Nicewander. 1988. “Thirteen Ways to Look at the Correlation Coefficient.” The American Statistician 42 (1): 59–66.
Levy, Omer, Yoav Goldberg, and Ido Dagan. 2015. “Leveraging Linguistic Structure For Open Domain Information Extraction.” Transactions of the Association for Computational Linguistics 3: 211–25. doi:10.1186/1472-6947-15-S2-S2.
Manning, Christopher. 2012. “Informaton Extraction and Named Entity Recognition.” Stanford University.
Manning, Christopher, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven Bethard, and David McClosky. 2014. “The Stanford CoreNLP Natural Language Processing Toolkit.” In Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 55–60. doi:10.3115/v1/P14-5010.
Manuel-Navarrete, David, José Javier Gómez, and Gilberto Gallopín. 2007. “Syndromes of Sustainability of Development for Assessing the Vulnerability of Coupled Human-Environmental Systems. The Case of Hydrometeorological Disasters in Central America and the Caribbean.” Global Environmental Change 17 (2): 207–17. doi:10.1016/j.gloenvcha.2006.07.002.
Manyena, Siambabala Bernard. 2006. “The Concept of Resilience Revisited.” Disasters 30 (4): 433–50. doi:10.1111/j.0361-3666.2006.00331.x.
Meadows, D. H. 2009. Thinking in Systems: A Primer. Edited by Diana Wright. London: Earthscan.
Meadows, D. H., Dennis L. Meadows, Jorgen Randers, and William W. Behrens III. 1972. The Limits to Growth. Universe Books.
Meerow, Sara, Joshua P. Newell, and Melissa Stults. 2016. “Defining Urban Resilience: A Review.” Landscape and Urban Planning 147. Elsevier B.V.: 38–49. doi:10.1016/j.landurbplan.2015.11.011.
Merriam-Webster. 2017. “Cause, Correlation, Causality, Explicit, Implicit.” Merriam-Webster. https://www.merriam-webster.com/dictionary.
Michel, Jean-baptiste, Yuan Kui Shen, Aviva Presser Aiden, Adrian Veres, Matthew K Gray, The Google Books, Joseph P Pickett, et al. 2010. “Quantitative Analysis of Culture Using Millions of Digitized Books,” no. December. doi:10.1126/science.1199644.
Mikolov, Tomas, Greg Corrado, Kai Chen, and Jeffrey Dean. 2013. “Efficient Estimation of Word Representations in Vector Space.” Proceedings of the International Conference on Learning Representations (ICLR 2013), 1–12. doi:10.1162/153244303322533223.
Mu, Jiaqi, Suma Bhat, and Pramod Viswanath. 2017. “All-but-the-Top: Simple and Effective Postprocessing for Word Representations,” February.
NIST. 2015a. “Community Resilience Planning Guide for Buildings and Infrastructure Systems: Volume I.” National Institute of Standards and Technology. doi:10.6028/NIST.SP.1190v1.
NIST. 2015b. “Community Resilience Planning Guide for Buildings and Infrastructure Systems : Volume II.” National Institute of Standards and Technology doi:10.6028/NIST.SP.1190v2.
Norris, Fran H., Susan P. Stevens, Betty Pfefferbaum, Karen F. Wyche, and Rose L. Pfefferbaum. 2008. “Community Resilience as a Metaphor, Theory, Set of Capacities, and Strategy for Disaster Readiness.” American Journal of Community Psychology 41 (1–2): 127–50. doi:10.1007/s10464-007-9156-6.
Oliver-Smith, Anthony. 1999. “‘What Is a Disaster?’: Anthropological Perspectives on a Persistent Question.” In The Angry Earth: Disaster in Anthropological Perspective, edited by Anthony Oliver-Smith and Susanna M. Hoffman, 18–34.
Özesmi, Uygar, and Stacy L Özesmi. 2004. “Ecological Models Based on People’s Knowledge: A Multi-Step Fuzzy Cognitive Mapping Approach.” Ecological Modelling 176 (1–2): 43–64. doi:10.1016/j.ecolmodel.2003.10.027.
Pearl, Judea. 2000. Causality. 1st ed. Cambridge University Press.
Pearl, Judea. 2009. Causality: Models,Reasoning, and Inference. Second. New York, NY: Cambridge University Press.
Pennington, Jeffrey, Richard Socher, and Christopher D Manning. 2014. “GloVe: Global Vectors for Word Representation.” Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 1532–43. doi:10.3115/v1/D14-1162.
Rink, Bryan, Cosmin Adrian Bejan, and Sanda Harabagiu. 2010. “Learning Textual Graph Patterns to Detect Causal Event Relations.” In Artificial Intelligence, 265–70.
Ritchey, Tom. 2012. “Outline for a Morphology of Modelling Methods: Contribution to a General Theory of Modelling.” Acta Morphologica Generalis AMG 1 (1): 1–20.
Rong, Xin. 2014. “word2vec Parameter Learning Explained.”
Sharifi, Ayyoob. 2016. “A Critical Review of Selected Tools for Assessing Community Resilience.” Ecological Indicators 69. Elsevier Ltd: 629–47. doi:10.1016/j.ecolind.2016.05.023.
Sherrieb, Kathleen, Fran H. Norris, and Sandro Galea. 2010. “Measuring Capacities for Community Resilience.” Social Indicators Research 99 (2): 227–47. doi:10.1007/s11205-010-9576-9.
Speer, Robert, and Joanna Lowry-Duda. 2017. “ConceptNet at SemEval-2017 Task 2: Extending Word Embeddings with Multilingual Relational Knowledge,” April.
Sterman, John D. 1994. “Learning in and about Complex Systems.” System Dynamics Review 10 (2–3): 291–330. doi:10.1002/sdr.4260100214.
Sterman, John D. 2002a. “All Models Are Wrong: Reflections on Becoming a Systems Scientist.” System Dynamics Review 18 (4): 501–31. doi:10.1002/sdr.261.
Sterman, John D. 2002b. Business Dynamics: Systems Thinking and Modeling for a Complex World. McGraw-Hill Higher Education. Print
Thomson, Jarvis. 1987. “Verbs of Action.” Synthese 72: 103–22.
UNISDR. 2015. “Sendai Framework for Disaster Risk Reduction 2015-2030 Contents.” The United Nations Office for Disaster Risk Reduction. doi:A/CONF.224/CRP.1.
United Nations. 2014. World Urbanization Prospects: The 2014 Revision, Highlights (ST/ESA/SER.A/352). New York, United. doi:10.4054/DemRes.2005.12.9.
United Nations. 2015. “The Millennium Development Goals Report.” United Nations. doi:978-92-1-101320-7.
Wisner, Ben, Piers Blaikie, Terry Cannon, and Ian Davis. 1994. AT RISK. 2nd ed. Abingdon, UK: Taylor & Francis.
Yates, A., M. Cafarella, M. Banko, O. Etzioni, M. Broadhead, and S. Soderland. 2007. “TextRunner: Open Information Extraction on the Web.” In , 25–26. Association for Computational Linguistics.
Zeng, Daojian, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. 2014. “Relation Classification via Convolutional Deep Neural Network.” In 25th International Conference on Computational Linguistics, 2335–44. Dublin.
Zhang, CE. 2015. “DeepDive: A Data Management System for Automatic Knowledge Base Construction.” UNIVERSITY OF WISCONSIN–MADISON.