Automating Open Source Intelligence: Algorithms for OSINT

Front Cover
Syngress, Dec 3, 2015 - Computers - 222 pages

Algorithms for Automating Open Source Intelligence (OSINT) presents information on the gathering of information and extraction of actionable intelligence from openly available sources, including news broadcasts, public repositories, and more recently, social media. As OSINT has applications in crime fighting, state-based intelligence, and social research, this book provides recent advances in text mining, web crawling, and other algorithms that have led to advances in methods that can largely automate this process.

The book is beneficial to both practitioners and academic researchers, with discussions of the latest advances in applications, a coherent set of methods and processes for automating OSINT, and interdisciplinary perspectives on the key problems identified within each discipline.

Drawing upon years of practical experience and using numerous examples, editors Robert Layton, Paul Watters, and a distinguished list of contributors discuss Evidence Accumulation Strategies for OSINT, Named Entity Resolution in Social Media, Analyzing Social Media Campaigns for Group Size Estimation, Surveys and qualitative techniques in OSINT, and Geospatial reasoning of open data.

  • Presents a coherent set of methods and processes for automating OSINT
  • Focuses on algorithms and applications allowing the practitioner to get up and running quickly
  • Includes fully developed case studies on the digital underground and predicting crime through OSINT
  • Discusses the ethical considerations when using publicly available online data
 

Contents

Chapter 1 The Automating of Open Source Intelligence
1
Chapter 2 Named Entity Resolution in Social Media
21
Chapter 3 Relative Cyberattack Attribution
37
Chapter 4 Enhancing Privacy to Defeat Open Source Intelligence
61
Corporate Patterns and Practices
79
A Study of the Digital Underground
89
Application to Social Data
103
Chapter 8 Ethical Considerations When Using Online Datasets for Research Purposes
131
Understanding the Question Not the Answer
159
Chapter 10 Geospatial Reasoning With Open Data
171
Subject Index
205
Back Cover
213
Copyright

Other editions - View all

Common terms and phrases

About the author (2015)

Dr. Robert Layton is a Research Fellow at the Internet Commerce Security Laboratory (ICSL) at Federation University Australia. Dr Layton’s research focuses on attribution technologies on the internet, including automating open source intelligence (OSINT) and attack attribution. Dr Layton’s research has led to improvements in authorship analysis methods for unstructured text, providing indirect methods of linking profiles on social media.

Paul A. Watters is a Professor of Information Technology at Massey University. He was previously Associate Professor of Information Security at the University of Ballarat, and co-founded the Cybercrime Research Laboratory at Macquarie University. His research interests are human factors in security and open source intelligence, and in measuring the risks associated with cybercrime, especially to children and young people. He is a Fellow of the British Computer Society and his work has been cited 1,249 times He has worked closely with government and industry on many projects, including Westpac, IBM, and the Australian Federal Police (AFP).