awesome-osint/README.md
2022-04-29 10:52:31 -04:00

108 KiB
Executable File
Raw Blame History

Awesome OSINT Awesome

A curated list of amazingly awesome open source intelligence tools and resources. Open-source intelligence (OSINT) is intelligence collected from publicly available sources. In the intelligence community (IC), the term "open" refers to overt, publicly available sources (as opposed to covert or clandestine sources)

📖 Table of Contents

Contributing

Please read CONTRIBUTING if you wish to add tools or resources.

Credits

This list was taken partially taken from i-inteligence's OSINT Tools and Resources Handbook.

Thanks to our main contributors jivoi EK_ spmedia

The main search engines used by users.

Main National Search Engines

Localized search engines by country.

Lesser known and used search engines.

Specialty Search Engines

Search engines for specific information or topics.

Visual Search and Clustering Search Engines

Search engines that scrape multiple sites (Google, Yahoo, Bing, Goo, etc) at the same time and return results.

  • Carrot2 - Organizes your search results into topics.
  • Yippy - Search using multiple sources at once

Find websites that are similar. Good for business competition research.

Search for data located on PDFs, Word documents, presentation slides, and more.

Search for all kind of files.

Pastebins

Find information that has been uploaded to Pastebin & alternative pastebin-type sites

Search by website source code

Major Social Networks

Real-Time Search, Social Media Search, and General Social Media Tools

Social Media Tools

Twitter

Facebook

Instagram

Pinterest

Reddit

Tools to help discover more about a reddit user or subreddit.

  • Imgur - The most popular image hosting website used by redditors.
  • Mostly Harmless - Mostly Harmless looks up the page you are currently viewing to see if it has been submitted to reddit.
  • Reddit Archive - Historical archives of reddit posts.
  • Reddit Suite - Enhances your reddit experience.
  • Reddit Investigator - Investigate a reddit users history.
  • Reddit Metrics - Keeps track of the growth of a subreddit.
  • Reddit User Analyser - reddit user account analyzer.
  • SnoopSnoo - Provides reddit user and subreddits analytics.
  • Subreddits - Discover new subreddits.
  • Reddit Comment Search - Analyze a reddit users by comment history.
  • Universal Scammer List - This acts as the website-portion for the subreddit /r/universalscammerlist. That subreddit, in conjuction with this website and a reddit bot, manages a list of malicious reddit accounts and minimizes the damage they can deal. This list is referred to as the "USL" for short.
  • Reddit Comment Lookup - Search for reddit comments by reddit username.

VKontakte

Perform various OSINT on Russian social media site VKontakte.

Tumblr

LinkedIn

  • FTL - Browser plugin that finds emails of people's profiles in LinkedIn.

Telegram

  • Telegago - A Google Advanced Search specifically for finding public and private Telegram Channels and Chatrooms.
  • Telegram Nearby Map - Webapp based on OpenStreetMap and the official Telegram library to find the position of nearby users.

Username Check

People Investigations

  • 411 (US) - Search by person, phone number, address, and business. Limited free info, premium data upsell.
  • 192 (UK) - Search by person, business, address. Limited free info, premium data upsell.
  • Ancestry - Premium data, free trial with credit card.
  • Black Book Online - Free. Nationwide directory of public record lookups.
  • Canada411 - Search by person, phone number, and business. Free.
  • Classmates - High-school focused people search. Free acounts allow creating a profile and viewing other members. Premium account required to contact other members.
  • CrunchBase - Business information database, with a focus on investment, acquisition, and executive data. Ancillary focus on market research and connecting founders and investors.
  • facesearch - Handy proxy to search Google face-only image search results.
  • Family Search - Popular genealogy site. Free, but registration requried. Funded by The Church Of Jesus Christ of Latter-day Saints.
  • Federal Bureau of Prisons - Inmate Locator (US) - Search federal inmates incarcerated from 1982 to the present.
  • Fold3 (US Military Records) - Search military records. Search filters limited with free access. Premium access requires subscription.
  • Genealogy Bank - Premium data, free trial with credit card.
  • Genealogy Links - Genealogy directory with over 50K links.
  • Homemetry - Reverse address search and allows searching for properties for sale/rent.
  • Judyrecords - Free. Nationwide search of 400 million+ United States court cases.
  • Kompass - Business directory and search.
  • My Life People Search - People search. Limited free info, premium data upsell.
  • OpenSanctions - Information on sanctions and public office holders.
  • The National Archives (UK) - Search UK national archives.
  • Reunion - People search. Limited free info, premium data upsell.
  • SearchBug - People search. Limited free info, premium data upsell.
  • Spokeo - People search. Limited free info, premium data upsell.
  • UniCourt - Limited free searches, premium data upsell. Nationwide search of 100 million+ United States court cases.
  • White Pages (US) - People search. Limited free info, premium data upsell.
  • ZabaSearch
  • JailBase
  • Black Book Online
  • Mugshots

E-mail Search / E-mail Check

Phone Number Research

  • National Cellular Directory - was created to help people research and reconnect with one another by performing cell phone lookups. The lookup products includes have billions of records that can be accessed at any time, as well as free searches one hour a day, every day.
  • Reverse Phone Lookup - Detailed information about phone carrier, region, service provider, and switch information.
  • Spy Dialer - Get the voicemail of a cell phone & owner name lookup.
  • Twilio - Look up a phone numbers carrier type, location, etc.
  • Phone Validator - Pretty accurate phone lookup service, particularly good against Google Voice numbers.
  • PhoneInfoga - Advanced information gathering & OSINT framework for phone numbers
  • FreeCarrierLookup
  • Sync.ME
  • EmobileTracker.com

Company Research

Job Search Resources

Q&A Sites

Domain and IP Research

Keywords Discovery and Research

Web History and Website Capture

Language Tools

Image Analysis

Stock Images

Video Search and Other Video Tools

Radio and Podcasts Tools

Academic Resources and Grey Literature

Books and Reading

Geospatial Research and Mapping Tools

News

News Digest and Discovery Tools

Fact Checking

Data and Statistics

Web Monitoring

Bookmarking

Startpages

Browsers

Offline Browsing

VPN Services

Note-taking

Annotation Tools

Writing and Office Tools

Slide Show and Presentation Tools

Digital Publishing

Newsletter Tools

Digital Storytelling

Infographics and Data Visualization

Image and Photo Editing

Productivity Tools

E-mail Management

Document and Reference Management

PDF Management

OCR Tools

Cloud Storage and File Sharing

Web Automation

Dashboard Tools

Wikis

Collaboration and Project Management

Communication Tools

Calendars and Scheduling

Mind Mapping, Concept Mapping and Idea Generation Tools

Social Network Analysis

Privacy and Encryption Tools

DNS

  • Amass - The amass tool searches Internet data sources, performs brute force subdomain enumeration, searches web archives, and uses machine learning to generate additional subdomain name guesses. DNS name resolution is performed across many public servers so the authoritative server will see the traffic coming from different locations. Written in Go.
  • findsubdomains - Automatically scans different sources to collect as many subdomains as can. Validate all the data through various tools and services to provide correct results without waiting.

Other Tools

  • Barcode Reader - Decode barcodes in C#, VB, Java, C\C++, Delphi, PHP and other languages.
  • Belati - Belati - The Traditional Swiss Army Knife For OSINT. Belati is tool for Collecting Public Data & Public Document from Website and other service for OSINT purpose.
  • Datasploit - Tool to perform various OSINT techniques on usernames, emails addresses, and domains.
  • DuckDuckGo URL scraper - A simple DuckDuckGo URL scraper.
  • Greynoise - "Anti-Threat Intelligence" Greynoise characterizes the background noise of the internet, so the user can focus on what is actually important.
  • The Harvester - Gather emails, subdomains, hosts, employee names, open ports and banners from different public sources like search engines, PGP key servers and SHODAN computer database.
  • Intrigue Core - Framework for attack surface discovery.
  • Maltego - Maltego is an open source intelligence (OSINT) and graphical link analysis tool for gathering and connecting information for investigative tasks.
  • Hunchly - Hunchly is a web capture tool designed specifically for online investigations.
  • OpenRefine - Free & open source power tool for working with messy data and improving it.
  • Orbit - Draws relationships between crypto wallets with recursive crawling of transaction history.
  • OSINT Framework - Web based framework for OSINT.
  • OsintStalker - Python script for Facebook and geolocation OSINT.
  • Outwit - Find, grab and organize all kinds of data and media from online sources.
  • eScraper - Grab product descriptions, prices, image urls and other data effortlessly
  • Photon - Crawler designed for OSINT
  • Pown Recon - Target reconnaissance framework powered by graph theory.
  • QuickCode - Python and R data analysis environment.
  • SecApps Recon - Information gathering and target reconnaissance tool and UI.
  • sn0int - Semi-automatic OSINT framework and package manager.
  • SpiderFoot - OSINT automation platform with over 200 modules for threat intelligence, attack surface monitoring, security assessments and asset discovery.
  • Zen - Find email addresses of Github users
  • OSINT.SH - Information Gathering Toolset.
  • SpiderFoot - SpiderFoot is an open source intelligence (OSINT) automation tool.
  • FOCA - Tool to find metadata and hidden information in the documents.
  • Sub3 Suite - A research-grade suite of tools for intelligence gathering & target mapping with both active and passive(100+ modules) intelligence gathering capabilities.

Threat Intelligence

  • GitGuardian - Public GitHub Monitoring - Monitor public GitHub repositories in real time. Detect secrets and sensitive information to prevent hackers from using GitHub as a backdoor to your business.
  • REScure Threat Intel Feed - REScure is an independent threat intelligence project which we undertook to enhance our understanding of distributed systems, their integration, the nature of threat intelligence and how to efficiently collect, store, consume, distribute it.
  • OTX AlienVault - Open Threat Exchange is the neighborhood watch of the global intelligence community. It enables private companies, independent security researchers, and government agencies to openly collaborate and share the latest information about emerging threats, attack methods, and malicious actors, promoting greater security across the entire community.
  • OnionScan - Free and open source tool for investigating the Dark Web. Its main goal is to help researchers and investigators monitor and track Dark Web sites.
  • Digital Stakeout - DigitalStakeout Scout™ is the leading security intelligence tool to collect data from the surface web, social media, dark web and technical sources to illuminate and investigate external threats.

OSINT Videos

OSINT Blogs

Other Resources

Project Management Tools

Project management tools, Scrum tools, and Project Boards.

  • ClickUp - Heavy-weight Task Management
  • Scrumfast - Light-weight, Free Project Management Tool
  • Trello - Free Team Project Board

License

cc license

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International license.