Awesome-Mirrors/awesome-osint
1
0
Fork 0
mirror of https://github.com/jivoi/awesome-osint.git synced 2024-10-01 01:25:40 -04:00
Code Issues Packages Projects Releases Wiki Activity
ad1ecf7d25
awesome-osint/README.md
Adk ad1ecf7d25
fixed bug with table of contents
2023-08-07 19:04:56 +03:00

81 KiB
Raw Blame History

Awesome OSINT Awesome

A curated list of amazingly awesome open source intelligence tools and resources. Open-source intelligence (OSINT) is intelligence collected from publicly available sources. In the intelligence community (IC), the term "open" refers to overt, publicly available sources (as opposed to covert or clandestine sources)

📖 Table of Contents

↑ Contributing

Please read CONTRIBUTING if you wish to add tools or resources.

↑ Credits

This list was taken partially taken from i-inteligence's OSINT Tools and Resources Handbook.

Thanks to our main contributors jivoi EK_ spmedia

↑ General Search

The main search engines used by users.

  • Aol - The web for America.
  • Ask - Ask something and get a answer.
  • Bing - Microsoft´s search engine.
  • Brave - a private, independent, and transparent search engine.
  • DuckDuckGo - an Internet search engine that emphasizes protecting searchers' privacy.
  • Goodsearch - a search engine for shopping deals online.
  • Google Search - Most popular search engine.
  • Instya - You can searching shopping sites, dictionaries, answer sites, news, images, videos and much more.
  • Impersonal.me
  • Lycos - A search engine for pictures, videos, news and products.
  • Mojeek - A growing independent search engine which does not track you.
  • Search.com - Search the Web by searching the best engines from one place.
  • SurfCanyon - a real-time contextual search technology that observes user behavior in order to disambiguate intent "on the fly," and then automatically bring forward to page one relevant results that might otherwise have remain buried.
  • Wolfram Alpha - Wolfram Alpha is a computational knowledge engine (answer engine) developed by Wolfram Alpha. It will compute expert-level answers using Wolfram’s breakthrough algorithms, knowledgebase and AI technology.
  • Yahoo! Search - The search engine that helps you find exactly what you're looking for.
  • YOU - AI search engine.

↑ Main National Search Engines

Localized search engines by country.

↑ Meta Search

Lesser known and used search engines.

↑ Specialty Search Engines

Search engines for specific information or topics.

↑ Visual Search and Clustering Search Engines

Search engines that scrape multiple sites (Google, Yahoo, Bing, Goo, etc) at the same time and return results.

↑ Similar Sites Search

Find websites that are similar. Good for business competition research.

↑ Document and Slides Search

Search for data located on PDFs, Word documents, presentation slides, and more.

↑ File Search

Search for all kind of files.

↑ Pastebins

Find information that has been uploaded to Pastebin & alternative pastebin-type sites

↑ Code Search

Search by website source code

  • AnalyzeID - Find Other Websites Owned By The Same Person
  • NerdyData - Search engine for source code.
  • SearchCode - Help find real world examples of functions, API's and libraries across 10+ sources.
  • SourceGraph - Search code from millions of open source repositories.
  • grep.app - Searches code from the entire github public repositories for a given specific string or using regular expression.
  • Reposearch
  • PublicWWW

↑ Major Social Networks

↑ Real-Time Search, Social Media Search, and General Social Media Tools

Social Media Tools

↑ Twitter

↑ Facebook

↑ Instagram

↑ Pinterest

↑ Reddit

Tools to help discover more about a reddit user or subreddit.

  • Imgur - The most popular image hosting website used by redditors.
  • Mostly Harmless - Mostly Harmless looks up the page you are currently viewing to see if it has been submitted to reddit.
  • Reddit Archive - Historical archives of reddit posts.
  • Reddit Suite - Enhances your reddit experience.
  • Reddit User Analyser - reddit user account analyzer.
  • Subreddits - Discover new subreddits.
  • Reddit Comment Search - Analyze a reddit users by comment history.
  • Universal Scammer List - This acts as the website-portion for the subreddit /r/universalscammerlist. That subreddit, in conjuction with this website and a reddit bot, manages a list of malicious reddit accounts and minimizes the damage they can deal. This list is referred to as the "USL" for short.
  • Reddit Comment Lookup - Search for reddit comments by reddit username.

↑ VKontakte

Perform various OSINT on Russian social media site VKontakte.

↑ Tumblr

↑ LinkedIn

  • FTL - Browser plugin that finds emails of people's profiles in LinkedIn.

↑ Telegram

  • Telegago - A Google Advanced Search specifically for finding public and private Telegram Channels and Chatrooms.
  • Telegram Nearby Map - Webapp based on OpenStreetMap and the official Telegram library to find the position of nearby users.

↑ Blog Search

↑ Forums and Discussion Boards Search

↑ Username Check

  • Check User Names
  • IDCrawl - Search for a username in popular social networks.
  • Knowem - Search for a username on over 500 popular social networks.
  • Name Chk
  • Name Checkr
  • Name Checkup - is a search tool that allows you to check the avilability of a givrn username from all over the social media. Inaddition it also sllows you to check the avilability of a given domain name.
  • NameKetchup - checks domain name and username in popular social media sites and platforms.
  • NexFil - checks username from almost all social network sites.
  • Seekr A multi-purpose all in one toolkit for gathering and managing OSINT-Data with a neat web-interface. Can be used for note taking and username checking.
  • Sherlock - Search for a username in multiple platforms/websites.
  • Snoop - Search for a nickname on the web (OSINT world)
  • User Search
  • WhatsMyName
  • User Searcher - User-Searcher is a powerful and free tool to help you search username in 2000+ websites.
  • Maigret - Collect a dossier on a person by username.
  • Blackbird - Search a username across over 500+ websites.

↑ People Investigations

  • 411 (US) - Search by person, phone number, address, and business. Limited free info, premium data upsell.
  • 192 (UK) - Search by person, business, address. Limited free info, premium data upsell.
  • Ancestry - Premium data, free trial with credit card.
  • Black Book Online - Free. Nationwide directory of public record lookups.
  • Canada411 - Search by person, phone number, and business. Free.
  • Classmates - High-school focused people search. Free acounts allow creating a profile and viewing other members. Premium account required to contact other members.
  • CrunchBase - Business information database, with a focus on investment, acquisition, and executive data. Ancillary focus on market research and connecting founders and investors.
  • Digital Footprint Check - Search the internet including social media accounts, employment history, dating profiles, gaming profiles, dark web credential breaches, indexed search engine occurrences, and more.
  • FaceCheck.ID - Search the internet by face.
  • Family Search - Popular genealogy site. Free, but registration requried. Funded by The Church Of Jesus Christ of Latter-day Saints.
  • Federal Bureau of Prisons - Inmate Locator (US) - Search federal inmates incarcerated from 1982 to the present.
  • Fold3 (US Military Records) - Search military records. Search filters limited with free access. Premium access requires subscription.
  • Genealogy Bank - Premium data, free trial with credit card.
  • Genealogy Links - Genealogy directory with over 50K links.
  • Homemetry - Reverse address search and allows searching for properties for sale/rent.
  • Judyrecords - Free. Nationwide search of 400 million+ United States court cases.
  • Kompass - Business directory and search.
  • OpenSanctions - Information on sanctions and public office holders.
  • The National Archives (UK) - Search UK national archives.
  • Reunion - People search. Limited free info, premium data upsell.
  • SearchBug - People search. Limited free info, premium data upsell.
  • Spokeo - People search. Limited free info, premium data upsell.
  • UniCourt - Limited free searches, premium data upsell. Nationwide search of 100 million+ United States court cases.
  • White Pages (US) - People search. Limited free info, premium data upsell.
  • ZabaSearch
  • JailBase - is an information site that allows you to search for arrested persons you might know, and even get notified if someone you know gets arrested.
  • Mugshots
  • BeenVerified

↑ E-mail Search / E-mail Check

  • DeHashed - DeHashed helps prevent ATO with our extensive data set & breach notification solution. Match employee and consumer logins against the world’s largest repository of aggregated publicly available assets leaked from third-party breaches. Secure passwords before criminals can abuse stolen information, and protect your enterprise.
  • LeakCheck - Data Breach Search Engine with 7.5B+ entries collected from more than 3000 databases. Search by e-mail, username, keyword, password or corporate domain name.
  • Email Address Validator
  • Email Format - is a website that allows you to find email address formats used by different companies.
  • EmailHippo - is an email address verification platform that will check whether a given email address exist or not.
  • Email Permutator
  • h8mail - Password Breach Hunting and Email OSINT, locally or using premium services. Supports chasing down related email.
  • Holehe
  • Have I Been Pwned - Search across multiple data breaches to see if your email address has been compromised.
  • Hunter - Hunter lets you find email addresses in seconds and connect with the people that matter for your business.
  • Snov.io - Find email addresses on any website.
  • MailTester
  • mxtoolbox - Free online tools to investigate/troubleshoot email server issues.
  • Peepmail
  • Pipl
  • Reacher - Real-time email verification API, written in Rust, 100% open-source.
  • ThatsThem
  • Toofr
  • Verify Email
  • VoilaNorbert - Find anyone's contact information for lead research or talent acquisition.
  • Ghunt - Investigate Google emails and documents.

↑ Phone Number Research

  • EmobileTracker.com
  • FreeCarrierLookup
  • Phone Validator - Pretty accurate phone lookup service, particularly good against Google Voice numbers.
  • PhoneInfoga - Advanced information gathering & OSINT framework for phone numbers
  • Reverse Phone Check - Look up names, addresses, phone numbers, or emails and anonymously discover information about yourself, family, friends, or old schoolmates. Powered by infotracer.com
  • Reverse Phone Lookup - Detailed information about phone carrier, region, service provider, and switch information.
  • Spy Dialer - Get the voicemail of a cell phone & owner name lookup.
  • Sync.ME
  • Twilio - Look up a phone numbers carrier type, location, etc.

↑ Expert Search

↑ Company Research

↑ Job Search Resources

↑ Q&A Sites

↑ Domain and IP Research

↑ Keywords Discovery and Research

↑ Web History and Website Capture

↑ Language Tools

↑ Image Search

↑ Image Analysis

↑ Video Search and Other Video Tools

↑ Academic Resources and Grey Literature

↑ Geospatial Research and Mapping Tools

↑ News

↑ News Digest and Discovery Tools

↑ Fact Checking

↑ Data and Statistics

↑ Web Monitoring

↑ Browsers

↑ Offline Browsing

↑ VPN Services

↑ Infographics and Data Visualization

↑ Social Network Analysis

↑ Privacy and Encryption Tools

↑ DNS

  • Amass - The amass tool searches Internet data sources, performs brute force subdomain enumeration, searches web archives, and uses machine learning to generate additional subdomain name guesses. DNS name resolution is performed across many public servers so the authoritative server will see the traffic coming from different locations. Written in Go.
  • findsubdomains - Automatically scans different sources to collect as many subdomains as can. Validate all the data through various tools and services to provide correct results without waiting.
  • Columbus Project - Columbus Project is an advanced subdomain discovery service with fast, powerful and easy to use API.

↑ Maritime

  • VesselFinder - a FREE AIS vessel tracking web site. VesselFinder displays real time ship positions and marine traffic detected by global AIS network.

↑ Other Tools

  • Barcode Reader - Decode barcodes in C#, VB, Java, C\C++, Delphi, PHP and other languages.
  • Belati - Belati - The Traditional Swiss Army Knife For OSINT. Belati is tool for Collecting Public Data & Public Document from Website and other service for OSINT purpose.
  • BeVigil-CLI - A unified command line interface and python library for using BeVigil OSINT API to search for assets such as subdomains, URLs, applications indexed from mobile applications.
  • CantHide - CantHide finds previous locations by looking at a given social media account.
  • CrowdSec - An open source, free, and collaborative IPS/IDS software written in Go, able to analyze visitor behavior & provide an adapted response to all kinds of attacks.
  • Datasploit - Tool to perform various OSINT techniques on usernames, emails addresses, and domains.
  • DuckDuckGo URL scraper - A simple DuckDuckGo URL scraper.
  • Glit - Retrieve all mails of users related to a git repository, a git user or a git organization.
  • Greynoise - "Anti-Threat Intelligence" Greynoise characterizes the background noise of the internet, so the user can focus on what is actually important.
  • The Harvester - Gather emails, subdomains, hosts, employee names, open ports and banners from different public sources like search engines, PGP key servers and SHODAN computer database.
  • Intrigue Core - Framework for attack surface discovery.
  • LinkScope - LinkScope is an open source intelligence (OSINT) graphical link analysis tool and automation platform for gathering and connecting information for investigative tasks.
  • Maltego - Maltego is an open source intelligence (OSINT) and graphical link analysis tool for gathering and connecting information for investigative tasks.
  • Hunchly - Hunchly is a web capture tool designed specifically for online investigations.
  • OpenRefine - Free & open source power tool for working with messy data and improving it.
  • Orbit - Draws relationships between crypto wallets with recursive crawling of transaction history.
  • OSINT Framework - Web based framework for OSINT.
  • OsintStalker - Python script for Facebook and geolocation OSINT.
  • Outwit - Find, grab and organize all kinds of data and media from online sources.
  • eScraper - Grab product descriptions, prices, image urls and other data effortlessly
  • Photon - Crawler designed for OSINT
  • Pown Recon - Target reconnaissance framework powered by graph theory.
  • QuickCode - Python and R data analysis environment.
  • SecApps Recon - Information gathering and target reconnaissance tool and UI.
  • sn0int - Semi-automatic OSINT framework and package manager.
  • SpiderFoot - SpiderFoot is an open source intelligence (OSINT) automation platform with over 200 modules for threat intelligence, attack surface monitoring, security assessments and asset discovery.
  • SpiderSuite - An advance, cross-platform, GUI web security crawler.
  • SerpApi - Scrapes Google search and 25+ search engines with ease and retruns a raw JSON. Supports 10 API wrappers.
  • SerpScan - Powerful PHP script designed to allow you to leverage the power of dorking straight from the comfort of your command line. Analyzes data from Google, Bing, Yahoo, Yandex, and Badiu.
  • Zen - Find email addresses of Github users
  • OSINT.SH - Information Gathering Toolset.
  • FOCA - Tool to find metadata and hidden information in the documents.
  • Sub3 Suite - A research-grade suite of tools for intelligence gathering & target mapping with both active and passive(100+ modules) intelligence gathering capabilities.

↑ Threat Intelligence

  • GitGuardian - Public GitHub Monitoring - Monitor public GitHub repositories in real time. Detect secrets and sensitive information to prevent hackers from using GitHub as a backdoor to your business.
  • REScure Threat Intel Feed - REScure is an independent threat intelligence project which we undertook to enhance our understanding of distributed systems, their integration, the nature of threat intelligence and how to efficiently collect, store, consume, distribute it.
  • OTX AlienVault - Open Threat Exchange is the neighborhood watch of the global intelligence community. It enables private companies, independent security researchers, and government agencies to openly collaborate and share the latest information about emerging threats, attack methods, and malicious actors, promoting greater security across the entire community.
  • OnionScan - Free and open source tool for investigating the Dark Web. Its main goal is to help researchers and investigators monitor and track Dark Web sites.

↑ OSINT Videos

↑ OSINT Blogs

↑ Other Resources

↑ Related Awesome Lists

License

cc license

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International license.