Awesome-Mirrors/awesome-osint
1
0
Fork 0
mirror of https://github.com/jivoi/awesome-osint.git synced 2024-10-01 01:25:40 -04:00
Code Issues Packages Projects Releases Wiki Activity
f632b0dd87
awesome-osint/README.md
Edmond Major III f632b0dd87
Merge pull request #503 from natashalekh/patch-1 
Add Google Maps Scraper (Unofficial Google Places API)
2024-07-04 08:51:45 -05:00

87 KiB
Raw Blame History

Awesome OSINT Awesome

A curated list of amazingly awesome open source intelligence tools and resources. Open-source intelligence (OSINT) is intelligence collected from publicly available sources. In the intelligence community (IC), the term "open" refers to overt, publicly available sources (as opposed to covert or clandestine sources).

This list is to help all of those who are into Cyber Threat Intellience (CTI), threat hunting, or OSINT. From beginners to advanced.

Happy hacking and hunting 🧙‍♂️

📖 Table of Contents

↑ Contributing

Please read CONTRIBUTING if you wish to add tools or resources. Feel free to help 🥰 us grow this list with great resources.

↑ Credits

This list was taken partially taken from i-inteligence's OSINT Tools and Resources Handbook.

Thanks to our main contributors jivoi EK_ & spmedia

↑ General Search

The main search engines used by users.

  • Aol - The web for America.
  • Ask - Ask something and get a answer.
  • Bing - Microsoft´s search engine.
  • Brave - a private, independent, and transparent search engine.
  • DuckDuckGo - an Internet search engine that emphasizes protecting searchers' privacy.
  • Goodsearch - a search engine for shopping deals online.
  • Google Search - Most popular search engine.
  • Instya - You can searching shopping sites, dictionaries, answer sites, news, images, videos and much more.
  • Impersonal.me
  • Lycos - A search engine for pictures, videos, news and products.
  • Mojeek - A growing independent search engine which does not track you.
  • Search.com - Search the Web by searching the best engines from one place.
  • SurfCanyon - a real-time contextual search technology that observes user behavior in order to disambiguate intent "on the fly," and then automatically bring forward to page one relevant results that might otherwise have remain buried.
  • Wolfram Alpha - Wolfram Alpha is a computational knowledge engine (answer engine) developed by Wolfram Alpha. It will compute expert-level answers using Wolfram’s breakthrough algorithms, knowledgebase and AI technology.
  • Yahoo! Search - The search engine that helps you find exactly what you're looking for.
  • YOU - AI search engine.

↑ Main National Search Engines

Localized search engines by country.

↑ Meta Search

Lesser known and used search engines.

↑ Specialty Search Engines

Search engines for specific information or topics.

↑ Visual Search and Clustering Search Engines

Search engines that scrape multiple sites (Google, Yahoo, Bing, Goo, etc) at the same time and return results.

↑ Similar Sites Search

Find websites that are similar. Good for business competition research.

↑ Document and Slides Search

Search for data located on PDFs, Word documents, presentation slides, and more.

↑ File Search

Search for all kind of files.

↑ Pastebins

Find information that has been uploaded to Pastebin & alternative pastebin-type sites

↑ Code Search

Search by website source code

  • AnalyzeID - Find Other Websites Owned By The Same Person
  • grep.app - Searches code from the entire github public repositories for a given specific string or using regular expression.
  • NerdyData - Search engine for source code.
  • PublicWWW
  • Reposearch
  • SearchCode - Help find real world examples of functions, API's and libraries across 10+ sources.
  • SourceGraph - Search code from millions of open source repositories.

↑ Major Social Networks

↑ Real-Time Search, Social Media Search, and General Social Media Tools

Social Media Tools

↑ Twitter

↑ Facebook

↑ Instagram

  • Iconosquare
  • Osintgram - Osintgram offers an interactive shell to perform analysis on Instagram account of any users by its nickname.
  • Picodash - Find Instagram Target Audience and Influencers
  • Sterra - Instagram OSINT tool to export and analyse followers | following with their details
  • Toutatis - a tool that allows you to extract information from instagrams accounts such as s, phone numbers and more

↑ Pinterest

↑ Reddit

Tools to help discover more about a reddit user or subreddit.

  • Imgur - The most popular image hosting website used by redditors.
  • Mostly Harmless - Mostly Harmless looks up the page you are currently viewing to see if it has been submitted to reddit.
  • Reddit Archive - Historical archives of reddit posts.
  • Reddit Suite - Enhances your reddit experience.
  • Reddit User Analyser - reddit user account analyzer.
  • Subreddits - Discover new subreddits.
  • Reddit Comment Search - Analyze a reddit users by comment history.
  • Universal Scammer List - This acts as the website-portion for the subreddit /r/universalscammerlist. That subreddit, in conjuction with this website and a reddit bot, manages a list of malicious reddit accounts and minimizes the damage they can deal. This list is referred to as the "USL" for short.
  • Reddit Comment Lookup - Search for reddit comments by reddit username.

↑ VKontakte

Perform various OSINT on Russian social media site VKontakte.

↑ Tumblr

↑ LinkedIn

  • FTL - Browser plugin that finds emails of people's profiles in LinkedIn.

↑ Telegram

  • Telegago - A Google Advanced Search specifically for finding public and private Telegram Channels and Chatrooms.
  • Telegram Nearby Map - Webapp based on OpenStreetMap and the official Telegram library to find the position of nearby users.

↑ Blog Search

↑ Forums and Discussion Boards Search

↑ Username Check

  • Blackbird - Search a username across over 500+ websites.
  • CheckUser - search username across social networks
  • IDCrawl - Search for a username in popular social networks.
  • Maigret - Collect a dossier on a person by username.
  • Name Chk - Check over 30 domains and more than 90 social media account platforms.
  • Name Checkr - checks a domain and username across many platforms.
  • Name Checkup - is a search tool that allows you to check the avilability of a givrn username from all over the social media. Inaddition it also sllows you to check the avilability of a given domain name.
  • NameKetchup - checks domain name and username in popular social media sites and platforms.
  • NexFil - checks username from almost all social network sites.
  • Seekr A multi-purpose all in one toolkit for gathering and managing OSINT-Data with a neat web-interface. Can be used for note taking and username checking.
  • Sherlock - Search for a username in multiple platforms/websites.
  • Snoop - Search for a nickname on the web (OSINT world)
  • User Search - Find someone by username, email, phone number or picture across Social Networks, Dating Sites, Forums, Crypto Forums, Chat Sites and Blogs, 3000+ sites Supported!
  • User Searcher - User-Searcher is a powerful and free tool to help you search username in 2000+ websites.
  • WhatsMyName - check for usernames across many different platforms.

↑ People Investigations

  • 192 (UK) - Search by person, business, address. Limited free info, premium data upsell.
  • 411 (US) - Search by person, phone number, address, and business. Limited free info, premium data upsell.
  • Ancestry - Premium data, free trial with credit card.
  • BeenVerified
  • Black Book Online - Free. Nationwide directory of public record lookups.
  • Canada411 - Search by person, phone number, and business. Free.
  • Classmates - High-school focused people search. Free acounts allow creating a profile and viewing other members. Premium account required to contact other members.
  • CrunchBase - Business information database, with a focus on investment, acquisition, and executive data. Ancillary focus on market research and connecting founders and investors.
  • FaceCheck.ID - Search the internet by face.
  • Family Search - Popular genealogy site. Free, but registration requried. Funded by The Church Of Jesus Christ of Latter-day Saints.
  • FamilyTreeNow - Research family and geneology, no registration required, can search addresses, phone numbers, and email addresses as well as associations.
  • Federal Bureau of Prisons - Inmate Locator (US) - Search federal inmates incarcerated from 1982 to the present.
  • Fold3 (US Military Records) - Search military records. Search filters limited with free access. Premium access requires subscription.
  • Genealogy Bank - Premium data, free trial with credit card.
  • Genealogy Links - Genealogy directory with over 50K links.
  • Homemetry - Reverse address search and allows searching for properties for sale/rent.
  • JailBase - is an information site that allows you to search for arrested persons you might know, and even get notified if someone you know gets arrested.
  • Judyrecords - Free. Nationwide search of 400 million+ United States court cases.
  • Kompass - Business directory and search.
  • Mugshots
  • OpenSanctions - Information on sanctions and public office holders.
  • Reunion - People search. Limited free info, premium data upsell.
  • SearchBug - People search. Limited free info, premium data upsell.
  • Spokeo - People search. Limited free info, premium data upsell.
  • The National Archives (UK) - Search UK national archives.
  • UniCourt - Limited free searches, premium data upsell. Nationwide search of 100 million+ United States court cases.
  • VineLink - Inmate search and notification service for victims of crime, linked to multiple correctional facilities' booking systems in the U.S.
  • Voter Records - Free political research tool to study more than 100 Million US voter records.
  • White Pages (US) - People search. Limited free info, premium data upsell.
  • ZabaSearch

↑ Email Search / Email Check

  • DeHashed - DeHashed helps prevent ATO with our extensive data set & breach notification solution. Match employee and consumer logins against the world’s largest repository of aggregated publicly available assets leaked from third-party breaches. Secure passwords before criminals can abuse stolen information, and protect your enterprise.
  • Email Address Validator - Improve deliverability, reduce bounce rates, prevent fraud and minimize funnel leaks.
  • Email Format - is a website that allows you to find email address formats used by different companies.
  • Email Permutator - a powerful tool designed to aid professionals in generating a range of potential email addresses for a specific contact.
  • EmailHippo - is an email address verification platform that will check whether a given email address exist or not.
  • Ghunt - Investigate Google emails and documents.
  • Gitrecon - Node.js tool to scan GitHub repositories for exposed email addresses and names.
  • h8mail - Password Breach Hunting and Email OSINT, locally or using premium services. Supports chasing down related email.
  • Have I Been Pwned - Search across multiple data breaches to see if your email address has been compromised.
  • Holehe - allows you to check if the mail is used on different sites like twitter, instagram and will retrieve information on sites with the forgotten password function.
  • Hunter - Hunter lets you find email addresses in seconds and connect with the people that matter for your business.
  • LeakCheck - Data Breach Search Engine with 7.5B+ entries collected from more than 3000 databases. Search by e-mail, username, keyword, password or corporate domain name.
  • MailTester - hunt for emails and improve your email deliverability
  • mxtoolbox - Free online tools to investigate/troubleshoot email server issues.
  • Peepmail - is a tool that allows you to discover business email addresses for users, even if their email address may not be publicly available or shared.
  • Pipl - a provider of identity solutions.
  • Reacher - Real-time email verification API, written in Rust, 100% open-source.
  • Snov.io - Find email addresses on any website.
  • ThatsThem - Reverse Email Lookup.
  • Toofr - Find Anyone’s Email Address in Seconds.
  • Verify Email - The fastest and most accurate email verification tool.
  • VoilaNorbert - Find anyone's contact information for lead research or talent acquisition.

↑ Phone Number Research

  • CallerID Test - Get caller ID and telco carrier information back from a phone number.
  • EmobileTracker.com - a service specifically designed to Track Mobile Number, Location on Google Map including information such as the owner's Name,Location,Country,Telecom provider.
  • FreeCarrierLookup - enter a phone number and we'll return the carrier name and whether the number is wireless or landline. We also return the email-to-SMS and email-to-MMS gateway addresses for USA and Canadian* phone numbers.
  • Infobel - Search 164+ million records across 73 countries for companies and individuals. Find places, local service providers, their contact details, reviews, opening hours and more.
  • Phone Validator - Pretty accurate phone lookup service, particularly good against Google Voice numbers.
  • PhoneInfoga - Advanced information gathering & OSINT framework for phone numbers.
  • Reverse Phone Check - Look up names, addresses, phone numbers, or emails and anonymously discover information about yourself, family, friends, or old schoolmates. Powered by infotracer.com
  • Reverse Phone Lookup - Detailed information about phone carrier, region, service provider, and switch information.
  • Spy Dialer - Get the voicemail of a cell phone & owner name lookup.
  • Sync.ME - a caller ID and spam blocker app.
  • Truecaller - Global reverse phone number search.
  • Twilio - Look up a phone numbers carrier type, location, etc. Twilio offers free accounts that come with credits you can use with their API. Each lookup is only ~$0.01-$0.02 typically on US and CAN numbers.

↑ Vehicle / Automobile Research

  • FaxVIN - Vehicle History Reports. A license plate lookup tool that returns info like VIN, make & model of vehicle, age, and numerous other details.
  • EpicVIN - Vehicle reports are compiled from various data sources, including historical accident records from state agencies and other entities like NMVTIS. License plate lookup that returns VIN and car millage.

↑ Expert Search

↑ Company Research

↑ Job Search Resources

↑ Q&A Sites

↑ Domain and IP Research

↑ Keywords Discovery and Research

↑ Web History and Website Capture

↑ Language Tools

↑ Image Search

↑ Image Analysis

↑ Video Search and Other Video Tools

  • Bing Videos
  • Clarify
  • Clip Blast
  • DailyMotion
  • Deturl - Download a YouTube video from any web page.
  • DownloadHealper - Download any video from any websites, it just works!
  • Earthcam - EarthCam is the leading network of live streaming webcams for tourism and entertainment.
  • Filmot - Search within YouTube subtitles. Indexing over 573 million captions across 528 million videos and 45 million channels.
  • Find YouTube Video - Searches currently 5 YouTube archives for specific videos by ID, which is really useful for finding deleted or private YouTube videos.
  • Frame by Frame - Browser plugin that allows you to watch YouTube videos frame by frame.
  • Geosearch
  • Insecam - Live cameras directory
  • Internet Archive: Open Source Videos
  • Metacafe
  • Metatube
  • Tubuep - Downloads online videos via yt-dlp, then reuploads them to the Internet Archive for preservation. Note: if you would like to archive comments too, you need to install version 0.0.33 and use the --get-comments flag, however you will still have the new yt-dlp fixes and features, but existing tubeup bugs cannot be fixed, unless you do manual work.
  • Veoh
  • Video Stabilization Methods
  • Vimeo
  • Yahoo Video Search
  • YouTube Data Viewer
  • YouTube Geofind
  • YouTube Metadata
  • YouTube
  • yt-dlp - Downloads videos from almost any online platform, along with information, thumbnails, subtitles, descriptions, and comments (comments only on a select few sites like Youtube and a few small sites). If a site is not supported, or a useful or crucial piece of metadata, including comments, is missing, create an issue.

↑ Academic Resources and Grey Literature

↑ Geospatial Research and Mapping Tools

↑ News

↑ News Digest and Discovery Tools

↑ Fact Checking

↑ Data and Statistics

↑ Web Monitoring

↑ Browsers

↑ Offline Browsing

↑ VPN Services

↑ Infographics and Data Visualization

↑ Social Network Analysis

↑ Privacy and Encryption Tools

↑ DNS

  • Amass - The amass tool searches Internet data sources, performs brute force subdomain enumeration, searches web archives, and uses machine learning to generate additional subdomain name guesses. DNS name resolution is performed across many public servers so the authoritative server will see the traffic coming from different locations. Written in Go.
  • Columbus Project - Columbus Project is an advanced subdomain discovery service with fast, powerful and easy to use API.
  • findsubdomains - Automatically scans different sources to collect as many subdomains as can. Validate all the data through various tools and services to provide correct results without waiting.

↑ Maritime

  • VesselFinder - a FREE AIS vessel tracking web site. VesselFinder displays real time ship positions and marine traffic detected by global AIS network.

↑ Other Tools

  • Barcode Reader - Decode barcodes in C#, VB, Java, C\C++, Delphi, PHP and other languages.
  • Belati - Belati - The Traditional Swiss Army Knife For OSINT. Belati is tool for Collecting Public Data & Public Document from Website and other service for OSINT purpose.
  • BeVigil-CLI - A unified command line interface and python library for using BeVigil OSINT API to search for assets such as subdomains, URLs, applications indexed from mobile applications.
  • CantHide - CantHide finds previous locations by looking at a given social media account.
  • CrowdSec - An open source, free, and collaborative IPS/IDS software written in Go, able to analyze visitor behavior & provide an adapted response to all kinds of attacks.
  • Datasploit - Tool to perform various OSINT techniques on usernames, emails addresses, and domains.
  • Discoshell - A simple discovery script that uses popular tools like subfinder, amass, puredns, alterx, massdns and others
  • DuckDuckGo URL scraper - A simple DuckDuckGo URL scraper.
  • eScraper - Grab product descriptions, prices, image
  • FOCA - Tool to find metadata and hidden information in the documents.
  • Glit - Retrieve all mails of users related to a git repository, a git user or a git organization.
  • Greynoise - "Anti-Threat Intelligence" Greynoise characterizes the background noise of the internet, so the user can focus on what is actually important.
  • Hunchly - Hunchly is a web capture tool designed specifically for online investigations.
  • Intrigue Core - Framework for attack surface discovery.
  • LinkScope Client - LinkScope Client Github repository.
  • LinkScope - LinkScope is an open source intelligence (OSINT) graphical link analysis tool and automation platform for gathering and connecting information for investigative tasks.
  • Maltego - Maltego is an open source intelligence (OSINT) and graphical link analysis tool for gathering and connecting information for investigative tasks.
  • OpenRefine - Free & open source power tool for working with messy data and improving it.
  • Orbit - Draws relationships between crypto wallets with recursive crawling of transaction history.
  • OSINT Framework - Web based framework for OSINT.
  • OSINT-Tool - A browser extension that gives you access to a suite of OSINT utilities (Dehashed, Epieos, Domaintools, Exif data, Reverse image search, etc) directly on any webpage you visit.
  • OSINT.SH - Information Gathering Toolset.
  • OsintStalker - Python script for Facebook and geolocation OSINT.
  • Outwit - Find, grab and organize all kinds of data and media from online sources.
  • Photon - Crawler designed for OSINT
  • Pown Recon - Target reconnaissance framework powered by graph theory.
  • pygreynoise - Greynoise Python Library
  • QuickCode - Python and R data analysis environment.
  • SecApps Recon - Information gathering and target reconnaissance tool and UI.
  • SerpApi - Scrapes Google search and 25+ search engines with ease and retruns a raw JSON. Supports 10 API wrappers.
  • SerpScan - Powerful PHP script designed to allow you to leverage the power of dorking straight from the comfort of your command line. Analyzes data from Google, Bing, Yahoo, Yandex, and Badiu.
  • sn0int - Semi-automatic OSINT framework and package manager.
  • SpiderFoot - SpiderFoot Github repository.
  • SpiderFoot - SpiderFoot is an open source intelligence (OSINT) automation platform with over 200 modules for threat intelligence, attack surface monitoring, security assessments and asset discovery.
  • SpiderSuite - An advance, cross-platform, GUI web security crawler.
  • Sub3 Suite - A research-grade suite of tools for intelligence gathering & target mapping with both active and passive(100+ modules) intelligence gathering capabilities.
  • The Harvester - Gather emails, subdomains, hosts, employee names, open ports and banners from different public sources like search engines, PGP key servers and SHODAN computer database.
  • Zen - Find email addresses of Github users urls and other data effortlessly

↑ Threat Intelligence

  • GitGuardian - Public GitHub Monitoring - Monitor public GitHub repositories in real time. Detect secrets and sensitive information to prevent hackers from using GitHub as a backdoor to your business.
  • OnionScan - Free and open source tool for investigating the Dark Web. Its main goal is to help researchers and investigators monitor and track Dark Web sites.
  • OTX AlienVault - Open Threat Exchange is the neighborhood watch of the global intelligence community. It enables private companies, independent security researchers, and government agencies to openly collaborate and share the latest information about emerging threats, attack methods, and malicious actors, promoting greater security across the entire community.
  • REScure Threat Intel Feed - REScure is an independent threat intelligence project which we undertook to enhance our understanding of distributed systems, their integration, the nature of threat intelligence and how to efficiently collect, store, consume, distribute it.

↑ OSINT Videos

↑ OSINT Blogs

↑ Other Resources

↑ Related Awesome Lists

License

cc license

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International license.