Using Internet archives in #OSINT and #SOCMINT

Services, tools, tricks.

Thread 🧵🧵⤵️⤵️
When searching for an old version of any site or page is not to limit to one archive.org, but to try different archives. Here is a link checker for all (26+search engines) archives I know at once:
cipher387.github.io/quickcacheanda…
Internet-archives #osint thread🧵⤵️⤴️
To see a list of all pages of a particular site stored in the archive, put an asterisk at the end of its URL (view pic).
This trick works for archive.org, Troove, and many other archives.

Internet-archives #osint thread🧵⤵️⤴️
For archive.org there is a special tool that shows a list of saved Wayback copies of the site and allows you to download a list of links to them in txt.

Internet Archive Wayback Machine Link Ripper:

tools.digitalmethods.net/beta/internetA…

Internet-archives #osint thread🧵⤵️⤴️
Remember that images in web archives are indexed by search engines. You can do a reverse image search on them using the "site:" operator in Google and Yandex.

Here's an example of the image from the first tweet.

Internet-archives #osint thread🧵⤵️⤴️
Web Archives

An extension for Chrome that allows you to quickly check if there is a copy of the currently open page in 18 archives and search engine caches.

chrome-extension://hkligngkgcpcolhcnkgccglchdafcnao/src/options/index.html

Internet-archives #osint thread🧵⤴️⤵️
Vandal

This extension speeds up, supplements, and enhances the standard Wayback Machine interface.

chrome.google.com/webstore/detai…

Internet-archives #osint thread🧵⤴️⤵️
Wayback Pack

This #python-written tool allows you to automatically download all copies of the site saved to archive.org for a specific time period.

Internet-archives #osint thread🧵⤴️⤵️
Wayback Machine Downloader

This #Ruby-based tool allows you to quickly download all the pages of a particular site from archive.org.

github.com/hartator/wayba…

Internet-archives #osint thread🧵⤴️⤵️
After downloading thecopies of the pages, they can be automatically analyzed for useful info: phone numberrs, emails, nicknames.

This is where #regularexpression and the Grep for OSINT shell-script set come in handy

github.com/cipher387/grep…

Internet-archives #osint thread🧵⤴️⤵️
Archivarix.com

This tool allows you to restore an old version of a site from the archive and place it on a separate domain (in some cases you can even restore the CMS, but not always).

Partially free

Internet-archives #osint thread🧵⤴️⤵️
archivebox.io

Internet archives are a very unreliable thing. And a huge number of sites are not covered by them.
Therefore, if you need to save any important and useful web pages for the future, then create your own local archive.

Internet-archives #osint thread🧵⤴️⤵️
Archive.org stores all kinds of content: photos, documents, press, etc. When searching for these items, you can use advanced searches (and search operators) to filter results.

Internet-archives #osint thread🧵⤴️⤵️
When investigating incidents that took place few years ago, be sure to consult local and federal television's archives for the relevant date.

Example of such site: americanarchive.org

Internet-archives #osint thread🧵⤴️⤵️
This thread is end. I suggest you check out my other threads:

Google
Facebook
YouTube

Internet-archives #osint thread🧵⤴️⤴️
@threader compile
@threadreaderapp unroll
@threadrip unroll
@PingThread unroll
@threadreaders unroll
@TurnipSocial save
@readwiseio save thread
@tresselapp save thread

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Cyber Detective

Cyber Detective Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @cyb_detective

17 Dec
GET THE MOST OUT OF A GOOGLE SEARCH

Tools, extensions, automation methods.

🧵🧵🧵Thread🧵🧵🧵

#google #search #osint
isearchfrom.com

Going beyond the "filter bubble"!

Set the language, country, device, and location you want to search from in detail.

Google Search thread🧵#1

#seo #geoint
brightlocal.com/local-search-r…

And here is an analogue of the service mentioned above. It has fewer options for settings (for example, you can't select a city), but you can search in @GoogleMaps, too

Google Search thread🧵#2
Read 23 tweets
13 Dec
GITHUB #OSINT THREAD🧵🧵🧵

A collection of services and techniques for gathering information about repositories, users, companies, and even yourself.

#coding #opensource #socmint
Zen

A tool for gathering contacts of #Github users.

Enter the link to the company's Github page and get a list of emails of its employees.

github.com/s0md3v/Zen

#python

Github Osint Thread🧵#1
OsintEye

Getting detailed information about Github user and getting list of his followers.

github.com/rlyonheart/osi…

#python

Github Osint Thread🧵#2
Read 22 tweets
9 Dec
Create "Sock Puppet" (fake account) for making contact with the target and collecting information through dialogue

Links, tips and tricks.

Thread🧵🧵🧵

(0/14)
It is very unlikely that your target is new to the Internet and does not yet know how to use Google Images, Yandex Images and Search4faces.

Therefore, you need a unique face of a non-existent person for an avatar. Neural networks help.

"Sock puppet" thread🧵 (1/14)
generated.photos/face-generator allows you to configure many parameters for the generated face: skin color, gender, age, emotions...

Pay special attention to the "Headpose" parameter. A slightly raised head will make the fake look more natural.

"Sock puppet" thread🧵 (2/14)
Read 21 tweets
8 Dec
Today already 464 links on my Worldwide OSINT Tools Map (+28).

cipher387.github.io/osintmap/

In this thread🧵 I will tell you how to use this tool.

(1/5)

#osint #geoint
Note that the map has a built-in search function. You can enter the name of a city or country, find it on the map, and see what checkboxes are next to it (adjust zoom to see more).

Red — services for countries
Blue — regions
Green — cities
White — continents
Black...

(2/5)🧵
You can also press Ctrl+F (or Command+F) and search the text table below the main map.

(3/5)🧵

#osint #geoint
Read 11 tweets
7 Dec
Facebook (Meta) #osint thread 🧵🧵🧵 (0/10)
Sowsearch.info

Show how the current Facebook search function works, after Graph search was closed.

It allows you to construct a URL with encrypted parameters to search for posts, people, groups, pages, etc.

Facebook (Meta) #osint thread 🧵🧵🧵 (1/10)
plessas.net/facebookmatrix

A detailed guide on how to create a URL with encrypted parameters for Facebook search (a technology used by the Sowdustsearch service).

Facebook (Meta) #osint thread 🧵🧵🧵 (2/10)
Read 16 tweets
6 Dec
9 basic tools to search, collect and analyze information in the TELEGRAM messenger (500 million users in 2021)

Extremely popular in the countries of the former Soviet Union and Iran.

#osint #socmint #telegram

🧵🧵🧵 thread
Teledago

Tool based by Google Custom Search Engine.

Search in Telegram, Telegraph, Stickers, Voice Chats, Contacts, Messages, Bots, Videos.

cse.google.com/cse?q=+&cx=006…

Telegram #osint 🧵🧵 1/11
Exgram

Tool based by Yandex Custom Search.

Search by 17 telegram content aggregator sites.

yandex.ru/search/site/?t…

Telegram #osint 🧵🧵 2/11
Read 18 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(