Osint For All Profile picture
Jan 3 11 tweets 12 min read
Hey #OSINT🕵, let's create our OWN Internet Archive/The Wayback Machine. Shall we?

#verification #archive #archivetwt #internet #InternetMarketing #journalism #journalist #journal #Fact #FactCheck #Factcheckers

Follow the thread 🧵👇
Today the Internet Archive has a collection of nearly 625 billion web pages, 38 million books and texts, 14 million audio recordings, 7 million videos (including 2 million Television News programs), 4 million images, 790,000 software programs and more.

#journalism #journalist
With all due respect, we don’t need all the data that’s been recorded by the Internet Archive. Usually people save pages on the Wayback Machine that are relevant to them.

So let's use 'Archive Box' @ArchiveBoxApp to make our own archive.

#Fact #FactCheck #Factcheckers
ArchiveBox is an open source internet archiving solution to collect and save the relevant web pages of our choice offline. It comes in many forms, we can set that up on Windows, GNU/Linux and MacOS. It can be used as a command line tool, a web app and a desktop app(alpha). #OSINT
SETUP

1. Open the terminal and type:
curl -sSL 'get.archivebox.io' | sh

2. Change the directory.

#Fact #FactCheck #Factcheckers #OSINT
3. Now let’s run our archivebox server locally. Type the following command inside /archivebox directory.

archivebox server 0.0.0.0:8000

#verification #archive #archivetwt #internet #InternetMarketing
4. As we can see in the image, we’ll copy and paste(or click) http://0.0.0.0:8000/ to our favorite browser.
#verification #archive #archivetwt #OSINT
5. Now we can type any URL on the search bar, here we have already archived ‘example.com’. If we click on the ‘Example Domain’ at the left, we can see all the contents of example.com that are archived.
#verification #archive #archivetwt #OSINT
6. All the contents that are archived will be stored in the /archive directory.
#verification #archive #archivetwt
7. We can also import URLs regularly on schedule.

archivebox schedule --every=day --depth=1 example.com/rss.xml

#infosec #infosecurity
That's the wrap 😎 Go check out - archivebox.io

Follow us @AllForOsint

Subscribe - youtube.com/@osintforall

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Osint For All

Osint For All Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @AllForOsint

Dec 26, 2022
Hey #OSINT, did you enjoy Christmas? 🤶 Here's a list of signal intelligence agencies around the world (which send Santa the naughty list) 🕵️ NSA Headquarters
1. UK 🇬🇧 - Government Communications Headquarters
Formed: 1 November 1919; 103 years ago (as Government Code and Cypher School)
commonly known as GCHQ
Headquarters: The Doughnut, Hubble Road, Cheltenham, England, United Kingdom
official site: gchq.gov.uk
2. Netherlands 🇳🇱 - Inlichtingen-en Algemene Veiligheidsdienst
Formed: 30 May 2002; 20 years ago
The AIVD focuses mostly on domestic non-military threats to Dutch national security
Headquarters: Europaweg 4, Zoetermeer, Netherlands
official site: english.aivd.nl
Read 29 tweets
Dec 20, 2022
Hey #OSINT #geolocation #verification 🕵️‍♀️🕵️‍♂️, let's solve a geolocation challenge. Blast from the past. 🤓

Finding Luther — An OSINT Geo location Challenge. 🧵
Step 1: This time I wanted to approach this zero knowledge target differently. So the first thing that I did was to reverse search the image. I got few results on Google & Yandex. Even they pointed out the season and episode number of Luther. #OSINT #geolocation #verification
Step 2: Here’s a tip (if you didn’t know already), IMDB, Rotten Tomatoes, Fandom Wiki pages could be super useful when you are investigating movies or TV shows.
#OSINT #geolocation #verification 🌐
Read 17 tweets
Dec 18, 2022
Hey #OSINT 🕵️‍♀️ Just saw some post within the community talking about the difference between 'Open Source Information' and 'Open Source Intelligence' 🤠 which I believe could be flawed and subjective. Here's why? 👇

First question - All of a sudden, what is this #OSINF
Open Source Intelligence is utilizing publicly available data for various purposes. And what should be considered as 'Intelligence' is dependent on the organization or interests. If one's a journalist or LE or spy, everyone's definition/priorities of 'Intelligence' differs.#OSINT
Usage of JARGON
Gap analysis, Pattern analysis, Strategic analysis (& N number of analysis)

Well, all these are NOT specifically related to OSINT, because there is no standard definition of OSINT. Perhaps, some international orgs have defined it based on their interests.#OSINT
Read 18 tweets
Dec 17, 2022
Hey #OSINT, what is your plan for the weekend? or do you want something interesting to watch? We have a list of documentaries on the most mysterious cases in history which remain unsolved until now. 🕵️‍♀️
1. The Zodiac Killer
is pseudonym of unidentified serial killer who operated in North California in late 60s. It has been described as the most famous unsolved murder case. It became a fixture of pop culture and inspired amateur detectives to solve it.
2. Dyatlov Pass incident
The Dyatlov Pass incident was an event in which 9 Soviet trekkers died in the northern Ural Mountains between February 1 and 2, 1959, in uncertain circumstances.
Read 12 tweets
Nov 29, 2022
Terrorist groups are increasingly adapting to technology to recruit, to disseminate illegal content and to promote violence. #OSINT can help identifying these networks and understanding the way they operate online. Here's a list of tools for researching terrorism:
1. Archives Library Information Center (ALIC) - archives.gov/research/alic/…
2. Counter Extremism Project - counterextremism.com
Read 16 tweets
Nov 28, 2022
Hey #OSINT, Data visualization is the graphical representation of information and data.

Investigations become easier with visual elements like charts, graphs, maps, & tools. #DataVisualization

Here are some must use Data Visualization tools for OSINT investigators.

A thread🧵
1. Osint Combine’s Data Visualization Tool - osintcombine.com/data-visualiza…

2. Gephi - gephi.org

3. ArcGis - arcgis.com/index.html

4. Cytoscape - cytoscape.org

5. SocNetV - socnetv.org

#OSINT #JournalismIsNotACrime #Data #DataVisualization
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(