#OSINT Workflow Wednesday

This week we’ll discuss how to find date/time information of web content even if it’s not obvious. This will help you establish a timeline of content or determine if an article has been altered since the original publication.

Let’s get started.

(1/8)
Step 1: Check the URL

This is a no brainer, but a lot of web content will include the original date it was published in the URL. Keep in mind that this could be an updated URL. We’ll look at other data to determine that next.

(2/8)
Step 2: Check the Sitemap

Simply add “/sitemap.xml” to the end of a URL to check if a sitemap is available. The sitemap usually includes the date/time stamp of when all content was updated on the website. This is great for finding different URL types on a website too!

(3/8)
Step 3: Check Google

If you copy the URL you’re on and paste it after inurl: in Google, the date of publication will sometimes be revealed. This is a good way of testing across multiple domains if your investigation is broader.

(4/8)
Step 4: Check Social Media

If you copy and paste the URL into Twitter, for example, and look for the oldest Tweet, you’ll likely get an idea of how old that post is. If you don’t get any results for the URL, try the article title instead.

(5/8)
Step 5: Check the Images

If all methods have failed so far, right-click and inspect the images on the page. Often, websites include the date of the images as part of the name for the file. If you see an earlier date on the images than you do in the URL it might be altered

(6/8)
Step 6: Check the Comments

Look for the oldest comment on the page if comments are available. While this won’t give you an exact publication date/time, it’ll give you a pretty good idea of how old the article is.

(7/8)
Step 7: Check the Archives

Using a tool like Web Archives, you can quickly check to see if the page you’re looking at has been archived. If you check for the earliest archive date, you can use it to determine a date range or find discrepancies.

github.com/dessant/web-ar…

(8/8)

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Jake Creps

Jake Creps Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @jakecreps

26 Jan
#OSINT Tool Tuesday

It’s time for another round of OSINT tools to help you improve your efficiency and uncover new information. A quick overview:

[+] Reversing Information
[+] Automating Searches with #Python
[+] Testing/Using APIs

RT for Reach! 🙏

(1/5) 👇
The first #OSINT tool is called Mitaka. It’s a browser extension that will reverse multiple data points right from your browser. Right-click what you want to reverse and Mitaka will show you what sources are available. Improve your efficiency!

github.com/ninoseki/mitaka

(2/5) 👇
The second #OSINT tool is called Sitedorks from @zarcolio. It’s a #Python tool to automate your Google queries. Enter a query and it’ll open up to 25+ tabs—checking your parameters across a variety of website categories.

github.com/Zarcolio/sited…

(3/5)☝️👇
Read 6 tweets
19 Jan
#OSINT Tool Tuesday

It’s the third week of the year and time for another set of tools to help you with your work in OSINT. This week will be:

[+] Spaghetti Bookmarklet (mine)
[+] Tab management/automation
[+] OnlyFans?

RT for Reach!

🙏

👇(1/5)
The first #OSINT tool is a bookmarklet I built called Forage and is meant to expand your search across popular social media sites. It takes the username from FB/IG, Twitter, and LinkedIn and expands your search across the web. Expect updates!

github.com/jakecreps/fora…

☝️👇(2/5)
The second #OSINT tool is a browser extension called TabTrum that takes a snapshot of your active tabs and saves them so you can reopen that same combination again with one click. It's saved me SO much time with work and OSINT investigations.

tabtrum.live

☝️👇(3/5)
Read 5 tweets
8 Dec 20
🚨 #OSINT Tool Tuesday

I think I'm going to stick with 2 tools a week. One web-based, the other script-based. This week it's about archives and scaling your work in search engines.

👇 (1/4)
The first tool is from @ODU and it's a web-based tool that will tell you the date a website started and show the earliest archive from multiple sources.

carbondate.cs.odu.edu

👇 (2/4)
The next tool I found through @s0md3v and it's called degoogle which lets you extract results directly. The reason why I included this is that the author claimed to not have run into a captcha for weeks and Somdev said he had 0 with 120+ requests.

github.com/deepseagirl/de…

(3/4)
Read 4 tweets
25 Nov 20
🚨 #OSINT Workflow Wednesday

In addition to OSINT Tool Tuesday, I'm going to start doing Workflow Wednesday where I unpack a process, instead of a tool, for open source intelligence. This week I'm going to talk about how to deconstruct a new social media platform.

👇 (1/9)
Step 1: Map the platform without an account.

You want to see what you can access without registering. Explore the platform from the website but also check out what's indexed by Google and other search engines using site:, -site:, inurl:, intext:, and other operators.

👇 (2/9)
Step 2: Understand the platform's privacy policies and other fine print.

You want to see what the risks are for registering an account including what information is collected and shared. You also want to know what other users can view once you've registered.

👇 (3/9)
Read 9 tweets
10 Apr 20
If you are looking for an tool to help in #OSINT investigations on Twitter..👇🏻
And you find yourself running into a long threat of information that’s difficult to read....👇🏻
Tag the account @threadreaderapp as a comment in the thread.... and get it all in one place!
Read 4 tweets
9 Mar 19
[#OSINT] You can use Twint to find indirect relationships between users. By matching the “conversation_id” to multiple queries, you can discover more insight.
For example, let’s say you’re trying to find violent users on Twitter that are threatening an influencer. Twitter only limits you to search for “influencer name” + “violent keyword”. Using Twint, you can search for all “violent keywords” and then match it to influencer mentions
You can also mine replies within Twint. It’s not in the Wiki, but adding “c.To =“ to your python module will allow you to pull tweets sent “to” someone. By finding the accounts that most mention said influencer, you can take this a a step further
Read 5 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!