In this thread I will show you how the #python library "duckduckgo_search" works.
You can use it to automate regular searches in DuckDuckGo, as well as searches for images, videos, news, objects on a maps, and even text translation.
pypi.org/project/duckdu…
This code allows web pages to be searched automatically by DuckDuckGo. You can configure keywords, search region and number of sites.
The results will show links, headings and some of the text of the pages.
🧵
Sep 23, 2022 • 11 tweets • 11 min read
Tools to increase the efficiency of working with MAPSs in #osint (more exact #geoint)
Quick basic thread
(1/10)🧵
These tools will help you measure the area of individual map sections (in square and polygon form), the radius of circle on the map, the distance between points of complex routes, etc.
(WARC - the general format for webarchiving, which is used by archive.org, the Australian Web Archive, and many other well-known Internet archives)
The WARC (Web ARChive) file format offers a convention for concatenating multiple resource records (data objects), each consisting of a set of simple text headers and an arbitrary data block into one long file (с).
"Simulates real human Google search behavior to prevent rate limiting by Google and if HTTP 429 blocked by Google, logic to back off and continue trying" (c)
8 types of government open databases that many countries have and that will be useful to investigate.
Each link is just an example. In the last tweet I will tell how to find government resources for a particular country.
(1/10) 🧵🧵🧵
Business Registries
On these sites you can find out by person's name the companies that belong to him, addresses, phone numbers, occupation, etc (data set varies by country).
Let's start with the easiest and fastest option. Use NAMINT from @seint_pl.
It will generate possible name variants and links to search for them in various search engines (+ possible emails and document search + social media accounts)
- reverse images search engines and advanced search operators;
- photo processing tools for a more successful search;
- face photo search;
- automation.
(1/16) 🧵🧵🧵
The tool I recommend you start your search with is Yandex Images.
Not only does it search very well for similar images, but it also recognizes the text on them and identifies the location if it is an image of a famous landmark.
- how to search for cameras (including vulnerable cameras)
- how to save streams from cameras
- how to analyze video
🧵🧵🧵(1/15)
You can search for cameras using Google Custom Search Engine, which brings together the ten largest aggregators of camera streams (Webcamtaxi, Insecam, Geocam etc).
New search engine from @dancho_danchev developed especially for #osint specialists!
It has many filters and advanced search operators that can help you analyse the information you find more quickly and effectively.
I will talk more about them in this🧵
It's possible to filter results by filetype, language, domain, author, keywords and protocol (https or http) and also sort by date.