Thread by @_aisapiens

We have added new #nodejs modules for #URL #Database which contains millions of domains classified for their categories using #machinelearning model:
yarnpkg.com/package/urldat…
npmmirror.com/package/urldat…
npmtrends.com/urldatabase

URL database was formed by collecting websites of millions of domains.

pre-processing their texts (lemmatization, punctuation removal, removal of stop words)

and then sending them to website classifier

which was previously trained on millions of labelled texts, according to 21 main categories. We also have other classifiers, which are more detailed and have 440+ categories.

Website classifiers are also available as modules:
jsdelivr.com/package/npm/we…
socket.dev/npm/package/we…
openhub.net/p/websitecateg…
@threadreaderapp unroll