Using machine learning to understand whales?

The past decade has witnessed a groundbreaking rise of machine learning for human language analysis, with current methods capable of automatically accurately recovering various aspects of syntax and semantics - including sentence Image
structure and grounded word meaning - from large data collections.

Recent research showed the promise of such tools for analyzing acoustic communication in nonhuman species.
They posit that machine learning will be the cornerstone of future collection, processing, and analysis of multimodal streams of data in animal communication studies, including bioacoustic, behavioral, biological, and environmental data.
Cetaceans are unique non-human model species as they possess sophisticated acoustic communications, but utilize a very different encoding system that evolved in an aquatic rather than terrestrial medium.

Sperm whales, in particular, with their highly-developed neuroanatomical
features, cognitive abilities, social structures, and discrete click-based encoding make for an excellent starting point for advanced machine learning tools that can be applied to other animals in the future.
Abs arxiv.org/abs/2104.08614… whales, in particular, with their highly-developed neuroanatomical

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Philip Vollet

Philip Vollet Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @philipvollet

24 Apr
Why is machine learning so important for healthcare?

A short thread on topic.

Let's look at Multiple Sclerosis!

1/6 Image
Multiple Sclerosis is an umbrella term

What does that mean?

MS is a disease with different subtypes, symptomatology and manifestations.

2/6
As different as these can be, so different should be the treatment.

Why?
Based on the subtype differentiation, treatment options should be considered. MS treatment and patient response could be very different.

How did ML help here?

3/6
Read 6 tweets
23 Apr
Opyrator - Turns your Python functions into microservices with web API and interactive GUI.

GitHub github.com/ml-tooling/opy…

$ 𝚙𝚒𝚙 𝚒𝚗𝚜𝚝𝚊𝚕𝚕 𝚘𝚙𝚢𝚛𝚊𝚝𝚘𝚛 Image
Instantly turn your Python functions into production-ready microservices.

Deploy and access your services via HTTP API or interactive UI.
Seamlessly export your services into portable, shareable, and executable files or Docker images.

Opyrator builds on open standards - OpenAPI, JSON Schema, and Python type hints - and is powered by FastAPI @tiangolo
@streamlit & Pydantic
Read 4 tweets
20 Apr
Machine learning from development into production as a team

What about
• Dependencies?
• Reproducibility?
• Continuous integration?

Save the hustle with these simple practices

1/6
Usually you start with a Jupyter notebook to make them robust especially working as a team nbdev is a life saver

GitHub github.com/fastai/nbdevq

2/6
nbdev is a library that allows you to develop a python library in Jupyter Notebooks, putting all your code, tests and documentation in one place. That is: you now have a true literate programming environment, as envisioned by Donald Knuth back in 1983!

3/6
Read 8 tweets
19 Apr
Does BERT Pretrained on Clinical Notes Reveal Sensitive Data? • Large Transformers pretrained over clinical notes from Electronic Health Records (EHR) have afforded substantial gains in performance on predictive clinical tasks.

Paper arxiv.org/abs/2104.07762
GitHub

↓ 1/4
github.com/elehman16/expo…

The cost of training such models and the necessity of data access to do so is coupled with their utility motivates parameter sharing, i.e., the release of pretrained models such as ClinicalBERT.

2/4
While most efforts have used deidentified EHR, many researchers have access to large sets of sensitive, non-deidentified EHR with which they might train a BERT model (or similar).

Would it be safe to release the weights of such a model if they did?

3/4
Read 4 tweets
22 Jan
Just a normal machine learning paper: Can a Fruit Fly Learn Word Embeddings? Apple cider vinegar and some drops of dish soap → Is All You Need

Paper arxiv.org/abs/2101.06887

The mushroom body of the fruit fly brain is one of the best studied systems in neuroscience.

#nlproc
At its core it consists of a population of Kenyon cells, which receive inputs from multiple sensory modalities.

These cells are inhibited by the anterior paired lateral neuron, thus creating a sparse high dimensional representation of the inputs.
In this work they study a mathematical formalization of this network motif and apply it to learning the correlational structure between words and their context in a corpus of unstructured text, a common natural language processing (NLP) task.
Read 4 tweets
22 Jan
Hey NLP is not only machine learning it also has to do with language.

But you are not alone!

Here are some of my classics that deal with linguistics

Linguistic Fundamentals for Natural Language Processing
by @emilymbender

May all-time favorite & silver bullet! A must read.
The beauty of this book is that it explains the most important linguistic concepts in short chunks and illustrates this with easy to understand examples

Book amazon.de/-/en/Emily-M-B…

eBook morganclaypoolpublishers.com/catalog_Orig/p…
Speech and Language Processing by Dan Jurafsky and James H. Martin web.stanford.edu/~jurafsky/slp3/

You are pulled into the topics very immersively and you can not stop reading! You literally soak up the knowledge
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!