Tweet

@tiangolo

This Thread may be Removed Anytime!

Twitter may remove this content at anytime! Save it as PDF for later use!

More from @philipvollet

Philip Vollet

@philipvollet

24 Apr

Why is machine learning so important for healthcare?

A short thread on topic.

Let's look at Multiple Sclerosis!

1/6

Multiple Sclerosis is an umbrella term

What does that mean?

MS is a disease with different subtypes, symptomatology and manifestations.

2/6

As different as these can be, so different should be the treatment.

Why?
Based on the subtype differentiation, treatment options should be considered. MS treatment and patient response could be very different.

How did ML help here?

3/6

Read 6 tweets

Philip Vollet

@philipvollet

21 Apr

Using machine learning to understand whales?

The past decade has witnessed a groundbreaking rise of machine learning for human language analysis, with current methods capable of automatically accurately recovering various aspects of syntax and semantics - including sentence

structure and grounded word meaning - from large data collections.

Recent research showed the promise of such tools for analyzing acoustic communication in nonhuman species.

They posit that machine learning will be the cornerstone of future collection, processing, and analysis of multimodal streams of data in animal communication studies, including bioacoustic, behavioral, biological, and environmental data.

Read 6 tweets

Philip Vollet

@philipvollet

20 Apr

Machine learning from development into production as a team

What about
• Dependencies?
• Reproducibility?
• Continuous integration?

Save the hustle with these simple practices

↓ 1/6

Usually you start with a Jupyter notebook to make them robust especially working as a team nbdev is a life saver

GitHub github.com/fastai/nbdevq

↓ 2/6

nbdev is a library that allows you to develop a python library in Jupyter Notebooks, putting all your code, tests and documentation in one place. That is: you now have a true literate programming environment, as envisioned by Donald Knuth back in 1983!

↓ 3/6

Read 8 tweets

Philip Vollet

@philipvollet

19 Apr

Does BERT Pretrained on Clinical Notes Reveal Sensitive Data? • Large Transformers pretrained over clinical notes from Electronic Health Records (EHR) have afforded substantial gains in performance on predictive clinical tasks.

Paper arxiv.org/abs/2104.07762
GitHub

↓ 1/4

github.com/elehman16/expo…

The cost of training such models and the necessity of data access to do so is coupled with their utility motivates parameter sharing, i.e., the release of pretrained models such as ClinicalBERT.

↓ 2/4

While most efforts have used deidentified EHR, many researchers have access to large sets of sensitive, non-deidentified EHR with which they might train a BERT model (or similar).

Would it be safe to release the weights of such a model if they did?

↓ 3/4

Read 4 tweets

Philip Vollet

@philipvollet

22 Jan

Just a normal machine learning paper: Can a Fruit Fly Learn Word Embeddings? Apple cider vinegar and some drops of dish soap → Is All You Need

Paper arxiv.org/abs/2101.06887

The mushroom body of the fruit fly brain is one of the best studied systems in neuroscience.

#nlproc

At its core it consists of a population of Kenyon cells, which receive inputs from multiple sensory modalities.

These cells are inhibited by the anterior paired lateral neuron, thus creating a sparse high dimensional representation of the inputs.

In this work they study a mathematical formalization of this network motif and apply it to learning the correlational structure between words and their context in a corpus of unstructured text, a common natural language processing (NLP) task.

Read 4 tweets

Philip Vollet

@philipvollet

22 Jan

@emilymbender

Hey NLP is not only machine learning it also has to do with language.

But you are not alone!

Here are some of my classics that deal with linguistics

Linguistic Fundamentals for Natural Language Processing
by @emilymbender

May all-time favorite & silver bullet! A must read.

The beauty of this book is that it explains the most important linguistic concepts in short chunks and illustrates this with easy to understand examples

Book amazon.de/-/en/Emily-M-B…

eBook morganclaypoolpublishers.com/catalog_Orig/p…

Speech and Language Processing by Dan Jurafsky and James H. Martin web.stanford.edu/~jurafsky/slp3/

You are pulled into the topics very immersively and you can not stop reading! You literally soak up the knowledge

Read 4 tweets

Share this page!

Philip Vollet

Try unrolling a thread yourself!

More from @philipvollet

Philip Vollet

Philip Vollet

Philip Vollet

Philip Vollet

Philip Vollet

Philip Vollet

Did Thread Reader help you today?

Like this author's thread?