Profile picture
Sebastian Ruder
@seb_ruder
, 2 tweets, 2 min read Read on Twitter
A Survey on Cross-lingual Word Embedding Models has been published in @JAIR_Editor. If you're interested in cross-lingual learning, then this should be a good starting point. It covers the history and points to interesting future directions.
jair.org/index.php/jair…
@JAIR_Editor For a more in-depth review that covers the most recent models, you can check out our book Cross-lingual Word Embeddings: morganclaypoolpublishers.com/catalog_Orig/p…
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to Sebastian Ruder
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

More from @seb_ruder see all

Profile picture
Sebastian Ruder
@seb_ruder
Coming up: A live Twitter thread of Session 8B: Machine Learning @NAACLHLT with some awesome papers on vocabulary size, subwords, Bayesian learning, multi-task learning, and inductive biases
@NAACLHLT First paper: How Large a Vocabulary Does Text Classification Need?
A Variational Approach to Vocabulary Selection aclweb.org/anthology/N19-…
@NAACLHLT Wenhu:
- Typically need to predefine vocabulary to get embeddings
- Most common approach: frequency-based cutoff; can lead to under-sized or over-sized vocabulary
Read 49 tweets
Profile picture
Sebastian Ruder
@seb_ruder
David Silver on Principles for Reinforcement Learning at the #DLIndaba2018. Important principles that are not only applicable to RL, but to ML research in general. E.g. leaderboard-driven research vs. hypothesis-driven research (see the slides below).
Principle 2. How an algorithm scales is more important than its starting point. Avoid performance ceilings. Deep Learning is successful because it scales so effectively.
Principles are meant to be controversial. I would argue that sample efficiency is at least as important.
Principle 3. Generality (how your algorithm performs on other tasks) is super important. Key is to design a diverse set of challenging tasks.
This. We should evaluate on out of distribution data and new tasks.
Read 10 tweets
Profile picture
Sebastian Ruder
@seb_ruder
#Repl4NLP at #ACL2018 panel discussion:
Q: Given that the amount of data and computing power is rapidly increasing, should we just quit working on models altogether?
Yejin: Sounds like a good idea for the companies. The more data the better. Please create more data.
Meg: Different people have different strengths. People say: “We should all care about ethics”. Geek out about what you love. Apply yourself to what you. Lots of other things that come to bear besides just working with data, e.g. sociology, psychology, maths, etc.
Important to focus on what you really love. Work with people that have complimentary and different interests.
Yoav: Personally don’t work on huge data. If some company would like to train a huge LM on the entire web, that’d be great to have and analyze.
Read 39 tweets

Related threads

Profile picture
Anina Bennett
@bigredhair
I updated my comic book learning portal! On this page I post curated links for comics creators, to resources about making comics and making a living: bigredhair.com/about/teaching… #teachingcomics
This page has my curated resource links for educators and librarians, about using comic books as a teaching aid, studying comics, teaching how to make them, and graphic novels in libraries: bigredhair.com/about/teaching… #teachingcomics
This one's for parents and young readers, with my curated links to all-ages graphic novel publishers, recommended reading lists by age group, activity books, and more: bigredhair.com/about/teaching… #teachingcomics
Read 5 tweets
Profile picture
Gary Holland 🇺🇸 ⭐️⭐️⭐️ 🇺🇸
@gholland04
!!DECODE (06/19/19 9:109 PM EST)

DECODE 06/19/2019 — POTUS Tweet T-6419 & T-6420

Buckle up, buttercups - it's about to get bumpy!

#Qanon
@realDonaldTrump

...
1.
POTUS Tweets T-6419 & T-6420

Here we find …

TimeStamp 9:20
Time Delta 1h 31m
Caps Gematria Values 477, 511
Keywords:
ICE, USA, Mexico, Souther Border, Illegal, Aliens

...
2.
The TimeStamp 9:20 +1200 Clue
Leads us to Q-Drop 2120

(Note: Q-Drop 920’s TimeStamp was Invalid)

Here we find …

Flag of Freedom

...
Read 576 tweets
Profile picture
Nathaniel Whittemore
@nlw
Long Reads Sunday #51.

Oh. My. God. This week. Facebook Libra squads up. Binance🖕US. Mass delistings. State power resurgent. Pomp’s birthday!

Bitcoin doesn’t sleep and neither do I on weeks like this!

Strap in, kids, it’s long reads time!
2/ Let’s start with the massive. We’ve been talking about FBcoin nonstop and this week we got official info about the first node partners - Uber, Visa, and PayPal. There was a ton of discussion but @Ben_Munster really captured the attitude here: decrypt.co/7464/facebook-…
3/ But then, like a SCOOPS AI from the future, @fintechfrank swooped in on Friday with the *entire* list of kick off partners for Libra, including investment firms, nonprofits, telcos, e-commerce, travel, music, ride-sharing, and payments.
Read 48 tweets
Profile picture
♰🇺🇸🕵 A Anon ⭐⭐⭐
@AAnon_QArmy
🕵Q's Army🕵

Do you #think #QsArmy is just a bunch of #people sitting at the #computer doing nothing?💻

Do you think #DigitalSoldiers are #stealing #valor?🎖

Do you think #QSoldiers are wasting their #time, not doing anything to #help?🕰

If so then please read #thread.
💊💊⤵
The first thing you have to #understand is the #RippleEffect. When you find a #Fact, you share it. Now the #information has a starting point. #Everyone is a starting point for #someone.

👥 👥
👥👥 👥👥
👥👥🕵👥👥
👥👥👥👥
👥👥

We call it #RedPilling. 💊
It can take a long time to find all the #facts. Hours of #digging.

#Imagine if you were being told #lies by the #news and no one was willing to take time out of their day to #find the #Truth. No #Opposition! No one watching [them].

#WeAreTheNewsNow. The protectors of truth.⤵
Read 17 tweets
Profile picture
#PoorPeoplesCampaign
@billyjoecain
At dinner, I learned more about corruption + racism built into society by our masters. A book we discussed (Zinn) was used as part of this "Left" resource's bibliography. I had to share. [A thread]

@BlackSocialists - thoughts on this resource?

historyisaweapon.com/indextrue.html
It very simply lays out the case that we are all being controlled. It covers hidden history of the United States including their (and, due to the systems created by our masters, our) racism. 

#racism #systemicracism #history
If you haven't been in school for a while (or are in a terrible school), some of the words might trip you up. Dictionary.com and Wikipedia.org are two good resources to help you.
Read 39 tweets
Profile picture
Millennial Macro
@MillennialMacro
#demographics #militaries #economies #currencies
#USA
- Best demographics
- Largest military
- Largest economy
- Most used currency
- Liquid financial markets
- Open capital account
- Rule of law
- Best geography
- Can be self sufficient if required
- Not trade dependent
#USA
Top trade partners as of 30 June 2018:
- China: 15.2% (strategic competitor)
- Canada: 15.1%
- Mexico: 14.6%
- Japan: 5.1%
- Germany: 4.4%

The next 10 years could result in the below:
- Mexico (25%)
- Canada (20%
- Japan (7%)
- South Korea (5%)
- Great Britain (4%)
#USA
Bring the manufacturing (jobs) home while negatively impacting China's economy.
forbes.com/sites/kenrapoz…
cebglobal.com/talentdaily/au…
irishtimes.com/business/econo…
Read 338 tweets

Trending hashtags

#Europe #geopoiltics #music #disobedience #systemicracism #politics #battle #currency #find #USTR #Feminism #slavery #Bulgaria #Soldiers #literature #Central #Foreign #culturalappropriation #Voices #anthrotalk #well #Information #Machine #control #uprising
Follow Us on Twitter!

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!