Post

How to get URL link on X (Twitter) App

On the Twitter thread, click on or icon on the bottom
Click again on or Share Via icon
Click on Copy Link to Tweet
Paste it above and click "Unroll Thread"!
More info at Twitter Help

Kyunghyun Cho

@kchonyc

Sep 11, 2020 • 8 tweets • 4 min read • Read on X

https://twitter.com/VectorInst/status/1304176452317982722

i'm quite embarrassed and wanted to sweep it under a rug, but let me share what happened behind this, largely for my own record/reminder and for a small hope this might raise awareness.

https://twitter.com/VectorInst/status/1304176452317982722

1st&foremost, it was totally my oversight to miss that the keynote speaker lineup was entirely composed of male speakers, including myself, which would've reinforced the lack of diversity and also potentially sent out a wrong sign to many participants and others, in our fields.

i've been calling out similar cases myself earlier pretty both publicly & privately (see e.g. slide 80 in drive.google.com/drive/u/0/fold…), but i've apparently fallen into the trap of seeing others' faults while failing to see my own. how embarrassing and eye-opening!

@tarfandy

when @tarfandy called it out

https://twitter.com/tarfandy/status/1302227213287411714

, i realized but then hesitated for a moment: what should i do? should i do anything? after all, i accepted the invitation w/o knowing the lineup. if i stay silent, wouldn't it just go away and only a few (if any) remembers?

you know.. producing an infinite series of possible excuses in my head. but, as they say, better late than never. i decided to see if i could somewhat alleviate this issue, while expecting the worst: offending organizers, alternative speakers &/or perhaps even participants.

@hhexiy

thankfully, @hhexiy kindly understood the situation & my intention and agreed to replace me. i'm super excited to hear from her how to "Unlearn dataset bias for robust language understanding" super exciting! i highly recommend everyone to attend and listen to her talk.

@sedak99

the organizers @sedak99 were very open to this last-minute suggestion. i'm thankful they decided to take this extra step in the last minute. the workshop looks fantastic, and i'm looking forward to attending it next week: vectorinstitute.ai/event/natural-…

@tarfandy

of course, i must thank @tarfandy for calling it out. this was a great opportunity for me to look at myself rather than at others.

• • •

Missing some Tweet in this thread? You can try to force a refresh

This Thread may be Removed Anytime!

Twitter may remove this content at anytime! Save it as PDF for later use!

More from @kchonyc

Kyunghyun Cho

@kchonyc

Jul 23

enjoying #ICML2024 ? already finished with llama-3.1 tech report? if so, you must be concerned about the emptiness you'll feel on your flight back home in a couple of days.

do not worry! Wanmo and i have a new textbook on linear algebra for you to read, enjoy and cry on your long flight.

(1/5)

have you ever wondered why SVD comes so late in your linear algebra course?

both wanmo (math prof) and i (cs prof) began to question this a couple of years ago. after all, svd is one of the most widely used concepts from linear algebra in engineering, data science and AI. why wait until the end of the course?

(2/5)

we began to wonder further whether SVD can be introduced as early as possible. i mean ... even before introducing positive definite matrices, matrix determinants and even ... eigenvalues (gasp!) without compromising on mathematical rigors.

(3/5)

Read 5 tweets

Kyunghyun Cho

@kchonyc

Jul 23

very cool to see a pretty exhaustive and extensive technical report on llama-3.1!

a few fun snippets 🧵

PLEASE release this custom html parse PLEASE 🙏

lesson 1: AGI won’t happen due to the degrading QC of NVIDIA.

lesson 2: even Meta couldn’t figure out NCCL watchdog timeout error 😂

Read 9 tweets

Kyunghyun Cho

@kchonyc

Jul 10

we all want to and need to be prepared to train our own large-scale language models from scratch.

why?

1. transparency or lack thereof
2. maintainability or lack thereof
3. compliance or lack thereof

and because we can, thanks to amazing open-source and open-platform ecosystem.

(1/12)

we have essentially lost any transparency into pretraining data.

(2/12)

we are being force-fed so-called values of silicon valley tech co's, ignoring the diversity in values across multiple geographies, multiple sectors and multiple groups.

(3/12)

Read 13 tweets

Kyunghyun Cho

@kchonyc

May 15

this semester (spring 2024), i created and taught a new introductory course on causal inference in machine learning, aimed at msc and phd students in cs and ds. the whole material was created from scratch, including the lecture note and lab materials;

1/4docs.google.com/document/d/1qN…

now that the course is finally over, i've put all the lab materials, prepared by amazing @taromakino, @Daniel_J_Im and @dmadaan_, into one @LightningAI studio, so that you can try them out yourselves without any hassle;

2/4lightning.ai/kc119/studios/…

i'm also making the lecture note i used to teach lectures throughout the semester publicly as well at .

3/4arxiv.org/abs/2405.08793

Read 4 tweets

Kyunghyun Cho

@kchonyc

Aug 23, 2021

@genentech

good morning!

as i tweeted last week, Prescient Design Team at gRED within @genentech is hiring awesome people. in particular, we have the following positions already open and ready:

[Engineering Lead] we want you to work with us to build a team for creating an ML infrastructure that seamlessly integrate between ML and bio: gene.com/careers/detail…

@stephenrra

[Machine Learning Scientist] we have a ton of challenging problems inspired & motivated by biology, chemistry & medicine that are waiting for your creativity, knowledge and ingenuity in ML/AI: gene.com/careers/detail…

cc: @stephenrra

Read 6 tweets