Our paper "Function-Space Learning Rates" is on arXiv! We give an efficient way to estimate the magnitude of changes to NN outputs caused by a particular weight update. We analyse optimiser dynamics in function space, and enable hyperparameter transfer with our scheme FLeRM! 🧵👇
NN training learns input-output functions. But we typically understand optimisers as acting in parameter space. For example, traditional learning rates tell us how much parameters change each step, rather than the effect on the learned function.
Can we meaningfully quantify and control learning in function-space? Sure! But a naive approach would require a backwards pass for every output node fₖ, resulting in K backwards passes (in LLMs, K = vocab size = 50,000+). EVERY ITERATION.
the fact that a youtube channel with 11 million subscribers decided to use a photo of junko furuta, a victim of one of the most horrific cases of femicide ever recorded, as a creepy decoration for a silly halloween episode with a kpop group is nauseating
the video appeared on my tl and i legitimately had to quadruple check if i was seeing it right
the youtuber's response confirming that she knew what the picture was. i fail to understand how putting up a picture of junko with her eyes crossed out, with no mention of her name, alongside pictures of creepy dolls and cobwebs, is supposed to be homage to a deceased teenager.
Buenos días. Hilo del día 1.353 de la guerra entre Rusia y Ucrania. Kiev resiste. Mientras tanto, la élite de Putin sigue haciendo de las suyas. Os presento a Vadim Vashchenko, de 22 años, de la región de Stavropol. Fue asesinado por dos soldados que habían vuelto a casa.
Según la investigación, en la noche del 15 de febrero de 2025, los veteranos Sergey Polezhaylov e Igor Kardanov torturaron brutalmente a Vadim: lo golpearon, estrangularon, le echaron agua hirviendo y lo cortaron con un cuchillo.
Ambos atacantes tenían antecedentes penales, incluyendo asesinato. Tras participar en la guerra, recibieron un indulto y fueron recibidos como «héroes». Fueron detenidos, quieren volver al frente y las autoridades no reconocen el crimen como asesinato.
#هذا_الكتاب لم أكتبه لأبيعه أو أسوق له، بل بحثت عن الفائدة الحقيقية للناس.
قررت أن أنسخ لكم كل محتواه من أول صفحة حتى آخر صفحة هنا على تويتر مجانًا، لتستفيدوا وتتعلموا بعمق
1.شغف البداية – The Spark of Beginning
2.وعي اللحظة – Awareness of the Moment
3.طريق النور – The Path of Light
4.إشعال الحلم – Igniting the Dream
5.خطوة الوعي – The Step of Awareness
6.العودة إلى الذات – Returning to the Self
7.المعنى الحقيقي – The True Meaning
8.بداية التحول – The Start of Transformation
9.تنفس الهدوء – Breathe the Calm
10.قوة النية – The Power of Intention
11.الصمت الواعي – Conscious Silence
12.ولادة الشغف – Birth of Passion
13.التوازن الداخلي – Inner Balance
14.إصغاء الروح – Listening to the Soul
15.لحظة الامتنان – Moment of Gratitude
16.استيقاظ القلب – Awakening the Heart
17.وضوح الرؤية – Clarity of Vision
18.طاقة الإيمان – The Energy of Faith
19.انسجام الروح – Harmony of the Soul
20.صدق النية – Purity of Intention
21.شجاعة البداية – Courage to Begin
22.طريق الشغف – The Path of Passion
23.هدوء الفكر – Calmness of Thought
24.الضوء الداخلي – The Inner Light
25.نداء الحلم – The Call of the Dream
26.ثقة الروح – The Confidence of the Soul
27.همس الإلهام – Whisper of Inspiration
28.التغيير الهادئ – The Quiet Change
29.رقة الوعي – The Subtle Awareness
30.لحظة التركيز – The Moment of Focus
31.تجديد الذات – Renewal of the Self
32.انبعاث القوة – Rise of Strength
33.مرونة الروح – Flexibility of the Spirit
34.إشراقة يوم جديد – Glow of a New Day
35.عبور الخوف – Crossing the Fear
36.الصبر الجميل – The Beautiful Patience
37.ثبات الخطوة – The Steady Step
38.إشراق الأمل – Shine of Hope
39.نداء الهدوء – The Call of Peace
40.بوابة الوعي – The Gate of Awareness
41.رحلة الشفاء – Journey of Healing
42.صفاء القلب – Purity of Heart
43.عودة الإلهام – Return of Inspiration
44.رائحة الحلم – The Scent of a Dream
45.بداية التوازن – Beginning of Balance
46.خفة الروح – Lightness of Spirit
47.سلام النية – Peace of Intention
48.سكون الجمال – Stillness of Beauty
49.إيمان متجدد – Renewed Faith
50.استمرارية الأمل – Continuity of Hope
51.الإلهام الخفي – Hidden Inspiration
52.بريق الحلم – Sparkle of a Dream
53.يقين الروح – Certainty of the Soul
54.إشراق النية – Shine of Intention
55.بساطة الوعي – Simplicity of Awareness
56.التوازن النوراني – Luminous Balance
57.إشعال الحلم الداخلي – Igniting the Inner Dream
58.قوة الإرادة – Power of Will
59.مواجهة الشك – Facing Doubt
60.الأمل المستمر – Endless Hope
61.التغلب على الخوف – Overcoming Fear
62.التركيز على الهدف – Focusing on the Goal
63.الصبر على الطريق – Patience on the Path
64.إعادة إشعال الشغف – Reigniting Passion
65.استغلال الفرص – Seizing Opportunities
66.تجديد الطاقة – Renewing Energy
67.الثقة بالنفس – Confidence in the Self
68.التغلب على التشتت – Overcoming Distraction
69.إشراق جديد – A New Dawn
70.الاستمرار رغم الصعوبات – Perseverance Through Challenges
71.لحظة الإلهام – The Moment of Inspiration
72.نداء الروح – The Call of the Soul
73.بريق الفكرة – Spark of an Idea
74.عمق المعنى – Depth of Meaning
75.شغف النمو – Passion for Growth
76.ممر الوعي – The Corridor of Awareness
77.جمال الصبر – Beauty of Patience
78.نور البداية – Light of Beginning
79.دفء الإيمان – Warmth of Faith
80.هدوء الإنجاز – Calm of Achievement
81.يقظة الحلم – Awakening the Dream
82.التوازن العاطفي – Emotional Balance
83.الانسجام الداخلي – Inner Harmony
84.عودة الضوء – Return of the Light
85.بداية الثقة – Beginning of Trust
86.معنى الثبات – Meaning of Steadiness
87.تجدد الشغف – Passion Renewed
88.صوت الوعي – Voice of Awareness
89.ملامح الهدف – Shape of Purpose
90.نهر الأمل – River of Hope
91.طمأنينة الروح – Tranquility of the Soul
95.لحظة التغيير – The Moment of Change
96.عبور الظلال – Crossing the Shadows
97.استراحة الوعي – Pause of Awareness
98.بهجة الإنجاز – Joy of Achievement
99.اكتمال الحلم – Completion of the Dream
100.شكر الرحلة – Gratitude for the Journey
كل بداية تحتاج عزيمة تُشعلها وثقة تسندها.
العزيمة هي لحظة الصدق مع الذات، والتوكل هو الجسر بين النية والفعل.
في بدايتك، لا تنتظر الظروف أن تكتمل، بل اكملها أنت بالإيمان والعمل♥️
التأمل
اللحظة التي تعي فيها أن الله معك ليست مجرد زمن، بل وعيٌ يسكنك.
كل همٍّ يذوب حين تدرك أنك لست وحدك في الطريق.
الوعي باللحظة هو انفتاح القلب على حضور الله،
حيث يصبح “الآن” ميدان عبادة، لا عبورٍ عابر.
التطبيق العملي
في كل مرة تشعر بالقلق، توقّف قليلًا، خذ نفسًا عميقًا، وقل:
“الله معي، الله يراني، الله يهديني.”
دع هذا الوعي يردّك إلى سكونٍ يشبه السجود الداخلي.
“اللحظة الواعية ليست ما يحدث حولك، بل ما يحدث داخلك حين تتصل بالله بصدق♥️
CRYPTO BROS TRIAL DAY 18: In Trial for Taking $25 Million from Ethereum Sandwich Bots, jury Day 3, note coming, after hypo - interim book here: AMZN paperback Code Is Law (?) after verdict; Inner City Press will live tweet, thread below play.google.com/store/books/de…
11:15 am, Jury foreperson said there is a note for the judge. So far, none of the lawyers (or brothers) back in courtroom. But Inner City Press is on it - thread continues below
11:23 am -
Now all the lawyers, the brothers and father are in the courtroom. Waiting for Judge Clarke.
In the heart of Breda—in the south of the Netherlands—a dramatic metamorphosis is underway: the Nieuwe Mark, where a corridor once dedicated to cars is being transformed into a blue-green vein; part of the city's vision to make its centre more liveable, natural and sustainable.🧵
Breda has long been a car city, and in their infinite wisdom, its post-war planners filled in and rerouted the Mark River around the centre to make room for the car. But now, the waterway is being brought bank into the city, while introducing plants, trees and fauna on its banks.
This strongly aligns with their ambition of "The city of Breda, centrally located in a green park", while contributing to myriad broader objectives such as climate adaptation, biodiversity, nature inclusivity, innovation, recreation, tourism, social cohesion, and quality of life.
@Volound @imPenny2x Ok, Musk’s $1T story is the trigger. I’ll agree co-ops/EO's are valid alternatives.
Labeling non co-ops “parasitic vampirism” is simplistic: some workers prefer higher base pay/shares over pure ownership. Both can serve workers differently.
Not sure why you have so much anger?
Long COVID in women and men are not the same disease. They share symptoms, but diverge in biology - immune, hormonal, and genetic.
After months since the preprint -
peer-reviewed study is now out in Cell Reports Medicine.🧵
This is the complete analysis immunity, hormones, and gene expression in 78 Long COVID with ME-CFS patients.
It confirms what patients have said for years -
this condition is biological, measurable, and deeply sex-specific.
In women, the immune system never stands down.
chronic inflammation, exhausted T cells, and loss of regulatory Tregs
leaky gut - constant immune activation
high IL-6, IL-1α, TNF-α, IFN-γ
low testosterone and cortisol - hormones that normally keep inflammation in check.
It’s not overreaction. It’s immune dysregulation.
Chronic inflammation meets hormonal collapse.
Ridley shows how one can get away with being wrong on topic after topic, as long one states the paranoid ideological narrative many conspiracy theorists want to hear.
1/X) SIN EL GAS RUSO EL SISTEMA DE BIENESTAR SE DERRUMBARÁ EN ALEMANIA.
👉 El gas ruso NUNCA fue barato para Alemania❗
👉 Si responde hágalo con eduación como corresponde a un prof. universitario, no insultando como ha hecho 2 veces @atvingeniero
2/X) Alemania nunca ha tenido ese "gas barato" ruso del que tanto se habla. La competitividad de las empresas alemanas se ha basado siempre en valor añadido.
3/X) Último contrato de Basf y EON firmado con Gazprom en 2017 tenía un precio puesto en la frontera alemana de 23 EUR/MWht . Eso no es barato como debería saber un profesor del ramo @atvingeniero
👉 Hay que decir que: NO EXISTE GAS BARATO EN EL MUNDO.
Bolsonarismo é niilismo? 1/ Não é só xingamento filosófico. É a ideia de que, no núcleo do movimento, não existe compromisso real com verdade compartilhável – só com a narrativa útil para o grupo naquele momento.
2/ Niilismo aqui não é "não acreditar em nada" no sentido existencial.
É algo mais concreto: não existe fato que não possa ser descartado como "narrativa" se atrapalhar o líder. Só vale o que reforça o "nós" contra "eles".
3/ O bolsonarismo nasceu e cresceu nas redes.
Rede social não premia verdade, premia engajamento.
Memes, meias verdades, teorias da conspiração, ataques viralizáveis.
A política vira marketing agressivo em busca de cliques – é o terreno ideal pro niilismo.