Thread Reader helps you read and share Twitter threads easily!
I'm @ThreadReaderApp a Twitter bot here to help you read threads more easily. To trigger me, you just have to reply to (or quote) any tweet of the thread you want to unroll and mention me with the "unroll" keyword and I'll send you a link back on Twitter 😀
— Thread Reader App (@threadreaderapp) November 25, 2017
X thread is series of posts by the same author connected with a line!
From any post in the thread, mention us with a keyword "unroll"
@threadreaderapp unroll
Follow @ThreadReaderApp to mention us easily!
Practice here first or read more on our help page!
Recent
You're in a Research Scientist interview at OpenAI.
The interviewer asks:
"How would you expand the context length of an LLM from 2K to 128K tokens?"
You: "I will fine-tune the model on longer docs with 128K context."
Interview over.
Here's what you missed:
The interviewer asks:
"How would you expand the context length of an LLM from 2K to 128K tokens?"
You: "I will fine-tune the model on longer docs with 128K context."
Interview over.
Here's what you missed:
Extending the context window isn't just about larger matrices.
In a traditional transformer, expanding tokens by 8x increases memory needs by 64x due to the quadratic complexity of attention. Refer to the image below!
So, how do we manage it?
continue...👇
In a traditional transformer, expanding tokens by 8x increases memory needs by 64x due to the quadratic complexity of attention. Refer to the image below!
So, how do we manage it?
continue...👇
1) Sparse Attention
It limits the attention computation to a subset of tokens by:
- Using local attention (tokens attend only to their neighbors).
- Letting the model learn which tokens to focus on.
But this has a trade-off between computational complexity and performance.
It limits the attention computation to a subset of tokens by:
- Using local attention (tokens attend only to their neighbors).
- Letting the model learn which tokens to focus on.
But this has a trade-off between computational complexity and performance.
Here's what 33% of Republicans and 30% of Independents need to KNOW.
-Trump has not provided the U.S.A with an ECONOMY. PERIOD. He's 2.1 MILLION jobs in the RED...STILL. He lost 277 Million in Season one, created..we THINK...685K so far in Season two. I say WE THINK because 1/
-Trump has not provided the U.S.A with an ECONOMY. PERIOD. He's 2.1 MILLION jobs in the RED...STILL. He lost 277 Million in Season one, created..we THINK...685K so far in Season two. I say WE THINK because 1/
in the 1.6 years of Season Two, there have been SIX DOWNWARD REVISIONS to his initially reported job numbers. That original report is what the 90% of our media now owned by right wing, GOP policy writing Billionaires allow to be broadcast. They NEVER give us the follow up. 2/
-Trump is responsible for 32% of the national Debt...in just 5.6 years in office. In fact, the last four @GOP 'presidents' have INCREASED OUR DEBT BY 151%, vs. the last four Dem's 21% increase.
-After Trump's FIRST 3 YEARS, BEFORE he turned a PAN-demic into a worst in world 3/
-After Trump's FIRST 3 YEARS, BEFORE he turned a PAN-demic into a worst in world 3/
1. For the SECOND TIME IN SIX MONTHS, a foreign real estate development led by Jared Kushner has been derailed by a GOVERNMENT CORRUPTION SCANDAL and mass protests.
Follow along for all the gory details.
🧵
Follow along for all the gory details.
🧵
2. Jared and Ivanka are developing a $4 billion resort centered around an uninhabited island in Albania.
The massive project, which includes 10,000 hotel rooms, is located in one of Europe’s most environmentally sensitive areas.
popular.info/p/kushners-alb…
The massive project, which includes 10,000 hotel rooms, is located in one of Europe’s most environmentally sensitive areas.
popular.info/p/kushners-alb…
3. In 2024, the Albanian government changed the law to allow the area, which was previously part of a protected national park, to be developed.
Then shortly after Trump's election, Kushner, through an LLC, was granted “strategic investor“ status, clearing the way for permits.
Then shortly after Trump's election, Kushner, through an LLC, was granted “strategic investor“ status, clearing the way for permits.
Common Mistakes New Investors Make When Trading Stocks
Save the thread below
Save the thread below
As more people start investing through platforms like Ziidi Trader, many beginners make avoidable mistakes that affect their returns.
Before we go deeper, you can access Ziidi Trader via the One App using the link below:
awj8.adj.st/mini-app?id=34…
Before we go deeper, you can access Ziidi Trader via the One App using the link below:
awj8.adj.st/mini-app?id=34…
Here are the most common ones:
First, chasing hype instead of value. Many new investors buy stocks just because they are trending.
— Rising price ≠ strong company
— Popularity ≠ profitability
— Hype ≠ long-term growth
First, chasing hype instead of value. Many new investors buy stocks just because they are trending.
— Rising price ≠ strong company
— Popularity ≠ profitability
— Hype ≠ long-term growth
There's an inscription from Paṭaivīṭu (c. 1426 AD) that's of interest not just because it attests (implicitly) to local brāhmaṇa-s practicing cousin-marriage, but also as a samayapattra that establishes it in-line with its legal defense by Devaṇṇa Bhaṭṭa (13th c. AD):
Note that as the Bṛhaspati Smṛti (1.6.15) here states, a Samayapattra is a legal document that formally establishes some convention for a specific subgroup provided they don't conflict with the ruling authority.
The specific purpose of the inscription is to establish as law a prohibition on brāhmaṇa-s in Paṭaivīṭu from participating in non-kanyādāna marriages lest they be subjected to an unspecified punishment and loss of caste.
@NadiaWhittomeMP
It's depressingly predictable to witness the outpouring of misinformation and hyperbole following the long-delayed publication of the EHRC's revised Code of Practice. The EA was never an access-all-areas pass to spaces and provisions for the opposite sex:
It's depressingly predictable to witness the outpouring of misinformation and hyperbole following the long-delayed publication of the EHRC's revised Code of Practice. The EA was never an access-all-areas pass to spaces and provisions for the opposite sex:
in particular it never gave the right to any man to declare himself a woman and make use of women's spaces and services on that basis. It's deeply regrettable that trans-identifying people were misled into believing they had rights that they never had, but the EHRC CoP
is not a roll-back of rights, or an attempt to drive trans-identifying people out of public life. It's a carefully-considered balancing act, aimed at making it possible for the single-sex exceptions in the Equality Act to work.
“‘We believe voting should be for the people, not corporations,’ Bernstein told WHYY News.
‘We strongly believe that allowing corporations to vote in local elections harms our democracy and dilutes the voices of voters. So over the coming days we will review the court’s decision and determine our next steps.’”
‘We strongly believe that allowing corporations to vote in local elections harms our democracy and dilutes the voices of voters. So over the coming days we will review the court’s decision and determine our next steps.’”
This is nuts. Court allows Delaware town to permit voting by corporations, trusts and other “artificial entities”.
People who think Lamine Yamal has a lot of PR are just biased Barcelona haters
He is the hottest name in world football for a reason
At 17, finishing 2nd in ballon d’or at 18 competing for it - while people his age are in B teams or competing for young player awards
🧵
He is the hottest name in world football for a reason
At 17, finishing 2nd in ballon d’or at 18 competing for it - while people his age are in B teams or competing for young player awards
🧵
His impact started at 16 years when he bodied france to win the euros.
No one in the world gets marked by 3-4 players except yamal - on top of that he has 293 successful dribbles which means he is that much more impactful to drive the attack forward individually
No one in the world gets marked by 3-4 players except yamal - on top of that he has 293 successful dribbles which means he is that much more impactful to drive the attack forward individually
His g/a numbers are only improving every season with 45/50 something in 2026
He has alone produced as many big chances as whole teams - unfortunately his team mates couldn’t finish all of them
He has alone produced as many big chances as whole teams - unfortunately his team mates couldn’t finish all of them
A Son of the Revolution, my ancestor was a Private in the Hunterdon County Militia under Colonel Philemon Dickinson. His encampment was at Washington's Bridgewater HQ. - Mustered out at the end of the War, his uniform was so infested with lice, it had to burned outside his home.
Gouvernour Morris (Westchester County (NY), who composed the Preamble in a few minutes, was unable to go home during the War, because his half-brother was Staats Long Morris (1728–1800), a Loyalist who served as a Major General in the British Army during the American Revolution.
Both the Treaty of Paris, and the Jay Treaty contained clauses inserted by the British that property confiscated from Loyalists was rightfully theirs, and was to be returned to those who had left after the war. - It took until the War of 1812 to put and end to that charade!
We appear to have a new type of Chinese nuclear powered submarine on out hands. The most remarkable aspect about it is its construction at Jiangnan in Shanghai, in a dedicated new facility.
A few additional remarks in a quick thread.
navalnews.com/naval-news/202…
A few additional remarks in a quick thread.
navalnews.com/naval-news/202…
The established Jiangnan naval production facilities here in red. The green buildings are relatively recent additions, and one of these appears to have launched this new boat. In particular the one in the second image.
The new type of submarine now appears to be berthed in this spot, after launch from the large hall. As HI Suttons article notes, length is about 120 metres. The submarine may not be "sailless" per se, but appears to have a relatively compact sail. Its difficult to say though.
I-REITS: THE MISSING LAYER IN YOUR PORTFOLIO: PART 1
There is a certain kind of investor frustration that gets you when you know real estate is a good asset, but you just don't have KSh 80 million sitting around to buy a commercial building in Gigiri. @trificsez
This is exactly the gap that an Income Real Estate Investment Trust, an I-REIT, was designed to fill.
But what Is a REIT?
There is a certain kind of investor frustration that gets you when you know real estate is a good asset, but you just don't have KSh 80 million sitting around to buy a commercial building in Gigiri. @trificsez
This is exactly the gap that an Income Real Estate Investment Trust, an I-REIT, was designed to fill.
But what Is a REIT?
A Real Estate Investment Trust is a regulated investment vehicle that pools money from many investors to collectively own and operate income-generating properties. Think of it like a unit trust, but instead of holding stocks or bonds, it holds real assets; office buildings, shopping malls, student accommodation, industrial parks.
@trificsez @cheruiyotkb @Davinedavid1 @mmnjug Investors buy “units” in the trust. Those units represent proportional ownership of the underlying property portfolio. When the properties generate rental income, that income is distributed back to unit holders as dividends.
