Tube Time Profile picture
Sep 16, 2020 49 tweets 12 min read Read on X
this electrical transmission tower has a little problem. can you spot it? actually, it's not a small problem--it cost us 16.65 *billion* dollars and caused the deaths of 85 people. Image
here's what it is supposed to look like. a transposition tower rotates the relative position of the three phase wires. this is done to balance the impedance of each of the wires so that one of them doesn't hog current. Image
here's the problem. the jumper conductor (the horizontal piece that brings a conductor from one side of the tower to the other) has fallen down. you can see the insulator dangling (circled.) but why did it fall? Image
let's look at an insulator up close. they're actually quite large; they just appear small because you're seeing them from the ground. noticed the hook that holds it in place? Image
this hook is called a "C hook." Image
and this is the C hook on the dangling insulator. looks like part of it broke off, doesn't it? Image
zooming in even closer, you can see something odd about the way the C hook broke off. inspect it with the eye of a materials engineer. what do you see? Image
penciled over in red are wear marks. this hook has been swinging back and forth for a very, very long time -- you can see rust stains (circled in black) the blue circle shows where the hook finally snapped.

oh, and this is about an inch in diameter. Image
here is a worn but unbroken C hook, glove for scale. that is a lot of metal to wear through! Image
the C hook hangs from this hangar bracket, and you can see signs of wear on this side, too. Image
so when the C hook broke and the hanger fell, the steel-reinforced aluminum conductor that carries 115,000V bounced and shorted out against the metal side of the tower, spraying chunks of white-hot aluminum across the ground underneath the tower. Image
the weather was extremely hot, dry, and windy, and this immediately started a fire. Image
the fire spread rapidly, and about 2 hours later, at 8am on November 8th, 2018, entered the nearby town of Paradise, CA. Image
this was the Camp fire, the most destructive in California history, and it burned most of the city to the ground, including my grandparents house. Image
(my grandfather had passed away a couple of years before, and my grandmother had moved to a facility scant *months* before the fire)
sadly, many others were not so lucky, and some were not able to escape the fire, including computing pioneer Bill Godbout (en.wikipedia.org/wiki/Bill_Godb…)
i wanted to add a little more detail on the human cost of the fire but--i just can't do it. i read through the stories and i had to stop. these are people who knew my grandparents, went to church together, participated in civic life. it's too hard.
so let's get back to the engineering talk. remember that worn C hook? how long was it rubbing against the hangar bracket? Image
the answer is that we don't know. we think it is about 97 (!) years old, but we're not sure because PG&E (the electric company that owns the lines) didn't keep records about it. Image
after the fire, many of the pieces were taken to the FBI lab's metallurgical unit at Quantico, and they determined that the C hook was made of cast iron. not all the C hooks on these 100-year old towers were made of cast iron--many were made of steel. but again: no records. Image
PG&E knew that this was a problem because at some point they bolted on L brackets and moved the C hooks onto the new brackets, probably concerned that the old bracket hole had mostly worn through. we don't know when they did this because they kept no records. Image
and yes, PG&E is legally required to inspect these towers periodically. we don't know exactly when, because (you guessed it) no records from before the year 2000.
the investigating team interviewed troublemen (inspectors for PG&E) to find out exactly how they did the inspections. they were done mostly from helicopters. and despite having official procedures, here's what they did

✅is the tower still standing?
just to pile it on a little more, here's another tower nearby. at some point, the jumper conductor broke, but to fix it, they just pulled it tight and spliced it. think: someone looked at this, with the taught conductor and the insulator pulled up sideways, and said "good enough" Image
there's even documented evidence that PG&E knew about the problem with the C hooks and hangers and yet did nothing. Image
smh Image
Image
i like this used car analogy. basically, they bought a used car and ran it without oil changes until the engine seized. Image
sadly, this is not new behavior for PG&E. it's just like the San Bruno gas explosion. Image
here's my previous thread on the San Bruno gas explosion.
on June 16 of this year, PG&E pled guilty to charges of unlawfully causing a fire and 84 counts of involuntary manslaughter. their penalty? a $4 million fine.
so what about the managers and executives at PG&E who were responsible? can we hold them personally liable? apparently, there's not enough evidence. but why? Image
because they set up their decision-making structure that way! Image
in fact, they had a perverse incentive to NOT maintain things, since those costs came directly out of their profit! Image
so despite PG&E's criminal negligence, there's a good chance that Paradise would have burned down anyway, even if they had good records and had kept the tower maintained. surprising? read on...
it turns out there was a second, unrelated fire that started at almost the same time and almost the same place! Image
this happened when a tree fell on a distribution line (lower voltage, shorter distance). Image
...and it turns out this was *not* PG&E's fault. there's no way the inspectors, even if they were competent, could have known that the tree would fall. Image
here's the second, more insidious cause: climate change. extreme weather->more vegetation->increased fuel load as well as hotter/drier weather. Image
while solving climate change is a good long term goal (although something that the human race is notoriously bad at) we need to improve our forestry management practices. and keep better records! and hold people accountable!
ok time for some sources: i am mainly relying on the excellent summary report from the Butte County DA: buttecounty.net/Portals/30/CFR…
i recommend you read the whole thing.
the DA's report also discuss the legal and accounting angles, which are fascinating but far outside my area of expertise.
the Wikipedia article on the Camp fire is decent for general information. en.wikipedia.org/wiki/Camp_Fire…
i noticed in the comments that some people advocate nationalizing the electric company. it sounds nice but it's not a panacea: a government agency and a private company are just groups of people. what's important is *how* you organize them and set up accountability.
if you think of PG&E (the organization) as an emergent intelligence, it was set up to optimize only one metric (profit) and utterly failed to take into account another metric (risk).
i'm sure there are people who study this sort of thing who could examine PG&E and point out exactly what caused this organizational failure.
quick disclaimer: my background and area of expertise is electronics. i have an EE degree but i am not officially (according to the state of CA) an "electrical engineer" since i am not a licensed professional engineer.
curious to see what the tower (#27/222) looks like now? someone took a 360° photo of it! goo.gl/maps/LsTjZEv9N…
again i want to emphasize that taking PG&E and making it state-owned and state-run is not a magic bullet. i mean, c'mon, Chernobyl was state-run! it comes down to organization, accountability, and incentives. they're complex problems but they can be solved.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Tube Time

Tube Time Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @TubeTimeUS

Jun 13, 2023
here's a weird object! it's some kind of foot pedal with an IBM logo. is it for a sewing machine? electronic synthesizer? what do you think? 🧵 Image
it's got a cursed connector! what IS that? Image
amazingly enough, I found something with the mating connector on it! but what is it? Image
Read 24 tweets
Jan 11, 2023
hey so remember the world's cutest oscilloscope i picked up last year? i think it's time to fix the probe socket issue.
i printed a new panel insert that has two BNC sockets on it (the original probes would have had captive cables)
the tricky part is that this oscilloscope has a 333K ohm input impedance instead of 1M like umm every other scope on the planet. fortunately someone designed a little conversion circuit...
Read 11 tweets
Jan 5, 2023
in honor of Sim Wong Hoo, here's a quick historical review of the Sound Blaster! 🧵
but first we have to go back to their first sound card, the Creative Music System from 1987. (image credit: Bratgoul on Wikipedia)
this card has some special "CMS-301" chips. if you peel back the sticker, they have had their top marks removed. they're actually SAA1099 synthesizer chips made by Philips. Creative wrote music composition software for musicians on the PC.
Read 23 tweets
Dec 31, 2022
Tube Time: a 2022 retrospective 🧵
(and stuff you might have missed!) Image
starting things off in january, i found a tube of super old 555 timer chips! i also decapped one of them.
i also started fixing up an old HP 150 computer. it's not PC compatible but it runs MS-DOS--how odd!
Read 65 tweets
Dec 29, 2022
today's mini project: fixing this Radius Thunder IV GX daughtercard. it looks fine, but... 🧵 Image
one of the chips has some broken pins! Image
looks like two of the pins got mashed and broke right at the plastic package. Image
Read 11 tweets
Dec 8, 2022
on the bench of healing tonight: my coffee grinder which decided to bite the dust. Image
symptoms: i push the start button and the motor just bumps a little bit and stops.
how to take it apart? hmm, i bet there are screws under the rubber feet. Image
Read 23 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(