Power company is hosting their control software in C1V scammer basement.
Due to I/O wait, the software cannot update electric substations fast enough, which triggers protection shutdown and causes outage.
We accept Karma donations for the last flan. 🍮 affbrr
@yoursunny said:
Power company is hosting their control software in C1V scammer basement.
Due to I/O wait, the software cannot update electric substations fast enough, which triggers protection shutdown and causes outage.
As of February 9th, 2025, C1V hosting has been acquired by Lumanex, a decision that reinforces our commitment to providing reliable, quality hosting
So they are not anymore in the basement, they moved to living room.
@rubenmdh said:
They just said full power restore will take from 6 to 10 hours. LTE/5G seems to work in some places.
Yes, this is the official info from the national grid operator.
As for the cause, it has been a sudden surge on the demand VS generation, as per the operator, Red Eléctrica Española.
The Spanish power grid already had dire constraints during the last few years given the increase in dependency from renewables, and there have been many forced industry stops for a while, to avoid this... until now.
Power was restored briefly in my area, but is now gone again. Fiber to the home also down.
4+ hours of outage is crazy, big supermarket chains are closed, rail public transit closed, traffic is a mess with no traffic lights, tunnels in the main Madrid roads are now closed, hospitals in emergency-only mode... interesting day.
@Nyr said:
Power was restored briefly in my area, but is now gone again. Fiber to the home also down.
4+ hours of outage is crazy, big supermarket chains are closed, rail public transit closed, traffic is a mess with no traffic lights, tunnels in the main Madrid roads are now closed, hospitals in emergency-only mode... interesting day.
We have survived this as well. Now time to cancel all appointments for tomorrow.
I believe in good luck. Harder that I work ,luckier i get.
@Nyr said: Anyone with servers online there is running on diesel at this point.
Digital Realty Madrid is having severe issues right now, its offline for some time now. So are big providers there, Datapacket, M247, etc
Apparently they are now having issues binging fiber up, I guess there is a switch in the path that wasn't accounted for power redundancy. No power of course, everything running on generators.
"REN told Sky News on Monday . . . that as a result of extreme temperature variations in Spain, there were "anomalous oscillations" in extremely high-voltage lines. REN said this is known as "induced atmospheric variation," which in turn can lead to oscillations. This caused synchronization failures between systems, leading to successive disturbances across the European network, which is interconnected."
@Nyr said: Apparently this has been caused by a super rare meteorological occurrence? Still not much info.
This sounds like a such a bullshit. I would be skeptical what Government tells you too.
I doubt we are going to find out what really happened anytime soon.
Its a fuckup of a colossal scale, and puts EU Government in a very unfavorable position given their push to centralized and unstable "renewable resources".
I think it was either related to "green" power grid, or an attack.
@Not_Oles said: "REN told Sky News on Monday . . . that as a result of extreme temperature variations in Spain, there were "anomalous oscillations" in extremely high-voltage lines. REN said this is known as "induced atmospheric variation," which in turn can lead to oscillations. This caused synchronization failures between systems, leading to successive disturbances across the European network, which is interconnected."
Sounds like something you would read on paranormal activity board.
Me, reading it.
@treesmokah said: Digital Realty Madrid is having severe issues right now, its offline for some time now. So are big providers there, Datapacket, M247, etc
Apparently they are now having issues binging fiber up, I guess there is a switch in the path that wasn't accounted for power redundancy. No power of course, everything running on generators.
Routing in Spain has been majorly fucked up since the outage started. My ISP still does not have routes to the entire internet, I am posting this via VPN.
It's always surprising how much effect a power outage has, considering everything important is supposed to be protected by UPSs and generators.
It feels like there's always some switch somewhere that gets forgotten
"REN told Sky News on Monday . . . that as a result of extreme temperature variations in Spain, there were "anomalous oscillations" in extremely high-voltage lines. REN said this is known as "induced atmospheric variation," which in turn can lead to oscillations. This caused synchronization failures between systems, leading to successive disturbances across the European network, which is interconnected."
This sounds like something made up from a BOFH excuse generator.
From what I've heard thus far seems it may be related to ~60% of generation being solar. I can see that being problematic if you don't have very good stabilisation
@havoc said:
From what I've heard thus far seems it may be related to ~60% of generation being solar. I can see that being problematic if you don't have very good stabilisation
Based on what someone with insider knowledge has personally told me, this is apparently a very viable explanation. Apparently there was a similar, big scale incident in Germany in 2006 involving a boat which affected large parts of Europe but was resolved within minutes.
Maybe tomorrow I will be able to provide more details from this insider, because sadly and unsurprisingly our politicians and national media are being useless at that.
@Nyr said: Maybe tomorrow I will be able to provide more details from this insider, because sadly and unsurprisingly our politicians and national media are being useless at that.
Yeah - I saw part of the prez (?) speech which asked people to not speculate...which I guess is fair.
Silver lining is at least this will wake everyone up about grid stability & it didn't take down the entire EU grid. Restarting Spain's grid is easier with a big grid next door to jumpstart off. If everything went down this would take way longer to restore
Got electricity and cellular back roughly 1-2h ago (Barcelona zone). Still no water here, so I dunno about that.
Most of central Barcelona got electricity way before me, but most traffic lights are still off, so you can imagine the mess.
Network routing has been weird since the outage but seems relatively fine now.
@zgato said:
Got electricity and cellular back roughly 1-2h ago (Barcelona zone). Still no water here, so I dunno about that.
Most of central Barcelona got electricity way before me, but most traffic lights are still off, so you can imagine the mess.
Network routing has been weird since the outage but seems relatively fine now.
Yes some WiFi+ phone coverage back from 3:00 am aproximately ( Com Valenciana ) unstable but better than nothing. We have water. In fact we have had water all the time. Internet is unstable for the moment and phone coverage is unstable like hell. Hopefully you would have some water soon.
I believe in good luck. Harder that I work ,luckier i get.
This is what my source told me this morning about the cause:
Over here, they still aren't sure what the cause of what happened is, but it's most likely that it was all due to an imbalance in the grid caused by the instability of solar panel generation. This type of generation is growing rapidly, but it's very unstable—you can't predict the output. We've been told that in recent weeks there have been several days when the grid was on the verge of collapse, until everything finally happened.
More likely that a frequency variation elsewhere in the system caused PV to drop off grid, which caused a cascade. There's nothing intrinsically unstable about PV, but it does take more active management than old fashioned coal.
A lot of old grids have had decades of underinvestment in the face of changing generator profiles - the UK is only one bad day away from having the same thing happen. Our only saving grace is that we've got a lot more international inter connects to save our butts.
@Nyr said:
This is what my source told me this morning about the cause:
Over here, they still aren't sure what the cause of what happened is, but it's most likely that it was all due to an imbalance in the grid caused by the instability of solar panel generation. This type of generation is growing rapidly, but it's very unstable—you can't predict the output. We've been told that in recent weeks there have been several days when the grid was on the verge of collapse, until everything finally happened.
Depending on the 'prophecy' / conspiracy theory / philosophy you subscribe to : major solar storm causing 7 days complete blackout is expected in the current solar cycle.
This guy over does it some times, but I like his analysis sometimes.. https://www.youtube.com/@StefanBurns
@skhron said:
I wonder if it is possible to make cash payments widely acceptable in EU?
I can't speak for the whole EU but the places I've been in living memory - Spain, France, Italy, Malta - are all very happy to take cash. Event event they do have electricity ;-)
I'm often the only guy with the contactless card passing thru the POS in stores. Gotta let Big Bother know everything.
Only once I walked out of a general store with 20 kilos of instant-ice bags and 20 liters of ammonia, and paid all with cash. They are still searching for who did it.
I don't know about those westerners (LOL ) but when I look at my city:
More and more air condition units are being installed. That drastically increases the max-load and average consumption during the warmer part of the year (when consumption used to be very low, and allowed for any maintenance grid work to be easier AFAIK).
More and more electric cars and bicycles are used, daily, and they all need power to charge.
During the winter, the consumption has always been relatively high, that hasn't improved.
Infrastructure work is long and expensive. Doesn't get folks elected or make it for an easy skim of the profits for anyone.
Renewables are being built by government subsidizing (and charging us all extra! LOL) the destruction of small mountain creeks to build mini water power generators - not what I'd call eco-friendly in even the most vague meaning of the term!
Solar panels with batteries?
I am not sure what the net-result of those is: both in terms of environmental impact (damage?), and in terms of any economic gains/savings. But I can see that they are far from popular and widely used.
In cities, we are very dependent on the technology and industry. With more and more smart cameras being placed everywhere. More and more people are moving to the cities, from the country. While socialism used to invest a lot in the building of every local community, now the trend is hugely in favour of only a handful of big cities (the largest 3 taking practically all of the economic turnover and over half of the total population).
It is not looking well, even with the best intentions (no government or terrorist sabotages, no huge natural disasters etc.). When you're driving with your eyes closed, is an accident really an accident (or your fault)?
Comments
Government is not saying anything about the causes, but blackout has been going for like one hour and a half at this point.
Still have 5G, for now, probably not for long. Wish us luck.
OpenVPN installer | WireGuard installer
Madrid and Portugal still up here, until now.
Is Mobile still working for you guys?
Free NAT KVM | Free NAT LXC
Power company is hosting their control software in C1V scammer basement.
Due to I/O wait, the software cannot update electric substations fast enough, which triggers protection shutdown and causes outage.
We accept Karma donations for the last flan. 🍮 affbrr
https://www.euronews.com/my-europe/2025/04/28/spain-portugal-and-parts-of-france-hit-by-massive-power-outage
apt mooVery slow, but yes. Not for everyone, some friends are already offline.
Supposedly power is being restored in some parts of the north according to the operator. Zero info from the government.
OpenVPN installer | WireGuard installer
As of February 9th, 2025, C1V hosting has been acquired by Lumanex, a decision that reinforces our commitment to providing reliable, quality hosting
So they are not anymore in the basement, they moved to living room.
Amadex • Hosting Forums • root.hr
They just said full power restore will take from 6 to 10 hours. LTE/5G seems to work in some places.
Yes, this is the official info from the national grid operator.
As for the cause, it has been a sudden surge on the demand VS generation, as per the operator, Red Eléctrica Española.
The Spanish power grid already had dire constraints during the last few years given the increase in dependency from renewables, and there have been many forced industry stops for a while, to avoid this... until now.
OpenVPN installer | WireGuard installer
Power is being restored to parts of Spain. Still not here.
OpenVPN installer | WireGuard installer
Hope everyone is ok
I moved all my websites to Carrd, and cancelled all my idlers.
Save the earth, don't idle.
Power was restored briefly in my area, but is now gone again. Fiber to the home also down.
4+ hours of outage is crazy, big supermarket chains are closed, rail public transit closed, traffic is a mess with no traffic lights, tunnels in the main Madrid roads are now closed, hospitals in emergency-only mode... interesting day.
OpenVPN installer | WireGuard installer
Power was out for about an hour in San Sebastian, mobile was spotty for a little while after but been fine since. Sounds like we got off lightly.
Both power and fiber are back for me, big parts of Spain are still off but being restored apparently.
Apparently this has been caused by a super rare meteorological occurrence? Still not much info.
OpenVPN installer | WireGuard installer
Com Valenciana location. Just from now we have some electricity.
I believe in good luck. Harder that I work ,luckier i get.
No phone coverage at all
I believe in good luck. Harder that I work ,luckier i get.
We have survived this as well. Now time to cancel all appointments for tomorrow.
I believe in good luck. Harder that I work ,luckier i get.
Madrid is still without electricity, as it is a region with a lot of demmand and virtually zero generation I guess it will be the last restored.
Anyone with servers online there is running on diesel at this point.
OpenVPN installer | WireGuard installer
Digital Realty Madrid is having severe issues right now, its offline for some time now. So are big providers there, Datapacket, M247, etc
Apparently they are now having issues binging fiber up, I guess there is a switch in the path that wasn't accounted for power redundancy. No power of course, everything running on generators.
A bit more detail via https://www.newsweek.com/europe-power-outage-cause-atmospheric-phenomenon-2065094 :
"REN told Sky News on Monday . . . that as a result of extreme temperature variations in Spain, there were "anomalous oscillations" in extremely high-voltage lines. REN said this is known as "induced atmospheric variation," which in turn can lead to oscillations. This caused synchronization failures between systems, leading to successive disturbances across the European network, which is interconnected."
This sounds like a such a bullshit. I would be skeptical what Government tells you too.
I doubt we are going to find out what really happened anytime soon.
Its a fuckup of a colossal scale, and puts EU Government in a very unfavorable position given their push to centralized and unstable "renewable resources".
I think it was either related to "green" power grid, or an attack.
Sounds like something you would read on paranormal activity board.
Me, reading it.
Routing in Spain has been majorly fucked up since the outage started. My ISP still does not have routes to the entire internet, I am posting this via VPN.
OpenVPN installer | WireGuard installer
How many tubs of ice cream have melted during this power outage?
We accept Karma donations for the last flan. 🍮 affbrr
It's always surprising how much effect a power outage has, considering everything important is supposed to be protected by UPSs and generators.
It feels like there's always some switch somewhere that gets forgotten
This sounds like something made up from a BOFH excuse generator.
https://pages.cs.wisc.edu/~ballard/bofh/
“Technology is best when it brings people together.” – Matt Mullenweg
From what I've heard thus far seems it may be related to ~60% of generation being solar. I can see that being problematic if you don't have very good stabilisation
Based on what someone with insider knowledge has personally told me, this is apparently a very viable explanation. Apparently there was a similar, big scale incident in Germany in 2006 involving a boat which affected large parts of Europe but was resolved within minutes.
Maybe tomorrow I will be able to provide more details from this insider, because sadly and unsurprisingly our politicians and national media are being useless at that.
OpenVPN installer | WireGuard installer
Yeah - I saw part of the prez (?) speech which asked people to not speculate...which I guess is fair.
Silver lining is at least this will wake everyone up about grid stability & it didn't take down the entire EU grid. Restarting Spain's grid is easier with a big grid next door to jumpstart off. If everything went down this would take way longer to restore
Got electricity and cellular back roughly 1-2h ago (Barcelona zone). Still no water here, so I dunno about that.
Most of central Barcelona got electricity way before me, but most traffic lights are still off, so you can imagine the mess.
Network routing has been weird since the outage but seems relatively fine now.
Yes some WiFi+ phone coverage back from 3:00 am aproximately ( Com Valenciana ) unstable but better than nothing. We have water. In fact we have had water all the time. Internet is unstable for the moment and phone coverage is unstable like hell. Hopefully you would have some water soon.
I believe in good luck. Harder that I work ,luckier i get.
https://www.instagram.com/reel/C_IVDnPoi7S/
it has been a crazy day and night. Let's seewhat we have for Tusday
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Watched this https://www.imdb.com/title/tt11470588/ not long ago, and it is scary that we are so vulnerable to a major blackout.
“Technology is best when it brings people together.” – Matt Mullenweg
This is what my source told me this morning about the cause:
OpenVPN installer | WireGuard installer
More likely that a frequency variation elsewhere in the system caused PV to drop off grid, which caused a cascade. There's nothing intrinsically unstable about PV, but it does take more active management than old fashioned coal.
A lot of old grids have had decades of underinvestment in the face of changing generator profiles - the UK is only one bad day away from having the same thing happen. Our only saving grace is that we've got a lot more international inter connects to save our butts.
Thanks @Nyr !
I believe in good luck. Harder that I work ,luckier i get.
Depending on the 'prophecy' / conspiracy theory / philosophy you subscribe to : major solar storm causing 7 days complete blackout is expected in the current solar cycle.
This guy over does it some times, but I like his analysis sometimes..
https://www.youtube.com/@StefanBurnsor hers
https://www.youtube.com/@TamithaSkovblog archives
I wonder if it is possible to make cash payments widely acceptable in EU?
Check our KVM VPS plans in 🇵🇱 Warsaw, Poland and 🇸🇪 Stockholm, Sweden
I am not what they call “Prepper” ( sometimes used as a derogatory term)
But world is moving towards digital, cashless, easier to lock out/lock down economies that way.
Cannot speak for EU but in India, 🇮🇳 very much the case, for reasons good or bad.
Keep cash equal to three months expenses is the “those in the know” mantra. And a faraday cage. In case the carrington event repeats.
I know a stock market advisor who backs up daily data, two locations, disks placed overnight in faraday cages. He admitted as much on a podcast…
blog archives
I can't speak for the whole EU but the places I've been in living memory - Spain, France, Italy, Malta - are all very happy to take cash. Event event they do have electricity ;-)
Cash remains widely acceptable except in Scandinavia.
OpenVPN installer | WireGuard installer
Glad to hear that I was wrong about that
Check our KVM VPS plans in 🇵🇱 Warsaw, Poland and 🇸🇪 Stockholm, Sweden
I'm often the only guy with the contactless card passing thru the POS in stores. Gotta let Big Bother know everything.
Only once I walked out of a general store with 20 kilos of instant-ice bags and 20 liters of ammonia, and paid all with cash. They are still searching for who did it.
AD: VPS Price Tracker
So what was the “official” reason given behind the electric failure?
blog archives
Nothing in concrete....... At least I am not aware ( at this moment) that the oficial information says something about the case
I believe in good luck. Harder that I work ,luckier i get.
I don't know about those westerners (LOL
) but when I look at my city:
More and more air condition units are being installed. That drastically increases the max-load and average consumption during the warmer part of the year (when consumption used to be very low, and allowed for any maintenance grid work to be easier AFAIK).
More and more electric cars and bicycles are used, daily, and they all need power to charge.
During the winter, the consumption has always been relatively high, that hasn't improved.
Infrastructure work is long and expensive. Doesn't get folks elected or make it for an easy skim of the profits for anyone.
Renewables are being built by government subsidizing (and charging us all extra! LOL) the destruction of small mountain creeks to build mini water power generators - not what I'd call eco-friendly in even the most vague meaning of the term!
Solar panels with batteries?
I am not sure what the net-result of those is: both in terms of environmental impact (damage?), and in terms of any economic gains/savings. But I can see that they are far from popular and widely used.
In cities, we are very dependent on the technology and industry. With more and more smart cameras being placed everywhere. More and more people are moving to the cities, from the country. While socialism used to invest a lot in the building of every local community, now the trend is hugely in favour of only a handful of big cities (the largest 3 taking practically all of the economic turnover and over half of the total population).
It is not looking well, even with the best intentions (no government or terrorist sabotages, no huge natural disasters etc.). When you're driving with your eyes closed, is an accident really an accident (or your fault)?
🔧 BikeGremlin guides & resources