During ordering, it shows a paypal window where you can click "link paypal account". This window seems to pay [amount], but in reality it does not. This is quite confusing and had me go through my paypal payment history to confirm that the payment was, in fact, not made. (I created a new account, this might be relevant information)
Email confirmation link takes you to "enable 2fa" page, until you enable 2fa, email confirmation link does not, in fact, confirm email
Order confirmation email gets sent out before the payment is made
VPS details information email is titled "New Dedicated Server Information"
VPS details information email WHMCS link is http://xxxxx:2086/ (actual quote, missing the link...)
VPS details information email was sent twice
And now on to using it. Might report again if stuff is broken/confusing. If nothing is posted, all went well.
"During ordering, it shows a paypal window where you can click "link paypal account". This window seems to pay [amount], but in reality it does not. This is quite confusing and had me go through my paypal payment history to confirm that the payment was, in fact, not made. (I created a new account, this might be relevant information)"
I will check that, most probably something related to latest WHMCS upgrade.
"Email confirmation link takes you to "enable 2fa" page, until you enable 2fa, email confirmation link does not, in fact, confirm email"
That is a weird behavior, thx for pointing it out.
"VPS details information email is titled "New Dedicated Server Information"
That is something even I know how to fix, will be done shortly.
"VPS details information email WHMCS link is http://xxxxx:2086/ (actual quote, missing the link...)"
"Email confirmation link takes you to "enable 2fa" page, until you enable 2fa, email confirmation link does not, in fact, confirm email"
That is a weird behavior, thx for pointing it out.
Seems to be that WHMCS is configured in such a way that it does not allow any action without enabling 2fa. Probably "intended" behavior, but feels weird as fuck.
"Email confirmation link takes you to "enable 2fa" page, until you enable 2fa, email confirmation link does not, in fact, confirm email"
That is a weird behavior, thx for pointing it out.
Seems to be that WHMCS is configured in such a way that it does not allow any action without enabling 2fa. Probably "intended" behavior, but feels weird as fuck.
Yes, 2FA is mandatory, altho it should send the mai prior to that.
I think that that is an issue from WHMCS, as there is no control over the setting.
You should be able to first receive the email confirmation and when you log in to be taken to set up 2FA. - this is the expected behavior.
Those on EOL products should get this also by mail shortly, ( with some typos Stuart did, oh man, he really hates doing these stuff )
What’s Changing:
Our products will now follow a standard lifecycle of approximately three (3) years. However, please note that in certain cases, the lifecycle may be shorter, particularly when the hardware underlying a product is decommissioned early or replaced with newer-generation equipment. This ensures that we continue to offer services aligned with evolving technologies and industry standards.
What This Means for You:
Products marked as End-of-Life (EOL) will continue to function as-is, but they will no longer receive updates or enhancements.
Customers using EOL products are not required to migrate immediately but are encouraged to consider available upgrade options for continued support and performance.
In the event of decommissioning, you will be notified in advance and provided with options for migration or upgrade.
EOL list it does not mean we will stop them tomorrow.
EOL means that they will not get any more development.
We will think of the upgrades for these services and contact all customers via mail for their options.
Also, as we upgrade the serves, we will keep the name of the service ( as creating new ones just makes a mess ) and we put the generation next to the naming ( G2, G3 and so on )
I asked Stu to send out a clarification mail on eligible products for the free upgrade to Scale Gen 2, here is the list for those that have fake mail accounts do not check their mail :
Eligible VPS Plans for Free Upgrade:
BF Revuelto
Little Dragon
V8-Ing till Judgement Day
FAT32 Special RS VPS
Promo VPS (7–10 USD/year offer)
HostSolutions Legendary Deal from the Grave
In Search for Cociu
Promo 7 Bucks Truck – LET Edition
7 USD Ticket
VPS Aurora IPv6
VPS IGLO – NVMe VPS
Project 949 Granit – Storage 1.5TB
VPS Maersk IPv6 – Storage 1TB
Fiat 500 IPv6 Only – NVMe VPS
VPS Triton – 500GB NVMe
Mostly all the BF / Xmass deals that were on E5-V4.
Again, these will be done by my team and there will only be a power off / on at the end of the LIVE migration so CPU type can be read by the OS you have. Probably 1-3 minutes downtime / VPS.
There will also be some nice upgrade for the LAN part, we got some shiny stuff from @NathanCore4 , but more on that when we have our hands on the goods... shortly....
There will also be some nice upgrade for the LAN part, we got some shiny stuff from @NathanCore4 , but more on that when we have our hands on the goods... shortly....
hey man stop ducking me ya slapnuts where is my upgrades? Tell Stu he will be off my Christmas list if he does not straighten up!!!
I asked Stu to send out a clarification mail on eligible products for the free upgrade to Scale Gen 2, here is the list for those that have fake mail accounts do not check their mail :
Mostly all the BF / Xmass deals that were on E5-V4.
Again, these will be done by my team and there will only be a power off / on at the end of the LIVE migration so CPU type can be read by the OS you have. Probably 1-3 minutes downtime / VPS.
Cheers!
Is it OK to ticket in and ask for that migration to occur sooner rather than later, or do I have to wait anyway? (Not sure if the hardware is ready or not)
Question! I saw the Gen 2 upgrade info...how does that play out for those with the 5TB or 10TB plans? (like those original promo ones from last year or whenever)
At this time, we have two nodes down due to currently unknown reasons. The only information we have is from the iDRAC interfaces, and frankly, it doesn't look good.
We are actively working on migrating the running VMs off the affected nodes. This process will take some time.
Right now, we don’t have a clear picture of the extent of the issue or how many services are impacted. We’ll continue to monitor the situation closely and will provide updates via email to affected customers as soon as we have more details.
At this time, we have two nodes down due to currently unknown reasons. The only information we have is from the iDRAC interfaces, and frankly, it doesn't look good.
We are actively working on migrating the running VMs off the affected nodes. This process will take some time.
Right now, we don’t have a clear picture of the extent of the issue or how many services are impacted. We’ll continue to monitor the situation closely and will provide updates via email to affected customers as soon as we have more details.
Let me know if you need anything man. I will be around for a bit longer.
All NVMe-based services previously hosted on the two affected nodes have been successfully restored to other nodes — a positive outcome so far. 😊
The second faulty node has been brought to our office for in-depth diagnostics and recovery procedures.
We expect to have more information by tomorrow and will continue to keep you updated here.
At this time, the main issue appears to be related to faulty ST18000NM019J FW. Once we have a clear understanding of the root cause, we will release an official statement and send a detailed email to all affected customers.
Ok, official info was sent to remaining affected customers, please check your e-mails.
Here is a time-lined description of the event of the fuckup:
July 27, 2025 – Afternoon (GMT+3):
Multiple Seagate ST18000NM019J drives (firmware KM02) across two nodes suddenly powered down due to a firmware-related failure. Drives began reporting critical SMART alerts (Data channel impending failure), causing the RAID-6/60 array to become unavailable.
Result:
Addon storage volumes became inaccessible, and VPS services depending on those volumes were disrupted. Some NVMe-based systems also experienced write issues due to OS-level I/O buffering.
July 28, 2025 – Morning:
Our team accessed the datacenter, identified the fault, and began recovery efforts. All NVMe-only VPS services were successfully migrated to healthy nodes.
July 28–29, 2025:
RAID array access was restored in degraded mode, enabling partial access to addon volumes at limited transfer speeds.
RAID controller entered fault mode due to concurrent SMART failures
No physical disk damage, no reallocated sectors or ECC errors — this was purely firmware-triggered
🛡️ Mitigation Going Forward
We are conducting a full infrastructure audit to identify any remaining ST18000NM019J drives with KM02 firmware
Affected drives will be proactively replaced or updated, where supported
RAID monitoring thresholds and firmware validation processes are being tightened to catch these failures earlier
This was an unprecedented firmware-level failure that bypassed typical RAID fault tolerance. We appreciate your understanding as we finalize recovery efforts for impacted systems.
Here is an output of one of the drives, maybe it can help others to check theirs if they have the same model used, all 6 reported exactly the same error, have the same powered on hours ( ~266 days ) and were brand new.
=== START OF INFORMATION SECTION ===
Vendor: SEAGATE
Product: ST18000NM019J
Revision: KM02
Compliance: SPC-5
User Capacity: 18,000,207,937,536 bytes [18.0 TB]
Logical block size: 4096 bytes
LU is fully provisioned
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Logical Unit id: 0x5000c500d8a51a07
Serial number: ZR57B8800000G20806CV
Device type: disk
Transport protocol: SAS (SPL-4)
Local Time is: Mon Jul 28 17:36:48 2025 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
Temperature Warning: Enabled
=== START OF READ SMART DATA SECTION ===
SMART Health Status: Data channel impending failure general hard drive failure [asc=5d, ascq=30]
Grown defects during certification <not available>
Total blocks reassigned during format <not available>
Total new blocks reassigned <not available>
Power on minutes since format <not available>
Current Drive Temperature: 31 C
Drive Trip Temperature: 60 C
Accumulated power on time, hours:minutes 6367:42
Manufactured in week 01 of year 2022
Specified cycle count over device lifetime: 50000
Accumulated start-stop cycles: 34
Specified load-unload count over device lifetime: 600000
Accumulated load-unload cycles: 291
Elements in grown defect list: 1
Vendor (Seagate Cache) information
Blocks sent to initiator = 3828
Blocks received from initiator = 1650689
Blocks read from cache and sent to initiator = 9094
Number of read and write commands whose size <= segment size = 29
Number of read and write commands whose size > segment size = 0
Vendor (Seagate/Hitachi) factory information
number of hours powered up = 6367.70
number of minutes until next internal SMART test = 53
Seagate FARM log supported [try: -l farm]
Error counter log:
Errors Corrected by Total Correction Gigabytes Total
ECC rereads/ errors algorithm processed uncorrected
fast | delayed rewrites corrected invocations [10^9 bytes] errors
read: 0 0 0 0 0 0.016 0
write: 0 0 0 0 0 6.889 0
Non-medium error count: 0
Pending defect count:0 Pending Defects
The error in bold triggered the detach of the drives from the raid array.
Here is a screen shot from the log of one of the dells servers ( R740 ) showing 2 drives leaving the " chat" at the precise same time, DST was not set on the server so that is why the time shows only 12:00
Upgraded my 5TB VPS from Debian 12 to 13 and the networking died. Make sure you know your root password in advance, the control panel can't change it, at least on debian 13, and you need it for VNC. Thankfully I found it lying around.
To fix networking, put this in /etc/netplan/99-static.yaml (and chmod 600):
I think doing this after upgrade but before the post-upgrade reboot should prevent death of networking. Get addresses/gateway from control panel. Don't set v6 gateway, it'll break IPv6. After upgrade my server was set to use DHCP for some reason, which didn't get any addresses.
I don't actually know why it broke but this is working across reboots. nameservers might be unnecessary but when networking first died it also wiped DNS server setup, it didn't have any set at all.
Looking at the CPU, we are safe for now.
We don't have a P**N Collection — we search YouTube for "buff dudes" or "pamela reif" whenever we feel like it.
Our name and email and telephone are all real, but address is office mailing address — residential address can be provided in exchange for a hoodie.
@yoursunny said:
Looking at the CPU, we are safe for now.
We don't have a P**N Collection — we search YouTube for "buff dudes" or "pamela reif" whenever we feel like it.
Our name and email and telephone are all real, but address is office mailing address — residential address can be provided in exchange for a hoodie.
Interesting fact, we actually had close to 0 problems like the ones described in the mail with the vast majority of the "active" users from here and OGF.
@host_c said: Interesting fact, we actually had close to 0 problems like the ones described in the mail with the vast majority of the "active" users from here and OGF.
Is there a reason you wouldn't talk about it here? I haven't seen the email so I don't understand what problem we're referring to.
Well, I think it is time we do not use forums for support tiket , tho this falls under announcements, here it is:
A Look Back at 2025 and the Road Ahead
Dear customers,
As many of you know, we entered 2025 with an ambitious list of improvements we wanted to deliver. Unfortunately, many of these plans did not materialize. Over the past few days, I took the time to analyze why.
The conclusion was straightforward: too much of our time was consumed by daily abuse cases, fake accounts, and operational distractions, leaving little room for the larger and more complicated projects we committed to.
And let’s be honest — 2025’s geopolitical and economic chaos did not help either. 🙂
For 2026, this will change.
Zero tolerance for fake accounts
We have repeatedly asked customers to update their profiles with real information. Some complied, many ignored the request.
To protect our platform and eliminate wasted time, we will enforce a 0-tolerance policy for fake accounts starting immediately.
Additionally:
→ We will tighten our fraud-protection rules.
After more than 12 months of operating our automated fraud-detection system, we can confirm its accuracy:
9 out of 10 flagged orders were indeed abusive
Orders manually approved just 1% above the fraud threshold turned abusive 9 out of 10 times
Therefore:
→ Borderline and suspicious orders will no longer be manually approved.
→ Fraud screening will be stricter and strictly enforced.
The TOS will be updated shortly.
Product naming issues & the $6 upgrade situation
We acknowledge that some product naming and upgrade communications in 2024–2025 caused confusion — some of it chaotic:
The Pioneer 5TB LET/LES editions created ambiguity (now corrected).
The upgrade from E5-V4 → Scale Gen1 is still misunderstood by some customers as an upgrade to Gen2.
In practice:
Scale Gen1 severely underperformed
It was retired quickly
Impacted customers were temporarily moved to Scale Gen2
This created a fairness issue:
Some customers paid $6 for an upgrade that did not provide long-term value, ending up on Scale Gen2, while others paid higher prices for native E5-V4 → Scale Gen2 plans.
To restore fairness and consistency:
→ All affected customers who paid the upgrade from E5-V4 to Scale Gen1 will receive a full $6 refund as account credit.
→ Services will be migrated back to their initial E5-V4 platform until final decommissioning.
→ This is mostly the case for the Pioneer 5TB and Nimitz 10TB plans.
This takes effect immediately as of 04-12-2025.
This corrects the imbalance, and no one loses anything. This was one of the largest operational mistakes of 2024–2025, and we have learned from it.
Abuse of promotional products & transfer restrictions
A large portion of platform abuse occurred on promotional products — often transferred repeatedly between users.
Some services changed owners five or more times in just a few months, and nearly every time ended up abused.
As it turns out, our initial wish to be flexible in this area came back to bite us.
Sometimes it is better to be more rigid, and flexibility should not be present in all parts of the service.
This is also why we did not participate in this year’s LET and LES Black Friday sales.
Until we develop a reliable anti-abuse formula, participating is a waste of resources and creates discomfort for existing customers.
Starting today, 04-12-2025:
→ Promotional products will no longer be transferable.
For list-priced (non-promo) services:
→ Transfers remain allowed but must be requested via support ticket.
There will be no other exceptions.
The TOS will be updated accordingly.
End-of-life for E5-V4 services
As previously announced, all E5-V4 services will be decommissioned by the end of 2025, with two exceptions:
Pioneer 5TB
Nimitz 10TB
There will be no other exceptions.
The E5-V4 platform is outdated, unstable, difficult to debug, and performs poorly on the 2025 hypervisor stack. It is no longer viable to maintain.
Looking ahead to 2026
2026 is just around the corner and, while I could say much more, I will keep it simple:
→ More attention to detail
→ Improved stability
→ Increased performance
We will roll out additional storage options using Hardware RAID10, correct mistakes of past years, bring new features, and focus on quality over all other aspects.
For those who stay with us: thank you, and a big hug.
Your support and patience mean a lot to us.
Happy holidays, and best wishes from our entire team.
Really appreciate the update! I have a quick clarification question about the 5TB storage plans -- if my plan is labeled now as "Pioneer XNova - Storage 5TB - I185 - G2" does that mean I'm on Gen 2, and should be good to go to keep using it indefinitely? Or are all the Pioneer plans regardless of generation going to eventually go away, I swear I remember reading something about 2027 in the email?
(edit: I checked the email, says nothing about that)
@SocksAreComfortable said: if my plan is labeled now as "Pioneer XNova - Storage 5TB - I185 - G2" does that mean I'm on Gen 2, and should be good to go to keep using it indefinitely?
yappp.
well, I will not say indefinitely, as in 10 years from now i highly doubt we will run Scale Gen 2. , but the G2 will not be scheduled for decommission anytime soon.
Once I will redo all the TOS from ground UP, it will be sent out to all active customers.
Comments
Is it good quality?
I am asking for a friend
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Initial Comment on https://lowendspirit.com/discussion/9575/host-c-flash-sale-xeon-scale-gen-2-from-13-2-usd-year/p2
"During ordering, it shows a paypal window where you can click "link paypal account". This window seems to pay [amount], but in reality it does not. This is quite confusing and had me go through my paypal payment history to confirm that the payment was, in fact, not made. (I created a new account, this might be relevant information)"
"Email confirmation link takes you to "enable 2fa" page, until you enable 2fa, email confirmation link does not, in fact, confirm email"
"VPS details information email is titled "New Dedicated Server Information"
"VPS details information email WHMCS link is http://xxxxx:2086/ (actual quote, missing the link...)"
I will re-edit the whole e-mail, thx.
"VPS details information email was sent twice"
that will be related to the 2FA issue
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Seems to be that WHMCS is configured in such a way that it does not allow any action without enabling 2fa. Probably "intended" behavior, but feels weird as fuck.
Hey teamacc. You're a dick. (c) Jon Biloh, 2020.
Yes, 2FA is mandatory, altho it should send the mai prior to that.
I think that that is an issue from WHMCS, as there is no control over the setting.
You should be able to first receive the email confirmation and when you log in to be taken to set up 2FA. - this is the expected behavior.
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
So, bring the pitchforks and fuel
Changes to Product Lifecycle Policy
Those on EOL products should get this also by mail shortly, ( with some typos Stuart did, oh man, he really hates doing these stuff
)
What’s Changing:
Our products will now follow a standard lifecycle of approximately three (3) years. However, please note that in certain cases, the lifecycle may be shorter, particularly when the hardware underlying a product is decommissioned early or replaced with newer-generation equipment. This ensures that we continue to offer services aligned with evolving technologies and industry standards.
What This Means for You:
Products marked as End-of-Life (EOL) will continue to function as-is, but they will no longer receive updates or enhancements.
Customers using EOL products are not required to migrate immediately but are encouraged to consider available upgrade options for continued support and performance.
In the event of decommissioning, you will be notified in advance and provided with options for migration or upgrade.
Cheers!
EDIT:
Arcturus - NVME VPS
Dwarf Star VPS LET Exclusive
Dyson S - NVME Barebone VPS
Dyson S Revision 2.0 - NVME Barebone VPS
Event Horizon NX-01 - Storage 1 TB
Hunter X-302 - Storage 4 TB
Icarus II - NVME VPS
Infinity - 16 CORE and 16 GB RAM
Infinity STX-147 - Storage 10 TB
IO 200 - NVME VPS
Kepler-70 - NVME VPS
Promo VPS Defiant - Storage 2TB
Promo VPS Excelsior - Storage 6TB
Promo VPS IDLER'S Heaven - Configurable 1TB Storage VPS
Promo VPS Intrepid - Storage 4TB
Red dwarf - NVME VPS
Sirius B - NVME VPS IPV6 Only
Valkyrie - 16 CORE VPS
VPS Archimedes - Storage 8 TB
VPS Atlantis - Storage 16 TB
VPS Daedalus - Storage 12 TB
VPS Defiant - Storage 2 TB
VPS Growler - Storage 3TB
VPS Hornet - Storage 1 TB
VPS Intrepid - Storage 4 TB
VPS Prometheus - Storage 14 TB
VPS Vikrant - Storage 10 TB
Wolf 359 - NVME VPS
These are in EOL as of today, mostly because are/were on Xeon V4.
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
EOL list it does not mean we will stop them tomorrow.
EOL means that they will not get any more development.
We will think of the upgrades for these services and contact all customers via mail for their options.
Also, as we upgrade the serves, we will keep the name of the service ( as creating new ones just makes a mess ) and we put the generation next to the naming ( G2, G3 and so on )
Old: Dyson S - NVME Barebone VPS -> New: Dyson S - NVME Barebone VPS - G3
Old: Kepler-70 - NVME VPS -> New: Kepler-70 - NVME VPS - G2
and so on...
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Cool cool
The Yeti has left the building.
Hy fellas.
I asked Stu to send out a clarification mail on eligible products for the free upgrade to Scale Gen 2, here is the list for those that have fake mail accounts do not check their mail
:
Eligible VPS Plans for Free Upgrade:
Mostly all the BF / Xmass deals that were on E5-V4.
Again, these will be done by my team and there will only be a power off / on at the end of the LIVE migration so CPU type can be read by the OS you have. Probably 1-3 minutes downtime / VPS.
Cheers!
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Nice, Chicken Farm upgraded, wish you a good harvest.
Free NAT KVM | Free NAT LXC
Thx
There will also be some nice upgrade for the LAN part, we got some shiny stuff from @NathanCore4 , but more on that when we have our hands on the goods... shortly....
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
hey man stop ducking me ya slapnuts where is my upgrades? Tell Stu he will be off my Christmas list if he does not straighten up!!!
The Yeti has left the building.
@NathanCore4
Thank you !
Stuff is premium!!
Juniper SRX are freaking new an they were at a freaking awesome price !!!
I cannot comment on the QFX-5200, I am thrilled to put it in the datacenter alongside the EX4300
Everything came packet nicely, no damage at all.
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Getting ready for BF25?
Have you tried turning it off and on again?Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Is it OK to ticket in and ask for that migration to occur sooner rather than later, or do I have to wait anyway? (Not sure if the hardware is ready or not)
Website: thomassen.sh
Question! I saw the Gen 2 upgrade info...how does that play out for those with the 5TB or 10TB plans? (like those original promo ones from last year or whenever)
Hi everyone,
Unfortunately, this isn't a pleasant update.
At this time, we have two nodes down due to currently unknown reasons. The only information we have is from the iDRAC interfaces, and frankly, it doesn't look good.
We are actively working on migrating the running VMs off the affected nodes. This process will take some time.
Right now, we don’t have a clear picture of the extent of the issue or how many services are impacted. We’ll continue to monitor the situation closely and will provide updates via email to affected customers as soon as we have more details.
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Let me know if you need anything man. I will be around for a bit longer.
The Yeti has left the building.
Small update, it seems the issue is from ST18000NM019J, even with the latest ( 6-8 mo ago ) fw update fix.
I will keep you posted once I get out of the DC.
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Update 1
All NVMe-based services previously hosted on the two affected nodes have been successfully restored to other nodes — a positive outcome so far. 😊
The second faulty node has been brought to our office for in-depth diagnostics and recovery procedures.
We expect to have more information by tomorrow and will continue to keep you updated here.
At this time, the main issue appears to be related to faulty ST18000NM019J FW. Once we have a clear understanding of the root cause, we will release an official statement and send a detailed email to all affected customers.
So, Keep calm and.... wait
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Ok, official info was sent to remaining affected customers, please check your e-mails.
Here is a time-lined description of the event of the fuckup:
July 27, 2025 – Afternoon (GMT+3):
Multiple Seagate ST18000NM019J drives (firmware KM02) across two nodes suddenly powered down due to a firmware-related failure. Drives began reporting critical SMART alerts (Data channel impending failure), causing the RAID-6/60 array to become unavailable.
Result:
Addon storage volumes became inaccessible, and VPS services depending on those volumes were disrupted. Some NVMe-based systems also experienced write issues due to OS-level I/O buffering.
July 28, 2025 – Morning:
Our team accessed the datacenter, identified the fault, and began recovery efforts. All NVMe-only VPS services were successfully migrated to healthy nodes.
July 28–29, 2025:
RAID array access was restored in degraded mode, enabling partial access to addon volumes at limited transfer speeds.
🧪 Root Cause
Firmware fault affecting multiple ST18000NM019J (KM02) drives simultaneously
RAID controller entered fault mode due to concurrent SMART failures
No physical disk damage, no reallocated sectors or ECC errors — this was purely firmware-triggered
🛡️ Mitigation Going Forward
We are conducting a full infrastructure audit to identify any remaining ST18000NM019J drives with KM02 firmware
Affected drives will be proactively replaced or updated, where supported
RAID monitoring thresholds and firmware validation processes are being tightened to catch these failures earlier
This was an unprecedented firmware-level failure that bypassed typical RAID fault tolerance. We appreciate your understanding as we finalize recovery efforts for impacted systems.
Here is an output of one of the drives, maybe it can help others to check theirs if they have the same model used, all 6 reported exactly the same error, have the same powered on hours ( ~266 days ) and were brand new.
SMART Health Status: Data channel impending failure general hard drive failure [asc=5d, ascq=30]
The error in bold triggered the detach of the drives from the raid array.
Here is a screen shot from the log of one of the dells servers ( R740 ) showing 2 drives leaving the " chat" at the precise same time, DST was not set on the server so that is why the time shows only 12:00
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Hope all is well with @host_c (Last Active: September 17). Just renewed my awesome 5TB VPS for another quarter
LinuxFreek.com — Thank you for your attention to this matter
Surely those euro summer vacations are over by now?!? 😬🤷♂️
Rock Solid Web Hosting, VPS & VDS with a Refreshing Approach - Xeon + EPYC with DDoS protection and Enterprise Hardware! HostBilby Inc.
I hope so
2CPU, 2GB RAM, 35 GB SSD = $17.66/y (aff) | Direct Admin Shared & Reseller (aff) | 1, 2, 4, 8, 16 TB StorageBox (aff) | 2CPU, 4GB RAM, 65GB NVMe = €24/y (aff)
They are busy upgrading and fixing things. The team is working on it and I am sure they will be ready for the next few months soon.
The Yeti has left the building.
Upgraded my 5TB VPS from Debian 12 to 13 and the networking died. Make sure you know your root password in advance, the control panel can't change it, at least on debian 13, and you need it for VNC. Thankfully I found it lying around.
To fix networking, put this in
/etc/netplan/99-static.yaml(and chmod 600):I think doing this after upgrade but before the post-upgrade reboot should prevent death of networking. Get addresses/gateway from control panel. Don't set v6 gateway, it'll break IPv6. After upgrade my server was set to use DHCP for some reason, which didn't get any addresses.
I don't actually know why it broke but this is working across reboots.
nameserversmight be unnecessary but when networking first died it also wiped DNS server setup, it didn't have any set at all.Cloudcone | Crunchbits | Dartnode | Dedirock | Georgedatacenter | Gigahost | Hostbilby | Host-c | Hostdzire | Hostsailor | Namecrane | Nuyek | Realtoxmedia | Servarica | Terabit | Tnahosting | Virmach
This is my fav backup server, ever!
Amadex • Hosting Forums • root.hr
@Amadex how much per year?
2CPU, 2GB RAM, 35 GB SSD = $17.66/y (aff) | Direct Admin Shared & Reseller (aff) | 1, 2, 4, 8, 16 TB StorageBox (aff) | 2CPU, 4GB RAM, 65GB NVMe = €24/y (aff)
0€, @host_c likes me
Amadex • Hosting Forums • root.hr
I'm jealous
2CPU, 2GB RAM, 35 GB SSD = $17.66/y (aff) | Direct Admin Shared & Reseller (aff) | 1, 2, 4, 8, 16 TB StorageBox (aff) | 2CPU, 4GB RAM, 65GB NVMe = €24/y (aff)
NO reason to be jealous man . His penis is still smaller than yours.
The Yeti has left the building.
I used to write songs for him
Amadex • Hosting Forums • root.hr
Cause I knows everything man and I do mean everything. I am Yeti Claws after all
The Yeti has left the building.
Oh noes, tomorrow 27.11 there's a maitenance. Machines pwoered off. Billions lost. Deadpool is at the corner.
Happy customer at AlexHost, AxusHost, Bakker-IT, Host-C, Ionos, Veesp + NanoKVM ftw.
Yeape Stu is getting drunk and they know what happens then.
The Yeti has left the building.
Kudos @host_c for the long, insightful email
. All the best for 2026. 
Happy customer at AlexHost, AxusHost, Bakker-IT, Host-C, Ionos, Veesp + NanoKVM ftw.
Right? Sounds like they are making good decisions and we keep informed.
THX, I appreciate it.
Those that got the mail now know why we were kinda off this year and absent in the Deal Threads.
And Yes, I did use AI to correct my typing, you should have seen the draft, not even I understood it
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Most will actually benefit from these decisions in the mid-long run, some will not. It is what it is.
Just be sure to have some Pop-Corn on idle, I do expect some fallout in Late December / beginning of January titled:
Shit HOT-C deleted my VPS and I lost my P**N Collection - The tragedy
Witch is espected as he/she/it's fake e-mail did not forward the info.
Either-way, I am looking forward for next year.
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Looking at the CPU, we are safe for now.
We don't have a P**N Collection — we search YouTube for "buff dudes" or "pamela reif" whenever we feel like it.
Our name and email and telephone are all real, but address is office mailing address — residential address can be provided in exchange for a hoodie.
We accept Karma donations for the last flan. 🍮 affbrr
Interesting fact, we actually had close to 0 problems like the ones described in the mail with the vast majority of the "active" users from here and OGF.
And I am proud of that!
PS:
Anyone should have one sincerely.
Cheers!
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Asciip0rn rocks !!
https://github.com/gabe565/ascii-movie
blog archives
that is pretty cool actually.
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
Is there a reason you wouldn't talk about it here? I haven't seen the email so I don't understand what problem we're referring to.
Well, I think it is time we do not use forums for support tiket , tho this falls under announcements, here it is:
A Look Back at 2025 and the Road Ahead
Dear customers,
As many of you know, we entered 2025 with an ambitious list of improvements we wanted to deliver. Unfortunately, many of these plans did not materialize. Over the past few days, I took the time to analyze why.
The conclusion was straightforward: too much of our time was consumed by daily abuse cases, fake accounts, and operational distractions, leaving little room for the larger and more complicated projects we committed to.
And let’s be honest — 2025’s geopolitical and economic chaos did not help either. 🙂
For 2026, this will change.
Zero tolerance for fake accounts
We have repeatedly asked customers to update their profiles with real information. Some complied, many ignored the request.
To protect our platform and eliminate wasted time, we will enforce a 0-tolerance policy for fake accounts starting immediately.
Additionally:
→ We will tighten our fraud-protection rules.
After more than 12 months of operating our automated fraud-detection system, we can confirm its accuracy:
9 out of 10 flagged orders were indeed abusive
Orders manually approved just 1% above the fraud threshold turned abusive 9 out of 10 times
Therefore:
→ Borderline and suspicious orders will no longer be manually approved.
→ Fraud screening will be stricter and strictly enforced.
The TOS will be updated shortly.
Product naming issues & the $6 upgrade situation
We acknowledge that some product naming and upgrade communications in 2024–2025 caused confusion — some of it chaotic:
The Pioneer 5TB LET/LES editions created ambiguity (now corrected).
The upgrade from E5-V4 → Scale Gen1 is still misunderstood by some customers as an upgrade to Gen2.
In practice:
Scale Gen1 severely underperformed
It was retired quickly
Impacted customers were temporarily moved to Scale Gen2
This created a fairness issue:
Some customers paid $6 for an upgrade that did not provide long-term value, ending up on Scale Gen2, while others paid higher prices for native E5-V4 → Scale Gen2 plans.
To restore fairness and consistency:
→ All affected customers who paid the upgrade from E5-V4 to Scale Gen1 will receive a full $6 refund as account credit.
→ Services will be migrated back to their initial E5-V4 platform until final decommissioning.
→ This is mostly the case for the Pioneer 5TB and Nimitz 10TB plans.
This takes effect immediately as of 04-12-2025.
This corrects the imbalance, and no one loses anything.
This was one of the largest operational mistakes of 2024–2025, and we have learned from it.
Abuse of promotional products & transfer restrictions
A large portion of platform abuse occurred on promotional products — often transferred repeatedly between users.
Some services changed owners five or more times in just a few months, and nearly every time ended up abused.
As it turns out, our initial wish to be flexible in this area came back to bite us.
Sometimes it is better to be more rigid, and flexibility should not be present in all parts of the service.
This is also why we did not participate in this year’s LET and LES Black Friday sales.
Until we develop a reliable anti-abuse formula, participating is a waste of resources and creates discomfort for existing customers.
Starting today, 04-12-2025:
→ Promotional products will no longer be transferable.
For list-priced (non-promo) services:
→ Transfers remain allowed but must be requested via support ticket.
There will be no other exceptions.
The TOS will be updated accordingly.
End-of-life for E5-V4 services
As previously announced, all E5-V4 services will be decommissioned by the end of 2025, with two exceptions:
There will be no other exceptions.
The E5-V4 platform is outdated, unstable, difficult to debug, and performs poorly on the 2025 hypervisor stack. It is no longer viable to maintain.
Looking ahead to 2026
2026 is just around the corner and, while I could say much more, I will keep it simple:
→ More attention to detail
→ Improved stability
→ Increased performance
We will roll out additional storage options using Hardware RAID10, correct mistakes of past years, bring new features, and focus on quality over all other aspects.
For those who stay with us: thank you, and a big hug.
Your support and patience mean a lot to us.
Happy holidays, and best wishes from our entire team.
HOST-C
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”
@host_c
Really appreciate the update! I have a quick clarification question about the 5TB storage plans -- if my plan is labeled now as "Pioneer XNova - Storage 5TB - I185 - G2" does that mean I'm on Gen 2, and should be good to go to keep using it indefinitely? Or are all the Pioneer plans regardless of generation going to eventually go away, I swear I remember reading something about 2027 in the email?
(edit: I checked the email, says nothing about that)
yappp.
well, I will not say indefinitely, as in 10 years from now i highly doubt we will run Scale Gen 2.
, but the G2 will not be scheduled for decommission anytime soon.
Once I will redo all the TOS from ground UP, it will be sent out to all active customers.
Host-C | Storage by Design | AS211462
“If it can’t guarantee behavior under load, it doesn’t belong in production.”