Understanding ET-131’s rogue foam liberations leads to ET-132 confidence
Although no ill effects were suffered by Endeavour, the problems with her External Tank (ET-131) – both prior and during last month’s launch – called for investigations into the downstream tanks, the latest of which is due to fly with Discovery later this month. Thanks to those evaluations, additional confidence has been gained ahead of STS-128’s launch with ET-132.
If External Tanks could survive their return to Earth, ET-131 would have found itself being placed on the naughty step inside the Vehicle Assembly Facility.
Two scrubs, caused by gaseous hydrogen leaks at the Ground Umbilical Carrier Plate (GUCP), forced STS-127’s launch to slip from its targeted launch date.
After realigning to acceptable weather conditions a month later, ET-131 shed an unusually large amount of foam during Endeavour’s ride uphill – mainly from the intertank region.
Notably, none of the liberated foam managed to cause anything more than cosmetic damage to Endeavour. However, Lockheed Martin – involved in ET-131’s manufacture at the Michoud Assembly Facility (MAF) – classed the tank’s performance as “on the outer edge of our family of experience.”
That classification came during the STS-127 IFA (In Flight Anomaly) review, which was dominated by ET-131’s events, partly due to the lack of any other issues with the highly successful flight to the International Space Station (ISS).
This issue is likely to be a thing of the past, after an investigation into ET-131’s leaks identified a misalignment of the “feet” – by a very small fraction – on the carrier plate, enough for the tiny hydrogen molecules to leak through the flight seal.
Following a realignment during re-installation, the addition of a more forgiving two-part flight seal, and a confidence check via a tanking test, no further leaks were detected on the subsequent loadings.
“STS-127-I-003: LH2 Leak at ET Ground Umbilical Carrier Plate (GUCP). LH2 leakage at the GUCP rose above the launch commit criteria limit and caused launch scrubs on two attempts,” noted expansive notes on the STS-127 Integrated IFA presentation – one of 11 IFA presentations presented to the Program Requirements Control Board (PRCB) meeting, and available to download on L2.
“Associated Hazard Report: ISPR-02 – ET Vent Arm System (ETVAS) Umbilical Malfunction. Cause Y – ETVAS Umbilical H2 Fluid System Failures Prior to T-0 Separation due to leakage.”
ET-132 will still find itself under the spotlight for STS-128’s late August attempt, with the manufacturing changes not sure to kick in until STS-129’s ET-133 tank. However, lessons learned from ET-131’s leaks will be incorporated into ET-132’s GUCP installation and tanking.
“GUCP leak: (Engineering changes) written and implemented on ET-132 to incorporate countermeasures from ET-131. Enhanced process for installation incorporated for KSC. Design change implemented for ET-133 and up,” added the specific ET-131 IFA presentation.
For all 20 NASASpaceflight.com articles on the GUCP, click here: https://www.nasaspaceflight.com/tag/gucp/
Three main areas of foam loss were observed during the ride to orbit, not unusual for a shuttle launch, but out of character for tanks that have flown since Return To Flight – due to the massive improvements in mitigating foam liberation by the ET engineering workforce.
“STS-127-I-004 – ET TPS Loss at LO2 Ice Frost Ramp (IFR) 718. Foam loss at IFR 718 exceeds risk baseline,” noted the integrated IFA presentation for STS-127 on the first area of foam loss placed under focus.
“Associated Hazard Reports: IDBR-01 – Ascent debris impact to SSV (Space Shuttle Vehicle). Cause I – External Debris Impact to the SSV During Ascent. Due to ET Foam (PDL-1034/NCFI-26-007/BX-265). Located at the LO2 Tank Ice/Frost Ramps and BX-265/BX-250/PDL-1034/NCFI-26-007 (type of foam) located on the LO2 Feedline Bellows PDL Drip Lip.”
A large amount of work has taken place on the IFRs on the tanks, but mainly with the LH2 ramps. As with most of the ET mitigation efforts to reduce liberations, foam has been reduced on the main threat areas, thus lowering the potential mass of the foam losses that could impact the orbiter. Such has been the success, many future modifications are no longer required.
It is not known if any additional modifications can be made to the ramps, although it is still rare for the IFRs to shed foam that has a direct threat to the orbiter during ascent.
However, to add confidence the foam loss was a rare event, checks – including X-rays – have been carried out on Discovery’s ET-132, in order to ensure the foam has no underlying problem.
“LO2 Ice Frost Ramp Loss: Additional NDE (Non Destructive Evaluation) options pursued for ET-132 at KSC included X-ray and THz,” added the ET-127 IFA presentational to the PRCB, noting good news on the health of ET-132’s ramps – and further mitigation on the downstream tanks in New Orleans.
“All observations were within performance expectations. LO2 IFR TIM (Technical Interchange Meeting) at MAF on July 29-30 to review design, process, and inspections (complete).
“Planning to increase BSx/ THz NDE inspections to include (location/station) Xt718 (minimum) for tanks at MAF.”
The second area of foam loss that made the IFA review related to a section of ET-131’s Bipod closeout foam, a liberation that has not been observed on most of the recent tanks to fly uphill with the shuttle.
This area of foam has been greatly reduced, with the elimination of bipod ramp TPS (Thermal Protection System – Foam) – a large area of foam which liberated during STS-107’s ascent, resulting in the fatal damage to Columbia’s Reinforced Carbon Carbon (RCC).
No association – other than the location – can be made to the loss of a suitcase sized ramp that damaged Columbia, and the much smaller areas of closeout foam that remains near the bipod struts on post Return To Flight tanks.
Also, the loss is only being investigated due to the “potential” for an impact with the orbiter – as no impact was observed via the array of cameras that carefully track the shuttle during ascent.
“STS-127-I-006 – ET TPS Loss Outboard Section of the –Y Bipod Closeout. Foam loss exceeds risk baseline,” noted the Integrated IFA presentation.
“Associated Hazard Reports: IDBR-01 – Ascent debris impact to SSV. Cause O – External Debris Impact to SSV During Ascent. Due to ET Foam Located at the Bipod Closeout and Bipod Jackpad Closeout – PDL-1034/NCFI-26-007 / BX-265 (type of foam).”
Once again, engineers double-checked the health of the TPS application in the specific area of ET-132, and found no issues – again pointing to a one-off incident with Endeavour’s ET-131 tank.
“Y Bipod loss: Risk assessment required to accept increase in mass beyond (previously defined) limits,” added the ET-131 IFA presentation. “ET Project planning to re-assess wire bonding process to ensure technique is meeting design intent. Additional NDE performed on ET-132 revealed no anomalies as expected.”
However, it was the intertank losses that provided the most “dramatic” images of foam loss from ET-131, due to the visible streaks of missing foam seen on the ET photography by the crew after ET sep, and the ET Umbilical Well photography that were later downloaded to engineers on the ground.
“STS-127-I-005 – ET Intertank TPS Foam Losses: Multiple foam losses exceed risk baseline,” noted the Integrated IFA presentation.
“Associated Hazard Reports: IDBR-01 – Ascent debris impact to SSV. Cause G – External Debris Impact to SSV During Ascent. Due to ET Foam – NCFI 24-124 (type of foam) located on the Intertank Acreage.”
Again, impacts with the orbiter failed to cause any concern to engineers on the ground, from an orbiter damage standpoint. Only minor cosmetic damage noted on Endeavour’s starboard Chine area.
However, no chances are being taken, with an investigation into the incident relating not only to the root cause with ET-131, but checks into the health of ET-132’s intertank foam.
“Intertank losses: Special investigation kicked off to drive to root cause. Fishbone (investigation) problem solving technique being used to perform root cause investigation,” noted the ET-131 IFA presentation.
“No unique root cause identified to date – requires updated risk assessment. Detailed assessment of ET-131 / STS-127 and ET-132 / STS-128 as-built process data in progress. Extensive adhesion tests performed on ET-132 to provide confidence for flight.”
Although no “unique” root cause has been found, leading candidates have already been noted, such as dust/contamination finding its way on to the intertank structure, prior – or during – the automated foam applications at the Michoud Assembly Facility.
The tank was also put through its paces ahead of launch, via the GUCP and weather related scrubs, resulting in six cryo cycles. While the tanks are certified for 13 cryo cycles, this was the most a tank has endured for many years.
“Number of Cryo Loadings – 6: Fleet leader for SLWT (Super Light Weight Tank) – tied with ET-35 (1990 launch) for first overall,” added Lockheed Martin’s overview in the IFA presentations.
“Number of Pressurization Cycles – 7. Tied for first with ET-120/STS-120 (tied for 5th overall). On-pad stay time (days) – 90. ET-131 on-pad time follows only ET-127/STS-119 (108 days) for current SLWT foam system.”
STS-127 Specific Articles, including all scrubs: https://www.nasaspaceflight.com/tag/sts-127/
Opening results, gained from the ET-132 Intertank Bond Adhesion Tests and LO2 Ice Frost Ramp / –Y Bipod NDE Analysis effort that have taken place on Discovery’s tank inside the VAB. found no candidates that would suggest ET-132 is suffering from the similar issues observed with its predecessor.
Those checks, mainly surrounding pull tests to check the adhesive properties between the foam and the tank structure – which may have been downgraded via the dust/contamination theory – have been taking place in stages, all of which have found no issues with Discovery’s tank.
The inspections also took a closer look at the other areas on ET-132, which shed during ET-131 ride uphill.
“Purpose: Provide results of additional tests and inspections performed on ET-132 / STS-128 at KSC,” noted a specific investigation presentation to the PRCB at the end of last week – and available to download on L2.
“Additional bond adhesion data needed to provide confidence in the as-sprayed TPS integrity for ET-132. THz inspection of LO2 Ice Frost Ramp and –Y Bipod performed to identify whether any unacceptable conditions exist.”
As noted by the IFA presentations, no unacceptable conditions have been found on the Bipod closeouts and the Ice Frost Ramps, and no issues have been found on the intertank pull tests – although those tests have been continuing to the point rollout of the STS-128 stack has been delayed to Tuesday.
Initially, tests on just 26 areas of ET-132’s intertank were called for – all showing good results, as the foam only broke loose when the pull far exceeded the stresses expected during ascent.
However, managers then called for 126 additional tests – again showing good results, prior to a final test drive on the final quadrant of the intertank. Those results are still being evaluated, as repairs to the pull test areas are carried out ahead of rollout to Pad 39A.
“Bond Adhesion Test Results: 26 bond adhesion pull tests initially performed on ET-132 / STS-128 to provide confidence in Intertank TPS application integrity,” noted the specific Analysis presentation to the PRCB.
“Twenty-six (26) tests with samples from each panel (8 panels). Tests planned on stringer top and sidewall leading / trailing edges. 26 cohesive failures – 2 low tensile pulls due to crooked pulls.
“126 additional tests performed on –Z (panels 7 and 8). 125 cohesive failures. One adhesive failure with a high tensile result at 52.4 psi. Chemical wipe performed for analysis. Results revealed no indications of contamination.
“Forward Work: Completion of TPS cause investigation. Perform bond tension tests of ET-133 (STS-129) at KSC to support flight rationale development.”
Flight rationale, which is being created for the upcoming Flight Readiness Reviews (FRRs), does not have to include specific root cause, given such an effort is near-impossible for a tank that was mainly destroyed during its re-entry.
However, the best possible understanding of both the events surrounding ET-131, and the status of ET-132 – in order to ensure the incidents do not reoccur – is the driving force behind having the best possible data for the FRRs.
Just how much work has been undertaken can be seen in X-ray and Terahertz scans on ET-132, which show a level of evaluation most humans would be lucky to receive.
“IFR inspections via BSX & THz Stations: 760 through 1851 (currently assessing more forward access).
“NDE performed on ET-132 LO2 Ice Frost Ramp. Process assessment of ET-132 Sta. 718 IFR Terahertz scan identified no issues. No anomalies noted (voids, cracks, etc.). Scans limited (whole ramp not scanned),” added the investigation presentation.
“Observations noted were either outside ramp volume or on metallic substrate features.”
X-rays were also used on the bipod closeout. Again, no issues were found on ET-132.
“NDE performed on ET-132 –Y Bipod Closeout: Process assessment of ET-132 –Y Bipod Terahertz scan identified no issues.
“Scans were as expected, dominated by hardware/geometric features (wires, adhesive bonds, fittings, flange, etc. However, No anomalies noted (voids, cracks, etc.). Foam Knitline features noted.
“Summary: NDE inspection of LO2 Ice Frost Ramp sta 718 and –Y Bipod completed. Engineering Assessment: No unexpected results. No apparent unacceptable conditions exist.”
It was always the general assumption that ET-131 performed like a rogue tank, given the huge strides that have been made in reducing foam liberation since the last major foam loss incident during STS-114’s Return To Flight – itself never specifically blamed on the tank, and more likely accidental damage at MAF.
The amount of evaluations that have taken place on ET-132 should add confidence that NASA is not willing to take such assumptions as flight rationale when it comes to the safety of their shuttle fleet – even when related to an incident that failed to cause any damage to the orbiter.
L2 members: Documentation – from which the above article has quoted snippets – is available in full in the related L2 sections, now over 4000 gbs in size.