News Space Station suffers Coolant loop issue

garyw

O-F Administrator
Administrator
Moderator
Addon Developer
Tutorial Publisher
Donator
Joined
May 14, 2008
Messages
10,547
Reaction score
347
Points
158
Location
East Sussex
Website
blog.gdwnet.com
Preferred Pronouns
He/Him
From Article said:
Trouble with one of the International Space Station's external coolant loops, used to dissipate the heat generated by the lab's electronics systems, has triggered extensive equipment powerdowns and troubleshooting, NASA officials said late Saturday. The malfunction occurred around 8 p.m. EDT Saturday, showing up as a short circuit that set off multiple on-board alarms.

It is not yet clear what went wrong, but it appears to involve a pump module in ammonia coolant loop A. The electrical powerdowns affect two of the station's four U.S. control moment gyroscopes, used to help maintain the lab's orientation in space, one communications channel and a variety of computer control boxes known as multiplexer-demultiplexers.

source: http://www.cbsnews.com/network/news/space/home/spacenews/files/317bc7915938fc0d4ca3af958f5245b2-34.html

This is the same coolant loop that they had issues with during STS-130's flight to the ISS althougth those issues were to do with the tank alignment rather then the pump module so I'm assuming that the pump has been onboard since the coolant system was installed.
 
Last edited:
Update on the same article:
After Discovery undocked, engineers resolved the problem, cooling the valve and using back pressure to get it open. There have been no other obvious signs of trouble with either coolant loop since then.
EDIT: I'm an idiot... :rofl:
 
NASA's Main ISS Webpage said:
One of two ammonia-fed cooling loops on the International Space Station shut down at 8 PM EST Saturday night/12:00 AM GMT Sunday morning after a power spike was detected on the loop's Pump Module. The Pump Module, that enables ammonia to flow through the loops, remains down, and with the loss of the cooling loop, several systems were forced to shut down, including two of the station’s four Control Moment Gyroscopes, one of two redundant strings of S-band communication, one of two redundant strings of the station's Global Positioning System, several DC to DC current converters in Tranquility and a set of components that route commands to station equipment.

When the cooling loop went down, the crew was awakened by several caution and warning alarms and began powering down equipment to balance the cooling loads that were transferred to Cooling Loop B, which is active and in good condition.

Tracy Caldwell Dyson remained awake into the early hours Sunday to work troubleshooting procedures while the rest of the crew went back to bed. The crew is in no danger, but will need to work additional troubleshooting on Sunday to keep the station in a stable configuration, including the installation of a jumper cable to maintain proper cooling to the Zarya module in the Russian segment.

The station is equipped with two spare Pump Modules that are housed on spare part platforms on the truss of the station should a replacement of the Loop A Pump Module be required.


Spaceflight Now: "Problem forces partial powerdown aboard station".

SPACE.com: "Space Station Suffers Cooling System Malfunction".

Discovery News: "Space Station Cooling System Shuts Down".

ISS Active Thermal Control System (ATCS) Overview (PDF, 1.23 MB).

---------- Post added at 01:51 PM ---------- Previous post was at 01:27 PM ----------

NASA's Official Twitter Account said:
Restart of ammonia-fed cooling loop on space station did not work. Crew is in no danger. Discussions underway to fix via spacewalk this week.

:OMG:

I guess this is kinda "good" timing, being that a lot of EVA preps are already done for US EVA-15.
 
Last edited:
That looks like a serious issue :(

Though I'm confident in the ability of the crew to do the repairs, since the last EVA was a complete success. And Russia already had those kind of problems with Mir, I hope that experience will be helpful.
 
NASA's Main ISS Webpage said:
One of two ammonia-fed cooling loops on the International Space Station remains shut down after an attempt to restart its pump module failed early Sunday morning. The pump module's circuit breaker initially tripped Saturday night, but had successfully been reset overnight. It tripped again Sunday when the pump module was restarted. Teams in Mission Control in Houston are reviewing data to determine whether to attempt another restart and are discussing options to perform two spacewalks later this week to replace the pump module. Two spare pump modules are housed on platforms on the outside of the station.

The space station crew is in no danger and all systems are stable, though operating in a "single string" mode without redundancy.

Two of the four main buss switching units are cooled by the failed loop. The units switch and route power to various station systems. Mission Control is evaluating whether the heat generation may be low enough to not require powering off these switching units. With the loss of the cooling loop, several systems have been shut down, including one of two S-band communication circuits, one Global Positioning System circuit, several DC to DC current converters in Tranquility and a set of components that route commands to station equipment. Though two of the four station Control Moment Gyroscopes initially were turned off, the crew installed a jumper cable to regain a third gyro. The gyroscopes maintain the station's attitude in space.

Looks like there's going to be an EVA! :OMG:
 
Good, they already managed to get a gyro back online. Station's orientation is a critical matter (solar panels). There's still the RCS as a backup, but given the mass of the station, the fuel probably wouldn't last very long.

But yeah, that's really serious : they lost half of the cooling capacity... Which means more or less powering down half the electronics... The Russian core modules seem OK, though.

"It seems like we're in a sim right now," flight engineer Tracy Caldwell Dyson joked with ground controllers shortly after 1 a.m. Sunday.

Looks like that Tracy Caldwell Dyson will be out for the repair EVA.
 
Good, they already managed to get a gyro back online. Station's orientation is a critical matter (solar panels). There's still the RCS as a backup, but given the mass of the station, the fuel probably wouldn't last very long.

But yeah, that's really serious : they lost half of the cooling capacity... Which means more or less powering down half the electronics... The Russian core modules seem OK, though.



Looks like that Tracy Caldwell Dyson will be out for the repair EVA.

The Russian RCS (called MCS - Motion Control System) can take fuel from the two docked Progresses, if needed. The Progresses can also be incorporated into the MCS and used to control the station's attitude.

The Russian segment has its own cooling system, but it is only passive (uses insulation material, heaters & heat pipes) whereas the USOS has both active (uses pumped Ammonia) and passive systems.

EVA crewmembers would be Tracy Caldwell-Dyson & Doug Wheelock, as they are both scheduled to go outside on US EVA-15 anyway (so they are already up to speed on EVA procedures).
 
From ISS On-Orbit Status Report for 01/08/2010 (Early Edition):

Thermal Loop A ETCS Pump Shutdown:
After losing one cooling system pump (of two), ISS is currently stable, although thermally on single string (no redundancy). Last night (at 7:48 PM EDT/11:48 PM GMT) RPC-1 (Remote Power Controller-1) in RPCM (RPC Module) S11A_D tripped open, powering off the Loop A ammonia pump of the S1 ETCS (External Thermal Control System), resulting in the loss of one half of the cooling to ISS.
This required a number of powerdowns (i.e., turning off selected systems for thermal protection), including redundant power to four CQs (Crew Quarters), three in Node 2, one in the JPM, with both fans in each CQ remaining functional but zero fault-tolerant (crew is still Go for CQ use). Due to loss of heater power, MBS (Mobile Base System), SSRMS (Space Station Remote Manipulator System), and SPDM (Special Purpose Dexterous Manipulator) are currently zero fault-tolerant. T2/COLBERT treadmill alignment guides are installed and should remain installed during crew sleep periods to protect against LOAC (Loss Of Attitude Control) while attitude control is degraded; the latter also renders use of unisolated exercise (Russian Velo) No-Go to reduce momentum perturbations; all other exercise is currently permitted. S-band is operating nominally (on String 2, with String 1 in hot backup); Ku-band is operating nominally; audio subsystem is operating nominally (Node 2, COL (Columbus Orbiting Laboratory) & the JPM are zero fault tolerant for C&W (Caution & Warning) annunciation and voice comm..); no video from Node 2, Node 3, COL & the JPM; HCOR (High-rate Communications Outage Recorder) is operating nominally; Russian UHF (Ultra High Frequency): no issues, both radios are deactivated.
Possible causes of the RPC trip include an electrical fault in the cabling between the RPCM and ammonia pump, electrical fault in the EMI (ElectroMagnetic Interference) filter, electrical fault in the pump control board, or an electrical fault in the pump. The RPC tripped because of an overcurrent; this points toward hardware components that do not have internal current limiting, such as the EMI filter, pump control board, and the pump itself (they get their current limiting function from the RPCM). A mechanical failure of the pump is considered unlikely.
After a pump restart attempt this morning, RPC-1 tripped again There will be more attempts.
There are two spare pumps on orbit. It will take two EVAs to remove and replace the pump. ISS is stable, but single string, and it is desired to get Loop A back as soon as possible. The teams are looking at replacing the 05/08 (Thursday) EVA with the first of two EVAs, followed by the second EVA on 07/08 (Saturday). The EVAs need special planning since the system is in a reduced power configuration.

---------- Post added at 06:46 PM ---------- Previous post was at 05:26 PM ----------

NASA's Main ISS Webpage said:
Mission Operations personnel and ISS Program management met Sunday morning to discuss the status of the loss of cooling loop A Saturday night on the International Space Station when a circuit breaker tripped just before 7 PM Central time Saturday night that resulted in the failure of the Pump Module for loop A that feeds ammonia to maintain the proper cooling for systems and avionics.

An attempt overnight Sunday to close the circuit breaker and restart the Pump Module was not successful.

The station is in a stable configuration with most systems receiving cooling and many systems operating with redundancy following the installation of jumper cables from the Destiny Lab's power system overnight. The crew is not in any danger and is monitoring systems and relaxing on an otherwise off duty day.

One of two Control Moment Gyroscopes (CMG-1) that was taken off line Saturday night was spun up once again this morning, enabling the station to operate with three of four CMGs to electrically control the orientation of the outpost. Temperatures on the Main Bus Switching Units, which route power to various systems, are a little higher than normal, but well within normal parameters and are stable.

The flight control and management teams today approved a preliminary plan to replace a planned spacewalk Thursday by Expedition 24 crewmembers Doug Wheelock and Tracy Caldwell Dyson with at least two spacewalks to swap out the failed Pump Module that resides on the station’s S1 truss. There are two spare Pump Modules on stowage platforms on the station's truss. The replacement module under consideration for replacement resides on External Stowage Platform 2, which is adjacent to the Quest airlock. The crew is being informed that replanning for alternate spacewalk activity is underway.

Although a final decision on a new spacewalk plan is still pending engineering and timeline analysis, the most likely scenario would call for an initial spacewalk no earlier than Thursday by Wheelock and Caldwell Dyson to replace the Pump Module and structurally bolt it into place on the S1 Truss, with an additional spacewalk by the duo two or three days later to mate fluid and electrical connections.

To protect for spacewalk activity later this week, the flight control team plans to vent residual ammonia in the lines between the Ammonia Tank Assembly on the S1 truss and the failed Pump Module Tuesday to prepare for the module's eventual replacement.

The tasks originally planned for Thursday's previously scheduled spacewalk by Wheelock and Caldwell Dyson to install a power extension cable to the Unity module prior to the delivery of the Permanent Multipurpose Module on the STS-133 mission in November and to install a Power and Data Grapple Fixture to the Zarya module to support future robotics work will be deferred to a later date.

A briefing to discuss the station's status and spacewalk replanning efforts is scheduled Monday on NASA Television at 3 PM Central time originating from the Johnson Space Center with Mike Suffredini, ISS Program Manager and Courtenay McMillan, Expedition 24 Spacewalk Flight Director. This briefing replaces a previously scheduled briefing on Tuesday.
 
Why do they have to wait until Thursday to do the EVA? At what point are Russia and the US going to be proficiant enough at EVAs to perform them on call at any moment. What if there was a failure that required immediate action?
 
Why do they have to wait until Thursday to do the EVA? At what point are Russia and the US going to be proficiant enough at EVAs to perform them on call at any moment. What if there was a failure that required immediate action?

a) They were doing an EVA anyway, they can't really have 2 so they want to try and do both things.
b) Everything is stable atm
c) EVA is hard, you can't really rush out until you know what you are going to do and how it is done.
d) If there was a failure, they would deal with that as it happens
There is still the pre-breath that needs to be done, and that lasts a number of hours.
 
Yeah, EVA may seem easy because the astronaut & cosmonauts are very skilled, but it's always a complex procedure that require extensive planning and physiological adaptation (the pressure inside the suits is very low (around 30kPa) with a 100% oxygen air).
 
Orlando Sentinel: "Coolant system fails aboard space station".

Florida Today: "ISS cooling system fails".

Florida Today's "The Flame Trench" Blog: "Urgent Spacewalks Planned After Station Cooling System Failure".

---------- Post added at 03:39 PM ---------- Previous post was at 01:16 PM ----------

Cady Coleman is going to be rehearsing PM R&R procedures in the NBL today.

Cady Coleman via Twitter said:
Some days training seems more real than others on E26. Today in the pool I'll practice the spacewalk for the pump module changeout for E24.


---------- Post added at 04:03 PM ---------- Previous post was at 03:39 PM ----------

NASA's Main ISS Webpage said:
Analysis, Spacewalk Preparations Continue After Loss of Cooling Loop.

Teams of flight controllers are continuing engineering analysis and refining spacewalk procedures to replace a failed International Space Station ammonia pump module later this week. Expedition 24 astronauts Doug Wheelock and Tracy Caldwell Dyson currently are scheduled to start the repairs on the station’s starboard truss Thursday.

A briefing to discuss the current station status and to preview the upcoming spacewalks will be broadcast on NASA Television at 4 PM EDT today. Briefers will include Michael Suffredini, the International Space Station Program Manager, and Flight Director Courtenay McMillan, who will lead the team supporting the spacewalks.

The pump failed Saturday night after a spike in electrical current tripped a circuit breaker. When the 780-pound pump failed, it shut down half of the station’s cooling system. Efforts to restart the pump, which feeds ammonia coolant into the cooling loops to maintain the proper temperature for the station’s electrical systems and avionics, were not successful. The station's crew worked with Mission Control to put the station in a stable configuration. The crew, which is in no danger, has resumed normal work activities. A tag-up to review procedures with spacewalk specialists is planned later today.

Mission Control also is preparing procedures for venting excess ammonia from the failed pump Tuesday in preparation for its removal. On Wednesday, flight controllers plan to move the Mobile Transporter, which will be used to support robotics operations for the spacewalks, into position at the replacement worksite.

Current planning continues to support an initial spacewalk on Thursday beginning just before 7 AM by Wheelock and Caldwell-Dyson to unbolt and remove the failed pump module, and to install the spare. NASA TV coverage will begin at 6 AM A second spacewalk to hook up a variety of electrical and fluid connections for the new pump module could occur two or three days after the first spacewalk.

Wheelock, who will be designated as EV-1, or extravehicular crew member 1, wearing the spacesuit bearing the red stripes, will be making the fourth spacewalk of his career, while Caldwell-Dyson, designated as EV-2, wearing the unmarked spacesuit, will be making her first spacewalk.

It looks like this EVA is really going to happen! :blink:

---------- Post added at 04:33 PM ---------- Previous post was at 04:03 PM ----------

Discovery News: "Space Station Problem Shows How Shuttle Will Be Missed".

^Agreed!
 
For anyone wondering, here's an image showing the location of the S1 PM (Pump Module):

attachment.php
 
Last edited:
NASASpaceFlight: "Two EVAs set up for ETCS coolant Pump Module changeout on ISS".

SPACE.com: "Big Space Station Can Have Big Malfunctions".

Florida Today: "Breakdown has NASA scrambling".

---------- Post added at 10:31 PM ---------- Previous post was at 10:30 PM ----------

Thanks. That's the NTA just to port of it, correct?

Yep, that is correct.

---------- Post added at 11:04 PM ---------- Previous post was at 10:31 PM ----------


Spaceflight Now: "Game plan coming together for station spacewalks".

From the article
A second pump module is mounted on ESP No. 3, attached to the upper side of the port three power truss segment on the left side of the station

Tut tut tut, ESP-3 was relocated to the lower side of the S3 Truss in Jan. :facts:

---------- Post added at 11:06 PM ---------- Previous post was at 11:04 PM ----------

I have to say that I can't think of a better reason to fly STS-135 now - take up a new Pump Module on the LMC, and return the old one to Earth for analysis. NASA said in a briefing earlier today that they have a spare PM on the ground (although they are working on a redesign with dual motors), and that it would be nice to get the old PM back! ;)

---------- Post added at 11:23 PM ---------- Previous post was at 11:06 PM ----------

Here is a video of today's mission status and EVA preview briefing.

And here is a video of today's EVA rehearsal training in the NBL (Neutral Buoyancy Laboratory) at JSC, by astronauts Cady Coleman & Sunita Williams.

---------- Post added at 11:56 PM ---------- Previous post was at 11:23 PM ----------

SPACE.com: "NASA Scrambling to Plan Vital Space Station Repairs".

---------- Post added 3rd Aug 2010 at 12:09 AM ---------- Previous post was 2nd Aug 2010 at 11:56 PM ----------

EVA Briefing Graphics.

Worksite Overview:
472090main_01_mcmillan_080210.jpg


S1 Location Bay 7:
472093main_02_mcmillan_080210.jpg


Replacement Pump Module Location on ESP-2:
472095main_03_mcmillan_080210.jpg


Spare Pump Module:
472097main_04_mcmillan_080210.jpg


---------- Post added at 03:16 AM ---------- Previous post was at 12:09 AM ----------

UPDATE:

EVAs now pushed back to Friday & Monday.
 
Last edited:
From the above article:

There is a bright side to the situation, McCurdy points out.

"Not having the shuttles forces people to think about long-duration spaceflight. If we go to Mars, we're potentially taking a space station-like craft out of Earth orbit. Our approach now has been to send up a new module. That's not going to be possible in interplanetary flight," he said.

Hear, hear.
 
Back
Top