Skip to content
0:00 / 0:00

#voyager1#flightsoftware#nasa

Saving Voyager 1! - Bruce Waggoner at !!Con 2024

!!Con

1.5K subscribers • 1 video on Hallway

YouTube
  • Recommended by 5 people: 4 on Hacker News and 1 on Lobsters.
  • Presented by Bruce Waggoner, Mission Assurance Manager at NASA JPL

Intermediate. Assumes working knowledge.

7.9K views2 years ago5 recommendations

Systems programmingHistory and cultureDebuggingEmbedded systemsHistory of computing

Bruce Waggoner explains how NASA engineers diagnosed a memory failure on Voyager 1 and patched its flight software from billions of miles away.

Saving Voyager 1! Both of the 47 year old Voyager spacecraft are currently in interstellar space and returning their most important data set; in-situ measurements of the magnetic field, plasma and dust beyond the Heliopause. In late 2023, Voyager 1 lost all downlink telemetry and the flight team had essentially no visibility into the state of the spacecraft which is over 15 billion miles from the Earth. This talk will detail how the flight team diagnosed the problem, and formulated a recovery plan to patch the Flight Data System flight software. Bruce Waggoner is the Mission Assurance Manager at NASA Jet Propulsion Lab/Caltech. He graduated from the University of Nebraska with a BS in Physics and Astronomy. He has worked at JPL for 39 years supporting dozens of Earth orbiting and deep space missions. He also volunteers as a gymnastics coach and assists teaching girls engineering and science at a local high school. Presented at !!Con 2024 (pronounced, of course, "bangbangcon"!) in Santa Cruz, CA -- bangbangcon.com/ !!Con is a production of the Exclamation Foundation -- exclamation.foundation/

Why it's here

5 people recommend this

What people say. Recommended as an amazing talk detailing the computer architecture, blind debugging challenges, and lack of documentation when recovering Voyager 1.

tverbeureon Hacker News • Recommends

On “NASA Pulls Off Delicate Thruster Swap, Keeping Voyager 1 Mission Alive”

2 weeks ago, Bruce Wagoner from the Voyager program gave a talk at !!Con about how they recovered from the CMOS memory issue that they had a year ago. It’s basically blind debugging with a latency of 45 hours. The talk is amazing and goes through the computer architecture of the spacecraft as well as the challenges of dealing with something that is so old, with so documentation that has conflicting information or unreadable etc. link to this video

tverbeureon Hacker News • Recommends

On “NASA Pulls Off Delicate Thruster Swap, Keeping Voyager 1 Mission Alive”

When Voyager failed last year with a CMOS memory error, one of the big problems was that a bunch of low level information was gone or conflicting. For example, they sometimes had to guess assembler instructions because the code printouts were low quality photocopied pages. Or because there were handwritten comments or comments scratched out with pencil without any clue about why it was done. One saving grace was the fact that the architecture and the code space was simple enough so that they could reason through the symptoms and actions to take, something that would have been much harder with modern spacecraft. Check out this amazing talk: link to this video

Twisolon Hacker News • Recommends

On “NASA Pulls Off Delicate Thruster Swap, Keeping Voyager 1 Mission Alive”

I had the extreme pleasure of seeing Bruce Waggoner of the Voyager team give a keynote at !!Con just last month. The recording landed on YouTube just a couple days ago, so this is great timing: link to this video

Ductapemasteron Hacker News • Recommends

On “NASA reconnected with Voyager 1 after a brief pause”

Check out this talk: link to this video The source code isn't hiding in a repo somewhere for security reasons — it's spread around on various pieces of paper and computers over the last 50 years. There isn't a single source of truth. Adds a whole other level of wizardry to keeping the thing running.

asalahlion Hacker News • Recommends

On “Ask HN: What are you working on? (February 2025)”

You might like this and or find it inspiring, in case you haven't seen it already: Saving Voyager 1! - Bruce Waggoner at !!Con 2024 - link to this video Edit: Also, please do share when it's playable :)

ndiddyon Hacker News • Mentions

On “NASA still maintains some of the Voyager spacecraft code from the 70s era”

…ople retire. The result of all of this is that they legitimately do not have a full understanding of how the hardware and software operates. Here's one example from a talk about how the crew fixed an issue with the Flight Data Subsystem, one of the computers that hadn't needed any significant software changes since the interstellar mission began ( link to this video ): > So our top priority was to figure out what the FDS was and how it worked. Because unfortunately the person who was the real expert had retired decades ago and the person who was their fill-in, their backup, had retired two years ago. So it was the worst place it could have hit us. The…