Approximately 1,200 guests attended President George H. W. Bush’s funeral at St. Martin’s Episcopal Church in Houston on Dec. 6 to bid farewell to the 41st president, including the Oak Ridge Boys, who performed an a capella rendition of “Amazing Grace” after making a lighthearted joke that President Bush considered himself to be a good bass singer.

“We first sang for him in October of 1983 on the lawn of the White House when he was vice president, and he said, ‘Fellas,’ he always called us fellas, ‘Would you sing me a few songs, I’m a big fan,” said the Oaks’ Joe Bonsall before the performance. “For decades we have sang for him. And this is, again, a real honor to be here. What a lot of people may not know is he fancied himself to be a good bass singer—he was not. We’ll sing for our president.”

Watch the Oaks’ performance below.

“We’ll sing for our president.”

The Oak Ridge Boys sing “Amazing Grace” at funeral service for former Pres. George H.W. Bush in Houston, TX. https://t.co/GVUtvaVWZW #Remembering41 pic.twitter.com/0ipkITrNvL

— ABC News (@ABC) December 6, 2018