Let's pass on it

[kjc0123]

What is the meaning of "Let's pass on it" in the following sentences?

 

"Everybody wants to come out to the house," he said with a mouthful. 
"It's off limits," Ray said. 
"That's what I'm tellin' them. Y'all want to receive guests tonight?" 
"No," said Forrest. 
"Should we?" asked Ray.
"It's the proper thing to do, either at the house or at the funeral home. But if you don't, it's no big deal. Ain't like folks'll get ****** and refuse to speak to you." 
"We're doing the courthouse wake and a funeral, isn't that enough?" Ray asked. 
"I think so."
"I'm not sittin' around a funeral home all night huggin' old ladies who've been talkin' about me for twenty years," Forrest said. "You can if you want, but I will not be there."
"Let's pass on it," Ray said. 
"Spoken like a true executor," Forrest said with a sneer. 

[jno]

It means 'let's not do it' or perhaps 'let's not talk about it'. I think it comes from playing cards; when your turn comes in some games, you can play a card or 'pass' - not do anything, just let the next person take his turn.