Here’s an excerpt from Brooklynometry:

I’ve been wondering for a while now what exactly a Ginkgo seed looks
like, and hearing so many complaints lately about the terrible smell of
the fruit, it seemed my work was cut out for me. The Chinese who
collect the fruit for the seeds wear rubber gloves to protect their
hands from noxious oils like those found on poison oak. I thought they
were only avoiding the abominable smell. I had no rubber gloves so I
used a stick and a napkin.

Once the pulp that smells like vomit
is cleaned off the seed loses the odor and is full of charm. I hear
they’re often eaten roasted, but although beneficial for various health
reasons, I’ve read that adults should eat no more than 10 a day,
children half that. The bad boys are toxic. Like most things if you eat
enough of them.