The expression makes these wonderful fruits sound worthless.
Whereas in fact it comes from a Spanish pun between the 2 almost identical words for fig and the female genitals.
It was the name for a rude gesture in which the thumb is placed between the first and second fingers.
In Shakespeare’s time it was known as The Fig of Spain.
Knowing all this doesn’t lessen my pleasure in eating them!