I tend to believe in the former, but some claim that some Sumerian artifacts were used as batteries for gold plating of other artifacts, and that they were made about 250 BCE.
These are known as the Baghdad Batteries, or Parthian Batteries and you can see the Wikipedia article here.
I'm feeling skeptical!
This article seems to me to have a much better explanation of the findings. Electricity then becomes a modern invention again.