Hi PMunch,
Vim3 doesn’t support voltage input from the GPIO pins so the pi juice is out of the question,
look into the topic Powering the VIM3
as mentioned, you can provide power via the VIN port
however you can’t charge your batteries from it, hence you will need to provide your own battery charging and voltage management circuitry 