Pulling the image again while the ref hasn't moved should be noticeably faster than cloning each time, since all the git checkout stuff is already done for you and saved.
And when the ref moves it should still be faster, since it fetches server-side.
New dynamic image registry dropped: https://git.kontain.me
This one takes a Git repo[:ref] and serves an image with that repo already shallow-cloned in /git.
Try it:
docker run --rm git.kontain.me/github.com/imjasonh/kontain.me -c "git status"