You can use this as a start point for managing a WordPress install with git.
In it's current state, all you need to do is clone this repo,
git submodule update --init then copy
wp-config.php, update your database settings, and your default theme.
See 'Install and manage WordPress with Git' for more details.