Remova a pasta do repo, mas mantenha localmente

git rm -r --cached File-or-FolderName
git commit -m "Removed folder from repository"
git push origin master
The Rambling Lank