Git only tracks files. SVN also tracks directories. So if you are using git svn to interoperate between the two, there can be problems. If you delete a bunch of directories in a git commit and then dcommit that change up to SVN, the directories themselves will not be deleted from the SVN repository.
You can work around this problem by including the --rmdir switch on dcommit. This will delete any empty directories upon commit. If you do not care about empty directories, this works fine. But if you do care about empty directories (maybe a build script depends upon their existence), there does not appear to be a satisfactory prepackaged solution.