Speed buff doesnt affect fighter skills as far as I know. The speed buff is only useful for something like Way of the Gun and normal gun spam and maybe barely for range spam (but u should be wearing bohemian for range anyways).
It's great for ninja regular attack too (if you don't want to switch between skillsets)