Fix compilation issue on some CI runners

Somehow the compilation of yaml-cpp failed without proper error on some CI runners. Make terminated with an internal error. The workaround is to not to run the build process in parallel. Move the download from build to configuration time.