Specify libs directory #595

Job	Run time
cache_libs / cache_libs (ubuntu-22.04-arm)	17s
cache_libs / cache_libs (windows-2022)	28s
cache_libs / cache_libs (macos-latest)	12s
cache_libs / cache_libs (windows-11-arm)	36s
cache_libs / cache_libs (ubuntu-22.04)	10s
manylinux (cp314-cp314, manylinux_2_28_x86_64)	3m 52s
manylinux (cp314-cp314, manylinux2014_x86_64)	3m 21s
manylinux (cp314-cp314, musllinux_1_2_x86_64)	4m 5s
	13m 1s

Provide feedback