Github Action build on Linux can pull in AVX512 via `-march=native` by default

[InternetOfTofu]

(For a detailed analysis on the code path involved, please see cjpais/Handy#91 (comment))

Currently transcribe-rs's whisper support depends on whisper-rs which includes whisper-rs-sys that contains a build.rs which configs and builds whisper.cpp as a library. However, whisper.cpp by default enables -march=native unless it's explicitly instructed to do a reproducible build or cross compilation. This chain of dependency in the end causes Handy's github action artifacts in some probability (some github action machines are avx512 enabled) will create a binary that includes avx512 instructions which isn't supported on most desktop platforms.

As I do not know an elegant solution to this problem, my current suggestion is to carry a patch to whisper-rs and whisper-rs-sys to manually set GGML_NATIVE flag to false. This can also be made into a feature if whisper-rs accepts it.

[cjpais]

Sounds good thanks for the detailed look. Wil definitely try to disable the flag if possible. Let me know if you find out anything else. I don't have time to look deeply this week but hopefully next week I will get some more time to look

I think we may need to fork whisper-rs or create our own whisper.cpp bindings, or use a rust based whisper inference library. The latest versions of whisper-rs don't have good support for older versions of OSX.

[InternetOfTofu]

Thanks for the quick reply. I found out that the culprit line was removed in this commit: ggml-org/whisper.cpp@44d1cbd and later on whisper.cpp does not put -march=native flag on non-cpu backends.

Looking at when was this changed pulled into whisper-rs, it happened in 0.14.1 (but it's yanked), so bump whisper-rs dependency to any later version of 0.14 should fix this problem.

[cjpais]

The issue is whisper-rs beyond 0.13.2 doesn't support older OSX versions (I forget which), so I've not upgraded it until I can resolve those or whisper-rs does. I've not had much time to investigate the build system as it relates to this.