For whisper.cpp I optimized the CZ model for CoreML. This improved speed on my M2 like 10%, but with significantly less memory and energy used. It has small priority on the desktop, but could be important on the iPhone. Feel free to contact me, I can convert them for you.