Some providers offer VMs with dedicated cores.

Not necessarily recommending Linode, but here's an example:

https://www.linode.com/pricing/#compute-dedicated

They obviously cost more, but it could be a solution to your problem.

VPS means cheap shared VMs. You can only get fast CPUs there by being lucky.

Have you determined your program CPU-bound?

AWS r7iz claim to be good and sped it up close to Mac M1 performance.