๐ก๏ธ Google open-sources HEIR for private AI inference
Google has open-sourced the HEIR compiler, which automates converting models for encrypted AI inference. This project involves multiple institutions like Intel, UC Santa Barbara, and Tsinghua. Benchmarks show sorting 32 integers takes 34 seconds, while encrypted GPT-2 inference is slow. HEIR aims to be a one-click solution for regulated industries like healthcare and finance. This open release allows rivals and startups to build on Google's compiler layer. ๐ก๏ธ