F5 has introduced it’s bringing sturdy software safety and supply capabilities to AI deployments powered by Intel. This joint resolution combines safety and visitors administration from F5’s NGINX Plus providing with the cutting-edge optimisation and efficiency of the Intel Distribution of OpenVINO toolkit and infrastructure processing models (IPUs) to ship safety, scalability and efficiency for AI inference.
As organisations more and more undertake AI to energy clever functions and workflows, environment friendly and safe AI inference turns into important. This want is addressed by combining the OpenVINO toolkit — which optimises and accelerates AI mannequin inference — with F5 NGINX Plus, offering sturdy visitors administration and safety.
The OpenVINO toolkit simplifies the optimisation of fashions from virtually any framework to allow a write-once, deploy-anywhere strategy. This toolkit is important for builders aiming to create scalable and environment friendly AI options with minimal code adjustments.
F5 NGINX Plus enhances the safety and reliability of those AI fashions. Performing as a reverse proxy, NGINX Plus manages visitors, ensures excessive availability and supplies lively well being checks. It additionally facilitates SSL termination and mTLS encryption, safeguarding communications between functions and AI fashions with out compromising efficiency.
To additional increase efficiency, Intel IPUs offload infrastructure providers from the host CPU, liberating up assets for AI mannequin servers. The IPUs effectively handle infrastructure duties, opening up assets to boost the scalability and efficiency of each NGINX Plus and OpenVINO Mannequin Servers (OVMS).
This built-in resolution is helpful for edge functions, corresponding to video analytics and IoT, the place low latency and excessive efficiency are essential. By operating NGINX Plus on the Intel IPU, the answer helps guarantee dependable responses, making it an optimum alternative for content material supply networks and distributed microservices deployments.
“Teaming up with Intel empowers us to push the boundaries of AI deployment. This collaboration highlights our dedication to driving innovation and delivers a safe, dependable and scalable AI inference resolution that can allow enterprises to securely ship AI providers at velocity. Our mixed resolution ensures that organizations can harness the facility of AI with superior efficiency and safety,” stated Kunal Anand, the chief expertise officer at F5.
“Utilizing the cutting-edge infrastructure acceleration of Intel IPUs and the OpenVINO toolkit alongside F5 NGINX Plus may help allow enterprises to grasp modern AI inference options with improved simplicity, safety and efficiency at scale for a number of vertical markets and workloads,” stated Pere Monclus, chief expertise officer, community and edge group of Intel.
The answer is now accessible. For extra data, go to f5.com/intel. As well as, a companion weblog from F5 CTO Kunal Anand supplies additional perception on this providing.