TECHNOLOGY
“ Cost will continue to be an issue and the ability to accurately assess the ROI will be vital if Gen AI projects are to be deployed in production ”
DR CHRIS HILLMAN DATA SCIENCE SENIOR DIRECTOR INTERNATIONAL , TERADATA
Scaling , the Gen AI problem Despite these hurdles , the momentum behind cloud-powered AI shows no signs of slowing . Innovations in cloud infrastructure are keeping pace with the evolving needs of AI systems .
From specialised hardware accelerators to advanced data management tools , cloud providers are continuously expanding their offerings to support the next generation of AI applications .
Scaling in terms of computational power could therefore see solutions coming in the near future .
Yet Paul warns of pitfalls in the interim : “ There is a fast-growing economy of companies that will manage the complexity of building your models for you , but with those , there is a real risk of vendor lock-in by buying into their proprietary ecosystems .”
However , exploring partnerships with cloud providers could allow you to keep control of your model whilst also keeping a cap on costs .
To do this , Dr Chris explains : “ It will be important to understand how much of the resource is needed on-demand and how much will be required to be permanently available .”
Understanding the distinction between on-demand and permanent resource needs is crucial for organisations deploying Gen AI in the cloud , as it directly impacts both scaling capabilities and cost management . aimagazine . com 173