Nvidia invests in Indian startup to lower AI computing costs

Nvidia's strategic investment

Nvidia has joined a $14 million funding round for Simplismart, an Indian startup focused on AI inference software. The investment round was led by Dallas Venture Capital and included participation from Accel, Shastra VC, and Micromax. This deal values the four-year-old company at approximately $100 million.

The partnership is notable because Nvidia is the primary supplier of the GPUs that companies use to power AI. By backing a company that helps users run models with fewer GPUs, Nvidia is betting on a strategy of efficiency. The goal is to make AI applications more accessible and attractive to a wider range of customers who may have limited budgets.

Beyond just providing capital, Nvidia is working directly with Simplismart on technical integrations. This includes collaboration between Simplismart engineers and Nvidia solutions architects regarding Dynamo inference software. Nvidia is also helping the startup connect with potential partners and new customers in the market.

Automating AI infrastructure

Running AI models at scale is often difficult because different tasks require different balances of speed, cost, and performance. Companies usually have to make complex manual adjustments to their computing infrastructure to meet these specific requirements. Simplismart provides a software layer that sits between the AI models and the hardware to automate these configurations.

The software allows businesses to customize how models respond, how many requests they can handle simultaneously, and how much computing power they consume. This enables companies to get more utility out of their existing GPU stacks without needing to manage the underlying technical details themselves. It essentially acts as a management tool for the deployment of AI models.

Simplismart offers its platform to various environments, including private cloud setups and on-premises infrastructure. It also provides tools for fine-tuning models and automatically scaling resources based on real-time demand. Furthermore, the startup allows cloud providers to build and operate their own AI inference services using the company's software.

Real-world cost savings

The startup has already demonstrated its ability to reduce expenses for high-demand AI applications. For example, the AI video-generation platform InVideo used Simplismart's software to cut its GPU serving costs by 56%. This highlights the software's ability to provide significant savings for companies handling heavy workloads like video generation.

Other notable clients include the AI video companies HeyGen and Higgsfield, as well as the enterprise AI startup Ema. Additionally, the Indian cloud provider Yotta uses the technology to power its serverless AI inference service within the Shakti Studio platform. These diverse partnerships show the software's versatility across different types of AI products.

Simplismart's growth has been rapid, with its annualized revenue run rate increasing 14-fold over the last six months. This growth reached an eight-figure sum based on recent customer usage. While the company has more customers in India, more than half of its revenue currently comes from the United States.

Market competition and growth

Simplismart is entering a crowded market where it competes with major cloud providers like Amazon Web Services, Google Cloud, and Microsoft Azure. It also faces competition from Nvidia's own offerings and a growing number of startups developing inference tools. The company differentiates itself by focusing on specific service-level agreements and total cost of ownership.

While some rivals offer fixed options for speed or cost, Simplismart aims to find a custom balance for each unique customer need. The founders, former engineers from Oracle and Google, built the company based on their experience deploying machine-learning systems. The startup currently employs 58 people and is looking to expand its footprint.

The company plans to use the new funding to grow its team and expand its presence in the U.S. market. This move comes despite rumors of a much larger funding round, which the CEO declined to comment on. Simplismart stated that this Series B round is now closed and will not be extended.