Cost of building with Jugalbandi

Accessing the Jugalbandi stack is and will remain free, through the project’s GitHub repository. To be able to utilise the stack to build and offer solutions, any individual or organisation needs to consider the cost of operating the application and the associated data & infrastructure.

The key considerations in budgeting for a conversational service is as follows:

  1. Estimating the usage and plan to scale

  • The amount of people using the service, how often they use it and the complexity of their queries will determine the associated costs of the cloud infrastructure and services that will be required for solutions such as Jugalbandi to operate

  • For example, if 100 users send 30 messages each day, an estimated ₹656 per month would have to be budgeted for processing these messages using LLMs such as GPT-4o mini or 3.5.

  • Start small and add more resources as needed. This helps control costs and scale efficiently.

  • Depending on the nature of the use case, cloud service providers are known to offer negotiated contracts to access their services at subsidised rates.

  1. Monitoring data transfer and storage needs

  • Calculate how much data will need to be stored including user data, message logs and media files. This should also include the costs of encrypting and masking sensitive information.

  • The data in and out of cloud services, would have to be routinely monitored in accordance with the regional regulations on data protection and privacy.

  1. Human Resources

  • Depending on the complexity of the use case, data scientists, data engineers and full stack developers may be needed to implement the solution as per the requirements.

  1. Communication Costs

  • Based on the medium of communication with users, there may be additional costs incurred through third party service providers.

  • While the exact cost will vary based on the chosen service provider, at an estimated Rs. 0.3 per session, the same example from above of 100 users sending 30 messages a day would cost an additional ~Rs. 1000 a month over whatsapp.

The following table indicates the costs associated with deploying and operating a platform with Jugalbandi manager:

Cost CategoryService RequiredIndicative Cost (as of July 2024, and all costs are subject to the terms of the service provider)Notes

Cloud Infrastructure

Compute

~Rs. 10 per hour per VM

Running compute resources. The cost will vary based on usage

Storage

~Rs. 2 per GB

Storing user data and media. Estimated: ₹166.71 per month (assuming 100 GB)

Event Hubs for Kafka

~Rs. 120 per processing hour

Queue management for messaging between the various services of the platform.

Vector Databases

~Rs. 25 per hour

Scalable databases for AI models

Landing Zones

Can vary based on the chosen service providers

A one-time cost for the initial setup of cloud resources

Embedding Models

₹0.008336 to ₹0.010836 per 1000 tokens

Creating chunks of the provided knowledge bases to be consumed by AI models

Speech Processing

₹83.35 to ₹1,250.27 [per million characters or audio hours]

Converting speech to text, text to speech, and processing text.

LLMs

GPT-3.5 Turbo Tokens

₹0.125 (Input) + ₹0.167 (Output) per 1000 tokens

Processing user messages for AI responses. Estimated: ₹656 per month for a 100 users with 30 messages each

Technical implementation team: Data Scientists, Data Engineers & Full-Stack Devs

Whatsapp/Communication Channel Integration and Communication Services

Data handling, transfer, security and compliance costs

Last updated