Our LLM was burning tokens on 3D modelling, so we made it a director instead of a builder (~64% cut)

In the rapidly evolving landscape of AI and SaaS, optimizing costs while maintaining efficiency is crucial. A recent discussion on Reddit highlights an inn...

In the rapidly evolving landscape of AI and SaaS, optimizing costs while maintaining efficiency is crucial. A recent discussion on Reddit highlights an innovative approach to reduce expenses associated with using large language models (LLMs) for 3D modeling.

Who is it for?

This approach is particularly beneficial for developers and companies engaged in creating applications that rely heavily on 3D modeling. If your project involves generating complex 3D environments or objects from textual prompts, this strategy could significantly reduce operational costs and improve output consistency.

✅ Pros

  • Reduces token consumption by optimizing the use of LLMs.
  • Improves speed of 3D model generation.
  • Ensures consistent results with deterministic output.
  • Makes debugging and customer support more manageable.
  • Predictable costs enhance pricing strategies.

❌ Cons

  • Requires significant upfront work to develop and maintain custom generators.
  • May not be suitable for all domains, particularly those lacking structured data.

Key Features

The key feature of this approach is the shift from using LLMs to generate entire 3D code to having them make high-level decisions. The model now determines aspects such as building type, height, style, and road placement, while the actual 3D generation is handled by custom-built generators. This separation allows for more efficient use of resources and improved performance.

Pricing and Plans

While specific pricing details were not disclosed, the reduction in token usage—from approximately 4.5 million tokens to about 1.6 million tokens per building—indicates a significant cost-saving potential. As the team noted, predictable costs make pricing strategies less daunting, allowing for better financial planning. However, pricing details may change, so it's advisable to stay updated with the latest information.

Alternatives

There are various alternatives in the market for 3D modeling and generation, but many may not offer the same level of customization or cost efficiency. Tools that rely solely on LLMs for code generation often face similar challenges of high token consumption and unpredictable outputs. Exploring hybrid models that combine LLMs with traditional coding practices may yield similar benefits.

Best For / Not For

This method is best for teams that have the capacity to invest in building and maintaining custom generators and operate in domains where structured data can be effectively encoded. It may not be suitable for projects that require highly dynamic or unpredictable 3D generation, where the flexibility of LLMs is paramount.

Our Verdict

Transitioning from using LLMs for extensive 3D modeling to a more structured approach of decision-making can lead to significant cost savings and efficiency improvements. While it requires substantial initial development, the long-term benefits for structured domains are promising.

Try Systeme.io
Start your free trial or explore pricing
Get Started →
All reviews