LLMs are all the rage, but those who focus only on the tip of the iceberg are in for a rough ride.

Rob Lubow
Botcopy Blog
Published in
4 min readJan 23, 2023

--

LLMs like chatGPT are the tip of the iceberg for AI teams in enterprises and the public sector. But those who wisely navigate the extensive backend functionality of a cloud-based AI stack will stay afloat and change the world.

Home base for Botcopy’s smart developer community.

To create the ultimate chat stack visit Botcopy for a free trial. Tie together Dialogflow and more CCAI layers to create a system that will change the way your organization operates.

Don’t get me wrong, LLMs are fantastic.

They bring natural language understanding to a new level. I’ve written about chatGPT, I love it as much as anyone, and I can’t wait to try the ready-for-primetime version of Google’s competing model that convinced one of its engineers it was sentient.

But given Botcopy’s vantage point behind the scenes working with enterprise and the public sector in 2022, the LLM commotion could be slightly misleading.

Innovative companies aren’t getting distracted by LLM quite yet. Instead, they are calmly and quietly getting their sea legs with a cloud setup designed for the AI-first era. An era exemplified by pushing and pulling stored data securely through AI-powered chat on websites and sewing in your operational tools to automate more tasks, streamline business, and give users what they’ll demand in 2023 and beyond.

Beyond the tip of the iceberg:

  • Siloed knowledge, often for authenticated users.
  • Personal and transactional info. For example, checking on status, changing account info, and completing a form component within the chat that gets shuttled to the right person or CRM.
  • Escalation flows and analytics. Did I mention live chat and ticketing?
  • Backend logic to tie into third-party apps and databases.
  • Automated analysis of transcripts to inform future enhancements of your conversational UX.
  • ADA compliance, safety, and security — the kind you get from a reputable cloud environment like Google.
  • Bank-level piece of mind, HIPAA/healthcare or public sector compliance.

So it’s no coincidence Microsoft is going all-in on Open AI. They know that LLMs are irrelevant if you don’t get your cloud system in order. The bring-your-own cloud model for AI web chat is emerging as the best option for a good reason. So catch the wave, choose your cloud, and select it wisely.

Google Cloud and Botcopy: a strong choice.

Google is the most innovative cloud and the fastest growing. It didn’t NEED to partner with Open AI like Microsoft because it has a better LLM waiting in the wings, which I presume Google is working on to add safety bumpers so that customers are clear of reputational risks.

In part, Google is also a strong choice because of the Botcopy piece. As a Google partner SaaS, our software helps ease Google Cloud customers into the conversational AI world. A robust front-end for web chat (like what we offer as a convenient SaaS) is often a vast, underestimated barrier to entry for adding next-level AI experiences to your website.

From our perspective, and that of our customers, a good web chat UI layer for Dialogflow needs to have Google OAuth, ADA 2.1 AA compliance, an enormous range of customizations, rich content such as buttons, carousels, etc., and top-of-funnel features like window methods, page-to-page context keeping, and language localization.

It also needs a live chat suite or open endpoints to help manage no-matches and facilitate an infinite learning loop.

Botcopy checks all those boxes. Plus — and this is vital — we don’t hold the data because our bring-your-own cloud model lets you store everything in your Google Cloud Project under lock and key.

Lastly, we don’t railroad you into using our backend builder. We don’t have one. After all, Google is admittedly better at that part. Likewise, Google doesn’t have an approved/supported web chat UI layer like ours because we focus exclusively on that part, and that’s why our partnership with them is so harmonious.

Kudos to Google Cloud and Google Public Sector for partnering with smaller SaaS providers that specialize. Google’s partner model means endless flexibility for you to design a bespoke stack, all under Google Cloud, an umbrella you trust.

We wrote a book for newbs and experts alike.

It’s called The Ultimate Contact Center AI Setup. Get it free here. It covers the exact recommended setup in detail. It’s fun and illuminating, nothing like homework, I promise.

Be bold! Sign up for a free trial of Botcopy. Or reach out to us whether you’re a backend developer, a web/frontend developer, a conversational designer, a data scientist, a product manager, or something else entirely. We’ll advise you on how to fill in the gaps and go from strength to strength.

TLDR: While LLMs revolutionize the natural language understanding/generation piece, it’s still merely the tip of the iceberg. The backend fulfillment of a framework like Dialogflow CX and Google Cloud includes a zillion things besides NLU/NLG. For example, Botcopy Messenger and Botcopy Live Chat are two essential layers — there are many more. Ignore the whole iceberg at your peril!

--

--

Cofounder @ Botcopy, a SaaS that connects Google Cloud Dialogflow to a whip-smart web chat that’s quickly becoming the UI of choice for enterprises worldwide.