BROKERAGE & WEALTH

Next generation chatbot eases data access

Gen AI tools help users of retail brokerage trading platform obtain information related to specific needs and complex queries.

Client
Large U.S.-based Brokerage and Wealth Management Firm
Goal
Enable a large number of users to readily access summarized information contained in voluminous documents.
Tools and Technologies
Google Dialogflow ES, Pinecone, Llamaindex, OpenAI API (GPT-3.5 Turbo)
Business Challenge

A large U.S.-based brokerage and wealth management client has a large number of users for its retail trading platform that offers sophisticated trading capabilities. Although extensive information was documented in hundreds of pages of product and process manuals, it was difficult for users to access and understand information related to their specific needs (e.g., How is margin calculated? or What are Rolling Strategies? or Explain Beta Weighting).

Solution

Our Gen AI solution encompassed:

  • Building a user-friendly interactive chatbot using Dialogflow in Google Cloud
  • Ringfencing a knowledge corpus comprising specific documents to be searched against and summarized (e.g., 200-page product manual, website FAQ content)
  • Using a vector database to store vectors from the corpus and extract relevant context for user queries
  • Interfacing the vector database with OpenAI API to analyze vector-matched contexts and generate summarized responses
Outcomes

The OpenAI GPT-3.5 turbo LLM (170 bn parameters) delivered impressive linguistic search and summarization capabilities in dealing with information requests. Prompt engineering and training are crucial to secure those outcomes.

In the case of a rich domain such as a trading platform, users may expect additional capabilities, such as:

  • API integration, to support requests requiring retrieval of account/user specific information, and
  • Augmentation of linguistic approaches with semantics to deliver enhanced capabilities.
Contact

Our experts can help you find the right solutions to meet your needs.

Get in touch
Explore the world with Iris. Follow us on social media today.
Copyright © 2024 Iris Software, Inc. All rights reserved