01 Investing AI

The Investing AI Agent Playbook

A strategic map for launching and scaling AI across digital investing experiences. It helps wealth, product, CX, and AI transformation leaders deploy faster, scale with confidence, and turn investing AI into measurable business value.

  • SpareBank 1

    odeabank

    CIO GROUP

  • SpareBank 1

    odeabank

    CIO GROUP

Playbook

Explore this topic with AIOpen ChatGPT

4.4 LLM choice

It is easy to make the model decision feel like the whole AI strategy.

That is understandable. LLMs are visible, fast-moving, and full of vendor claims. But for a bank building an investing AI agent, the more useful question is not simply which model is best? It is which model strategy lets us stay compliant, accurate, adaptable, and commercially sensible as the market changes?

That is why Charlie is model-flexible. You can choose the model that fits your requirements today, and keep the rest of the investing layer stable when better or cheaper models appear tomorrow.

Start with requirements

There is no single best model for every financial institution. The right setup depends on what the agent needs to do, where data may go, and how the experience should behave.

Requirement

What to check

Compliance and data handling

Where prompts, outputs, traces, and tool results are processed and stored.

Answer quality

How the model performs on real portfolio questions, not only generic benchmarks.

Tool use

How reliably the model calls portfolio, market-data, guardrail, and workflow tools.

Latency

How quickly the assistant can answer during a normal client conversation.

Cost

How much each conversation costs at expected volume, including guardrails and summaries.

Future flexibility

How easy it is to test or switch models without rebuilding the product.

Cost is an architecture question

A good LLM setup can be much cheaper than people expect. With a strong fast model, a normal useful Charlie conversation can often sit around 2 to 8 cents, depending on length, model choice, tool calls, deployment setup, and volume.

Very small interactions can be far lower. In some cases, a conversation can be around 0.01 cents. That is only possible when the product is built carefully: compact prompts, compact tool outputs, smart routing, and no habit of sending the full investing app into the model.

For example, Google’s Gemini API pricing lists Gemini 3.1 Flash-Lite Preview at low per-million-token rates. That kind of pricing makes low-cent conversations realistic, but only if the system uses the model efficiently.

This is one of the reasons Charlie is built around tools. The LLM should communicate, reason, and decide which capability to use. It should not calculate portfolio performance from memory, invent market facts, or receive unnecessary raw data.

Why not build your own model first?

Building your own model is not a bad idea. It can make sense when the model itself is the strategic product, or when there are very specific sovereignty, research, or performance reasons.

For most investing AI projects, it is just not the best first investment. The real work is usually elsewhere: connecting portfolio data, broker systems, market data, deterministic calculations, guardrails, evaluations, traceability, and the operating model your teams can approve.

Training or deeply owning a model also creates ongoing work: specialist talent, infrastructure, data governance, red teaming, monitoring, model updates, incident response, and proof that the model behaves safely over time. That can be worth it, but it should be a deliberate decision, not the default starting point.

If the goal is...

Usually start with...

Better portfolio answers

Better tools, cleaner data contracts, and stronger evaluation cases.

Lower cost

Model routing, compact prompts, caching, summaries, and efficient tool outputs.

More control

Private deployment, self-hosted options, strict logging, and clear model governance.

Better brand voice

Prompt configuration, response rules, tone testing, and optional fine-tuning.

A differentiated experience

Portfolio context, workflows, guardrails, traceability, and the client experience around the model.

Keep the model layer movable

Model switching should still be tested carefully. Different models behave differently. Tool-calling, tone, latency, refusal style, multilingual quality, and safety behaviour all need review.

But a model change should be a contained project, not a rebuild. In Charlie, the portfolio tools, market-data connectors, guardrails, traces, and workflows stay stable while the model layer can evolve.

FAQ

How should you choose an LLM for Charlie?
Should you build your own model?
Can Charlie switch model providers?
Which jobs should not be done by the model?
Can you use private or self-hosted models?
How should models be evaluated?

Meet Charlie. The Investing AI Agent.

Give your clients an entire investing experience, rebuilt from the ground up as a conversational AI agent.

Unlock more insights in
digital investing and reporting
MiFID II Risk Profiles: Is it like hiking Alpine mountain trails?

Debiasing in real time: Experimental research on mitigating the disposition effect among retail investors.

There is no lack of books on the many biases that undermine effective financial decision-making. But how do you actually counter the biased behaviour of an investor -in real time- on a 9:16 inch mobile screen? We did experimental research with University of Leuven’s Mintlab to find out if we could decrease the so-called ‘disposition effect’ using nudging techniques.

Read more

Microlearning moments benefit both investors and investment platforms

Microlearning is the snappy cousin of e-learning and a common feature in many apps. But will a microlearning layer, embedded in an investment app, increase people's interaction with educational content? Will it improve knowledge retention? And will users favor this learning experience? To find out, we partnered up with the ‘Meaningful Interactions Lab’ to conduct experimental research. Here are the results:

Read more

Digital Investor Series - The unstoppable rise of the digital investor 4

This update is part of a series, building upon the perspective at the end of 2020: ‘The Unstoppable Rise of the Digital Investor’. In this topic we highlight: Beijing crackdown triggers Chinese tech stocks sell-off in July / The accelerated growth of direct indexing / Robinhood: from a disappointing IPO to a steep surge / The unstoppable rise of cryptocurrency trading amongst young people / Banks launch neobanks: super apps and investing / New investors are getting younger and younger

Read more
Unlock more insights in digital investing and reporting
MiFID II Risk Profiles: Is it like hiking Alpine mountain trails?

Debiasing in real time: Experimental research on mitigating the disposition effect among retail investors.

There is no lack of books on the many biases that undermine effective financial decision-making. But how do you actually counter the biased behaviour of an investor -in real time- on a 9:16 inch mobile screen? We did experimental research with University of Leuven’s Mintlab to find out if we could decrease the so-called ‘disposition effect’ using nudging techniques.

Read more

Microlearning moments benefit both investors and investment platforms

Microlearning is the snappy cousin of e-learning and a common feature in many apps. But will a microlearning layer, embedded in an investment app, increase people's interaction with educational content? Will it improve knowledge retention? And will users favor this learning experience? To find out, we partnered up with the ‘Meaningful Interactions Lab’ to conduct experimental research. Here are the results:

Read more

Digital Investor Series - The unstoppable rise of the digital investor 4

This update is part of a series, building upon the perspective at the end of 2020: ‘The Unstoppable Rise of the Digital Investor’. In this topic we highlight: Beijing crackdown triggers Chinese tech stocks sell-off in July / The accelerated growth of direct indexing / Robinhood: from a disappointing IPO to a steep surge / The unstoppable rise of cryptocurrency trading amongst young people / Banks launch neobanks: super apps and investing / New investors are getting younger and younger

Read more