Skip to main content
Back to cases

CONTENT DESIGN · A/B TESTING

Content experimentation in financial products

6 min readDownload the complete case study as a PDF.

Two experiments exploring how language and interface choices influence people's behavior and support business decisions.

Highest observed click rate · Portocred

38.71%

Highest observed click rate · Portocred

Abandonment in the selected variant · Itaú

12%

Abandonment in the selected variant · Itaú

Context

Experimenting to make better-informed decisions

In financial products, a content choice can influence anything from interest in an offer to understanding the terms of a service.

The two experiments brought together in this case started with different challenges: increasing interaction with a credit campaign and encouraging responsible use of a Pix dispute mechanism.

In both, experimentation made it possible to compare communication alternatives using behavioral data, considering product objectives and people's needs.

What We Did

EXPERIMENT 01 — PORTOCRED · 2022

How do different CTA approaches influence click rates?

Context and hypothesis

In an email marketing campaign developed by Parcelex in partnership with Portocred to promote personal loans, we sought to identify which messaging approaches generated the most interest.

I was responsible for the content strategy and email copy, including writing the four CTA variants used in the experiment. The email's visual design was developed by Product Design.

We tested four variations of the call-to-action button text, randomly distributed through HubSpot. The rest of the email remained unchanged, allowing us to compare the alternatives' performance.

The hypothesis was that different language choices, even within a single component, could influence people's willingness to click and learn about the offer.

Content strategy

The four alternatives explored distinct approaches:

A — Exclusivity: highlight the possibility of special terms with a low-commitment invitation. CTA: “Check special terms”.

B — Urgency: use a direct invitation associated with immediately applying for the product. CTA: “Apply for a loan now”.

C — Personal identification: bring the message closer to everyday language, expressing the need for credit in the first person. CTA: “I need a loan”.

D — Rationality: present a loan estimate as a step before deciding to take out a loan. CTA: “Get a personal loan estimate”.

Observed results

A

Exclusivity

Check special terms

Click rate

23.73%

B

Urgency

Apply for a loan now

Click rate

38.71%

Highest observed rate

C

Personal identification

I need a loan

Click rate

22.78%

D

Rationality

Get a personal loan estimate

Click rate

35.34%

Rates represent CTA clicks, not loan conversions. This comparison does not establish statistical significance.

Variation B, with a direct invitation to apply for a loan, recorded the highest observed click rate: 38.71%. It was followed by variation D, focused on getting an estimate, at 35.34%.

The exclusivity and personal identification approaches had lower rates in this experiment.

Learning

Calls to action that explicitly described a concrete action — applying or getting an estimate — recorded more interaction than those centered on generic benefits or personal identification.

The experiment provided evidence to guide future communication decisions, showing how small language changes can be associated with meaningful differences in behavior.

The percentages represent results observed in the campaign, without documented proof of statistical significance or higher loan conversion.

EXPERIMENT 02 — ITAÚ · 2026

How can we encourage responsible use of Pix disputes without creating barriers to access?

Context and challenge

With the introduction of the Special Return Mechanism (Mecanismo Especial de Devolução, or MED), established by Brazil's Central Bank, Pix disputes became part of a journey that was still unfamiliar to many people.

There was uncertainty about the situations covered by the mechanism. Transfers sent by mistake to the wrong account, for example, also prompted dispute attempts, although they were not covered by the MED.

This contributed to a substantial increase in requests and created operational challenges.

At the same time, there was a fundamental constraint: the journey could not prevent people from opening a dispute.

The challenge was to make the rules easier to understand and help people assess their requests more carefully, without creating undue obstacles for those who needed to use the feature.

Hypotheses and content strategy

I was responsible for designing the four interface variants and developing the content tested, exploring different ways to present the MED rules and request confirmation during the Pix dispute journey.

The experiment was conducted in partnership with Itaú's Experimentation team, which was responsible for methodological rigor and statistical validation.

The alternatives explored different ways to present information and request confirmation, including:

  • Presence or absence of a modal.
  • Single or double confirmation.
  • Confirmation on the first or second screen.
  • Inclusion of police report information.
  • Changes to the presentation of guidance and the conditions for using the mechanism.

We sought to understand how these decisions might influence continuation through the journey and contribute to more responsible use of disputes.

The objective was not to encourage more disputes or prevent requests, but to balance clarity, responsibility and access.

Variants A, B, C and D of the Pix dispute journey tested in the experiment (original interface in Portuguese). Enlarge image

Results

A — Control

Abandonment
4%
Valid disputes opened
40%
Reached summary screen
43%

B

Abandonment
6%
Valid disputes opened
42%
Reached summary screen
44%

C

Abandonment
9%
Valid disputes opened
45%
Reached summary screen
44%

D

Selected

Abandonment
12%
Valid disputes opened
43%
Reached summary screen
44%

The experiment involved thousands of clients, was overseen by Itaú's Experimentation team and underwent statistical validation.

During the 13 days analyzed, we compared the four variants using indicators of behavior and the appropriateness of requests.

Variant D was selected for implementation after recording the highest abandonment rate at the stage analyzed: 12%, compared with 4% in the control group.

Although variant C had the highest observed percentage of valid disputes opened (45%), the decision prioritized increased abandonment at that stage, in alignment with the experiment's operational objective.

Selecting variant D was part of a strategy to reduce the continuation of potentially inappropriate requests while preserving the ability to file a dispute.

Learning

The experiment showed that a metric traditionally interpreted as negative can take on a different meaning depending on the context.

In a dispute journey, abandonment was not necessarily a problem to eliminate. The challenge was to provide enough information for people to understand the rules and reconsider requests that did not match the MED's purpose.

At the same time, higher abandonment alone does not prove that only inappropriate requests stopped progressing. The assessment therefore needed to consider the operational objective, appropriateness indicators and regulatory constraints.

Selecting variant D reinforced the importance of evaluating content decisions within the full context of the experience, rather than through a single metric.

Results

The right metric depends on the behavior we want to understand

The two experiments had different objectives.

At Portocred, the test revealed which CTA approaches generated more clicks in a credit campaign. At Itaú, experimentation examined how different ways of communicating rules and requesting confirmation related to continuation through a regulated journey.

While the first explored ways to increase interaction, the second investigated how to encourage more informed decisions before proceeding.

The projects demonstrate that experimenting with content requires understanding the context, formulating hypotheses and interpreting metrics in light of the problem we are trying to solve.

More clicks do not always mean more conversions. Likewise, less abandonment does not always represent a better experience.

The value of experimentation lies in turning language and interface choices into evidence-based decisions, considering their effects on people and the business.

What did you think of this collection?

Your feedback helps me improve. Feel free to leave a comment, too.

Participation is optional. I use feedback to improve the portfolio’s content and experience. Comments will not be published. A random identifier in this browser lets you change your vote; please do not include personal or sensitive information.

Good ideas start with a conversation.

If you have an interesting challenge ahead or believe we could build something together, get in touch!