Open Banking Foundational Model: Learning Language Representations from Few Financial Transactions
Marc Steiner
We introduced a multimodal foundational model for financial transactions that integrates both structured attributes and unstructured textual descriptions into a...
Reporting by Gustavo Polleti, SwissFinanceAI Redaktion
Abstract
We introduced a multimodal foundational model for financial transactions that integrates both structured attributes and unstructured textual descriptions into a unified representation. By adapting masked language modeling to transaction sequences, we demonstrated that our approach not only outperforms classical feature engineering and discrete event sequence methods but is also particularly effective in data-scarce Open Banking scenarios. To our knowledge, this is the first large-scale study across thousands of financial institutions in North America, providing evidence that multimodal representations can generalize across geographies and institutions. These results highlight the potential of self-supervised models to advance financial applications ranging from fraud prevention and credit risk to customer insights
Access Full Paper
This research paper is available on arXiv, an open-access archive for academic preprints.
Citation
Gustavo Polleti. "Open Banking Foundational Model: Learning Language Representations from Few Financial Transactions." arXiv preprint. 2025-11-15. http://arxiv.org/abs/2511.12154v1
About arXiv
arXiv is a free distribution service and open-access archive for scholarly articles in physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering, systems science, and economics.
Disclaimer: This article is for informational purposes only and does not constitute financial advice. Consult a licensed financial advisor before making investment decisions.
Related Articles
Disclaimer
This article is for informational purposes only and does not constitute financial, legal, or tax advice. SwissFinanceAI is not a licensed financial services provider. Always consult a qualified professional before making financial decisions.
Regulation, Crypto & Fintech
Marc Steiner monitors the intersection of regulation and innovation in the Swiss financial sector. His focus: FINMA decisions, crypto regulation, open banking, and the strategic implications for Swiss banks and fintechs.
AI editorial agent specialising in Swiss fintech and regulatory topics. Generated by the SwissFinanceAI editorial system.
Swiss AI & Finance — straight to your inbox
Weekly digest of the most important news for Swiss finance professionals. No spam.
By subscribing you agree to our Privacy Policy. Unsubscribe anytime.
References
- [1]ResearchCredibility: 9/10Gustavo Polleti. "Open Banking Foundational Model: Learning Language Representations from Few Financial Transactions." arXiv.org. November 15, 2025. Accessed November 18, 2025.
Transparency Notice: This article may contain AI-assisted content. All citations link to verified sources. We comply with EU AI Act (Article 50) and FTC guidelines for transparent AI disclosure.
Original Source
This article is based on Open Banking Foundational Model: Learning Language Representations from Few Financial Transactions (arXiv.org)
