Forward-Deployed Team · Banking
Putting a private LLM inside a bank's perimeter in 8 weeks
An embedded Rexto pod pairs with a commercial bank's platform team to stand up an on-prem retrieval system credit analysts actually use.
The situation
A mid-size commercial bank's credit team was spending hours per loan file manually cross-referencing covenant language, financial statements and prior credit memos scattered across a document management system and email threads. Compliance had already ruled out any SaaS LLM tool that would send client financial data outside the bank's network.
The bank’s own platform team had Kubernetes and GPU capacity but no one who had taken an LLM system past a proof of concept, and no spare headcount to build one while running existing systems.
What we build
A two-person Rexto pod embeds inside the bank's platform team for the engagement, working from the bank's own ticketing system and sprint cadence rather than a separate project plan.
- Retrieval layer — A document ingestion pipeline that indexes loan files, covenant schedules and credit memos from the existing document management system, with access control mirroring the bank's own permission model.
- Model serving — An open-weight model served on the bank's existing GPU nodes inside its VPC, with no API calls leaving the perimeter and no data used to train anything outside the bank's environment.
- Analyst workflow — A query interface inside the tool credit analysts already use, returning answers with the source document and page cited alongside every claim.
Delivery timeline
What your team owns
By week 8, the bank's platform team owns the deployment: the model-serving infrastructure, the retrieval pipeline's monitoring, and the access-control mapping. Rexto hands over runbooks and stays on for a defined support window, not an open-ended dependency.
What to expect
- Credit analysts can query loan documentation in natural language and get an answer with its source citation, inside the existing case tool.
- No client financial data leaves the bank's network at any point in the pipeline.
- The bank's platform team can redeploy or extend the retrieval system without Rexto in the room.
- Access control and audit logging match the bank's existing model-governance requirements from day one.