Head of AI Engineering (f/m/x)
neoshare
- Location
- Frankfurt am Main
- Type
- full time
- Posted
- Aug 29, 2026
Your mission Own and evolve our AI engineering function — transforming a 15–20 person ML team from research-heavy to a high-throughput, production-grade organization. You’ll partner with the CTO on strategy, build the platform that unifies LLM access, RAG, and backend services, and ship reliable, scalable AI features that change how banks work. Key responsibilities Team leadership and org build Hire, mentor, and develop a high-performing team; set the technical bar, operating rhythms, and code/research review practices Organize sub-teams (e.g., Core Modeling, AI Platform/Infra, Integrations) with clear ownership, SLOs, and on-call Manage roadmap, capacity planning, and delivery across parallel initiatives Architecture and platform Own the LLM gateway: unified APIs and proxy layers for multi-provider routing (OpenAI, Gemini, Bedrock), with rate limits, fallbacks, and cost tracking Build high-performance RAG pipelines (ingestion, embeddings, vector stores, caching) with robust observability and safety guardrails Partner with Java/ NestJS teams to define clean async contracts, schemas, and eventing patterns; drive low-latency, scalable inference Model lifecycle and operations Lead end-to-end model and prompt lifecycle: data curation, training/fine-tuning, evaluation, deployment, rollback Establish LLMOps / MLOps : model/prompt registries, CI/CD, canary/A/B tests, offline/online evals, drift and cost monitoring Optimize inference throughput and cost (autoscaling, batching, quantization/distillation, caching) Strategy and collaboration Translate company goals into an AI/ML…
Looking for more like this? Browse all AgentOps Engineer jobs.