AI Engineer

Required skills: Python, API, PostgreSQL For one of our clients, we are looking for a Mid/Senior AI Engineer (m/f/n). You'd work on a live LLM system with real users — not a proof of concept. We're looking for a Senior AI Engineer who can take an LLM-based feature from idea to production and then keep it accurate, fast, observable and efficient. Tasks and responsibility • Build LLM-powered features end to end. Design and implement agentic flows, retrieval, and tool calling using LangGraph — then ship them as FastAPI services with streaming, persistence and proper tests. • Own answer quality. Build evaluation datasets, regression suites and LLM-as-judge checks so we know whether a prompt or model change made things better before it reaches users. • Get the right context to the model. Turn user questions into effective queries against our search platform, orchestrate multi-step research loops, and shape the context the model reasons over. When an answer is wrong, work out whether retrieval, the query or the prompt is at fault — and fix the right one. • Debug production. Instrument flows with tracing (Langfuse), investigate bad answers from real traces, and manage latency, token and cost budgets — including routing across model sizes and families behind an AI gateway. Requirements • Experience in building and operating backend services — APIs, async, testing. • Hands-on experience taking LLM features to production and keeping them running — not only prototypes. • Agent / orchestration frameworks. LangGraph ideally. • Practical RAG experience. • Experience debugging LLM systems in production — tracing, evaluation, cost and latency. • Experience running services in the cloud (we're on Azure). • Strong problem-solving skills, analytical thinking, and technical decision-making. • Fluent in English, proactive communicator, and a collaborative team player. • Open-minded, creative, and motivated to push boundaries in AI and automation. Tech stack • Python • FastAPI • LangGraph • Azure OpenAI, Google Gemini, Anthropic Claude • FAISS • PostgreSQL • Langfuse • Azure App Insights • Bicep • Docker / Podman Nice to have • Azure OpenAI, AI Search, App Service • Infrastructure-as-code (Bicep) • Mentoring or tech-lead experience What We Offer: Rate: 175 PLN/H net + VAT B2B contract via SHIMI Location: Remote Availability: ASAP Long-term engagement