Software Engineer – Generative AI / LLM (Python | Azure | RAG)

Location: Belgium (Onsite)

Employment Type: Contract / Freelance (Very Long Term )

About the Role

We are looking for an experienced Software Engineer with a strong background in backend or full-stack development and hands-on experience building applications powered by Large Language Models (LLMs) and Generative AI technologies.

You will be responsible for designing, developing, and maintaining AI-enabled software solutions while working closely with architects, product owners, and business stakeholders. The ideal candidate combines solid software engineering practices with practical experience implementing Retrieval-Augmented Generation (RAG), vector search, and modern AI application architectures.

This role is idóneo for engineers who understand both traditional software development and emerging AI technologies and know when to apply each appropriately.

Key Responsibilities

- Design, develop, and maintain scalable backend services and AI-powered applications.
- Integrate Large Language Models (LLMs) and Generative AI services into enterprise software solutions.
- Build Retrieval-Augmented Generation (RAG) pipelines using embeddings, vector databases, and semantic search technologies.
- Develop and maintain APIs and microservices supporting AI applications.
- Design maintainable, secure, and testable software following software engineering best practices.
- Implement automated testing, logging, monitoring, CI/CD pipelines, and deployment processes.
- Evaluate AI applications using test datasets, quality metrics, regression testing, and user feedback.
- Improve retrieval quality and optimize AI application performance.
- Work closely with business and technical teams to translate requirements into robust technical solutions.
- Apply secure development practices when handling sensitive or confidential enterprise data.
- Assess technical trade-offs and determine when AI-based solutions are appropriate versus deterministic software approaches.




- Contribute to architecture discussions and continuously improve development standards and engineering practices.

Required Skills & Experience

- Fluent communication skills in English and French or Dutch.
- Minimum 5 years of experience as a Software Engineer, preferably in backend or full-stack development.
- Minimum 1–2 years of hands-on experience integrating Large Language Models (LLMs) or Generative AI services into software applications.
- Strong programming skills in Python.
- Practical experience with:
- Retrieval-Augmented Generation (RAG)
- Embeddings
- Vector Search
- Retrieval quality optimization
- Experience with:
- Model Context Protocol (MCP)
- Agent-to-Agent (A2A)
- Tool Calling
- Multi-Agent architectures/workflows
- Experience designing maintainable software including:
- Automated testing
- Logging
- CI/CD
- Deployment pipelines
- Knowledge of AI application evaluation techniques including:
- Test datasets
- Quality metrics
- Regression testing
- User feedback analysis
- Good understanding of cloud-native application development.
- Security-first mindset for enterprise software development.
- Strong analytical and problem-solving skills.
- Ability to communicate technical decisions and trade-offs clearly to technical and non-technical stakeholders.
- Ability to determine when AI, RAG, or agent-based solutions are appropriate and when simpler deterministic approaches provide greater value.

Nice to Have

Experience with one or more of the following:

- LangChain
- LangGraph
- Semantic Kernel
- AI observability or evaluation platforms
- Azure Cloud
- Microsoft AI ecosystem
- Semantic Kernel
- Microsoft Agent Framework
- Microsoft Foundry
- Microsoft 365 Agents SDK
- .NET / C#
- Vector databases
- Enterprise search platforms
- Enterprise-scale or security-sensitive environments
- Regulated industries

Technical Stack

- Python
- LLMs / Generative AI
- Retrieval-Augmented Generation (RAG)
- Embeddings
- Vector Search
- MCP
- A2A
- Multi-Agent Systems
- LangChain
- LangGraph
- Semantic Kernel
- Azure
- .NET / C#
- CI/CD
- Cloud-Native Architecture

📌 Cyber security architect (España)
🏢 ThoughtLabs Belgium
📍 España