We are seeking an experienced AI Developer to support the productization of a local Large Language Model (LLM) solution for a client working in highly regulated environment. This is a focused engagement centered on moving a proof-of-concept implementation toward production readiness.
Key Responsibilities
- Deploy and optimize local language models to production environments
- Perform fine-tuning of models tailored to specific use cases
- Conduct model evaluation and auditing to meet client requirements
- Assess and implement fine-tuning methodologies
- Support the transition from POC to production-grade systems
Must-Have Qualifications
- Past experience deploying local LLMs to production
- Hands-on expertise in model fine-tuning and optimization
- Experience with model evaluation and auditing frameworks
- Strong understanding of LLM deployment methodologies
Nice-to-Have Qualifications
- Background in regulated or security-sensitive industries
- Familiarity with RAG (Retrieval-Augmented Generation) implementations
- Knowledge of on-premises or hybrid AI infrastructure
This assignment would start after summer and part-time allocation is possible. The chosen consultant needs to be security cleared.