Machine Learning / LLM Engineer
About Oh:
Oh is pioneering hyper-realistic, uncensored AI-driven content, building a full-spectrum ecosystem of multimodal AI products. Our platform powers lifelike digital twins and AI characters across text, voice, and images.
With a mission to become the OpenAI of the spicy content industry, we iterate fast, push boundaries, and deploy cutting-edge, real-time conversational AI experiences at scale.
The Role:
Our platform integrates a variety of multimodal GenAI models. You will own the technical roadmap and full lifecycle of our large language models, most notably our flagship Llama 3.1 70B and other open-source models.
Your responsibilities will include:
* Fine-tuning with custom and synthetic datasets
* Deploying on GPU platforms to ensure low-latency, cost-efficient, and safe real-time interactions
* Driving multimodal expansion—integrating text, voice, and image capabilities
* Embedding robust safety and compliance measures
* Keeping on top of recent development in the field and auditing new models for a wide range of purposes (e.g. conversational AI, intent classification, AI agents life planner)
Key Responsibilities:
LLM Fine-Tuning & Optimization
* Fine-tune and optimize models (Llama 3.1 70B, GPT-based, Mistral, etc.) using domain-specific and synthetic datasets
* Enhance accuracy, reduce hallucinations, and improve alignment with user intent
Deployment & Infrastructure Management
* Deploy scalable, memory-efficient models on GPU-based platforms (Runpod, AWS, Kubernetes clusters)
* Optimize GPU inference with Torch, CUDA, TensorRT, vLLM, and DeepSpeed
Multimodal & Cross-Model Integration
* Integrate additional open-source models to enable image prompt generation, voice synthesis, and dynamic character personalization
* Expand multimodal AI capabilities (e.g. improve LLava-based vision models)
Data Pipeline & Evaluation
* Design robust data pipelines for curation, cleaning, synthetic data generation, and versioning (DVC)
* Implement evaluation metrics and continuous monitoring to ensure model quality
Real-Time Performance & System Optimization
* Ensure low-latency, real-time performance using mixed-precision training, quantization, pruning, and distillation techniques
Safety, Moderation & Compliance
* Embed robust safety, content moderation, and ethical AI frameworks to comply with GDPR and industry standards
* Develop custom token filters and controlled response mechanisms
Monitoring, Diagnostics & Cost Management
* Set up and maintain monitoring tools (Prometheus, Grafana, TensorBoard, Weights & Biases, Sentry) for performance tracking and cost optimization
Technical Skills & Requirements:
Experience:
* 5+ years in machine learning engineering, NLP, or AI research with deep expertise in Transformer-based LLMs
Programming & Frameworks:
* Strong proficiency in Python and Bash scripting
* Hands-on experience with PyTorch, HuggingFace libraries (Transformers, Diffusers, PEFT, Accelerate), and the common ML toolkit (e.g. SKLearn, Pandas, Numpy)
* Familiarity with JAX/TensorFlow is a plus
LLM Specialization:
* Proven expertise in fine-tuning LLMs using techniques like LoRA, QLoRA, PEFT, RLHF, and prompt engineering
GPU & Inference Optimization:
* Experience with common inference speed optimisation and model quantization techniques.
Deployment & Orchestration:
* Skilled in containerization (Docker) and orchestration (Kubernetes) for scalable ML deployments
* Experience with major MLOps frameworks (MLFlow / KubeFlow) preferred
Data Handling:
* Proficient in data wrangling and preprocessing (Pandas, Dask)
* Experience managing large-scale datasets using AWS (S3, RedShift, EC2)
* Knowledge of data QC and monitoring tools (DVC, Great Expectations)
Additional Knowledge:
* Understanding of retrieval-augmented generation (RAG) techniques
* Familiarity with vector databases (FAISS, Pinecone, Weaviate)
Preferred Qualifications:
✅ Experience integrating and optimizing multimodal models (text, voice, image, video)
✅ Background in AI-driven gaming, digital experiences, or adult content
✅ Familiarity with CI/CD pipelines (GitLab CI, Jenkins) for ML workflows
✅ Interest or experience in crypto, Web3, or NFT-based AI models
✅ Prior exposure to AI governance, safety, or ethical AI frameworks
What We Offer:
Competitive Compensation:
* Attractive salary, benefits, and equity participation
Remote & Flexible:
* Remote-first work environment with flexible hours
Growth & Leadership:
* Rapid career advancement and the opportunity to shape our AI strategy
Innovative Culture:
* Join a fast-paced team at the forefront of advanced, uncensored AI applications
If you’re passionate about pushing the boundaries of AI-driven experiences and have a track record in developing, deploying, and optimizing cutting-edge LLMs, we want to hear from you!