MLOps Engineer, LLM Performance
Location
Remote
Job Type
Full-Time
Experience Level
Mid-level, Manager-level (3-5 Years)
Salary Range
90-$120 per hour (2 cr per Annum)
Job Description
Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking MLOps and ML systems engineers with hands-on experience in large language model infrastructure across any of four areas: accelerator kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. Experience with JAX, XLA or TPUs is especially valuable. This role involves AI model training and evaluation work, including writing and assessing ML systems tasks and solutions to generate high-quality training data for frontier AI systems. This is a fully remote role open to candidates worldwide. Depending on where you are based, your engagement will be arranged through Cincinnatus LLC or one of its trusted employer-of-record partners in your country, with the opportunity to be placed at a leading AI lab as part of their extended workforce. This is a 40-hour full-time engagement, with no conflicts/no other engagements. 2. Key Responsibilities Design challenging tasks across kernels, profiling, debugging and inference serving, including adversarial problems that expose where frontier models fail on accelerator code (for example Pallas kernels on TPU), and write accurate, well-structured solutions to them. Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, compilers and training infrastructure topics. Evaluate ML systems tasks and solutions, and provide clear written technical feedback that stands up to expert review. Develop guidelines and detailed rubrics covering kernel optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs. Collaborate with other subject matter experts to keep training data consistent and accurate. 3. Core Qualifications 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering. This is a hands-on systems role rather than an applied modelling or data science one. Practical experience in at least one of the following, with more than one a strong plus: writing or optimizing custom kernels (Pallas, Triton, CUDA, CUTLASS); performance profiling and trace analysis (JAX/XLA profiler, Kineto, torch.profiler, Nsight); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, JetStream, KV cache, paged attention, continuous batching). Working production experience with JAX and/or PyTorch. Framework-level depth is a strong plus: custom operators, sharding and distributed training (pjit/shard_map, FSDP, Megatron, MaxText), or compiler and graph-level work (XLA/StableHLO, torch.compile, MLIR). Experience with modern accelerators such as TPU (v4 to v6e), H100, B200, Trainium or MI300, and the ability to reason about throughput, latency and memory trade-offs. Demonstrable career progression. Ability to engage reliably for at least 40 hours/week during weekdays. Strong written communication skills and the ability to explain complex technical decisions clearly.
About Quickhyre AI
QuickHyre AI is an online job portal and HRMS software platform for hiring and workforce management, trusted by over 10 million active users. It connects freshers and experienced professionals across all career levels with verified job opportunities, while enabling companies to hire, onboard, and manage employees through a single system. Candidates use QuickHyre AI to search and apply for jobs across entry-level, mid-level, and senior roles, including internships and contract positions across tech and non-tech domains. Employers use QuickHyre AI as a hiring platform, applicant tracking system (ATS), and HRMS to post jobs, screen candidates, manage applications, onboard hires, and maintain employee records. Built for startups, growing companies, and enterprises, QuickHyre AI reduces irrelevant applications, improves hiring efficiency, and simplifies HR operations. By combining job discovery, online recruitment, and HR management software, QuickHyre AI supports end-to-end talent acquisition and workforce administration at scale.
Connections
Sai Charan
Senior Developer
Kalpana Sharma
Team Lead
Rahul Patel
Full Stack Developer
Priya Singh
Frontend Developer
Connect with professionals in your network
Skill Match Analysis
??% skills matched (?? of 49 skills)
💡 This is keyword matching for reference only. Your actual match score uses AI semantic analysis.
Login to see your score