AI Research Engineer Inference Optimization

Tether Operations Limited is looking for an expert AI Research Engineer specializing in Kernel and Inference Optimization for a full-time remote position connected to Bengaluru. The ideal candidate will spearhead innovations in model serving architectures and low-level GPU execution pipelines to enable highly efficient deployment scenarios.

• Architect and deploy production-grade model serving systems achieving maximum throughput, low token latency, and optimized memory footprints.
• Execute and benchmark rigorous inference experiments across simulated and production edge environments, monitoring hardware utilization and error rates.
• Curate comprehensive evaluation datasets and production simulation profiles tailored specifically for resource-constrained architectures.
• Profile deep learning computational pipelines to detect and eliminate bottlenecks arising from batch processing, memory allocations, or networking.
• Collaborate across technical divisions to smoothly embed optimized inference execution setups directly into on-device production codebases.

• Degree in Computer Science or related engineering discipline; a PhD focused on NLP or Machine Learning with reputable conference publications is highly desirable.
• Proven capacity to develop custom GPU compute shaders from scratch using Metal Shading Language (MSL).
• Demonstrated expertise in low-level kernel optimization and fine-tuning inference systems on edge or mobile hardware layers.
• Solid understanding of advanced serving frameworks and optimization strategies such as Pruning, Quantization, Flash attention, KV Cache, and Speculative Decoding.
• Familiarity with Distributed Inference Engineering principles involving Tensor, Pipeline, or Expert Parallelism across multi-node configurations.
• Strong background in the underlying mathematics of modern Diffusion Models and Vision Transformers.

• Combine with a globally distributed elite team leading pioneering breakthroughs in digital finance and decentralized tech.
• Fully remote work setup backed by a stable, agile, and industry-leading financial technology organization.
• Opportunity to influence cutting-edge AI developments and next-generation secure communication ecosystems.

• Candidates are urged to apply exclusively through official channels; all primary correspondence is handled via company domains ending in @tether.to or @tether.io.
• Tether never requests financial deposits, processing fees, or sensitive bank details at any stage of the recruitment process.