Lead AI Inference Engineer

Posted 8 hours 33 minutes ago by Tether Operations Limited

£60,000 - £90,000 Annual
Permanent
Full Time
Other
London, United Kingdom
Job Description
Join Tether and Shape the Future of Digital Finance

At Tether, we're not just building products, we're pioneering a global financial revolution. Our cutting edge solutions empower businesses-from exchanges and wallets to payment processors and ATMs-to seamlessly integrate reserve backed tokens across blockchains. By harnessing the power of blockchain technology, Tether enables you to store, send, and receive digital tokens instantly, securely, and globally, all at a fraction of the cost. Transparency is the bedrock of everything we do, ensuring trust in every transaction.

Innovate with Tether

Tether Finance: Our innovative product suite features the world's most trusted stablecoin, USDT, relied upon by hundreds of millions worldwide, alongside pioneering digital asset tokenization services.

Tether Power: Driving sustainable growth, our energy solutions optimize excess power for Bitcoin mining using eco friendly practices in state of the art, geo diverse facilities.

Tether Data: Fueling breakthroughs in AI and peer to peer technology, we reduce infrastructure costs and enhance global communications with cutting edge مسؤ솔 like KEET, our flagship app that redefines secure and private data sharing.

Tether Education: Democratizing access to high quality digital learning, we empower individuals to thrive in the digital and gig economies, driving global growth and opportunity.

Tether Evolution: At the intersection of technology and human potential, we are pushing the boundaries of what is possible, crafting a future where innovation and human capabilities merge into powerful, unprecedented ways.

Why Join Us?

Our ट ल is a global talent powerhouse, working remotely from every corner of the world. If you're passionate about making a mark in the fintech space, this is your opportunity to collaborate with some of the brightest minds, pushing boundaries and setting new standards. We've grown fast, stayed lean, and secured our place as a leader in the industry.

If you have excellent English communication skills and are ready to contribute to the most innovative platform on the planet, Tether is the place for you.

Are you ready to be part of the future?

About the job

You'll lead a cross functional pod that spans the full stack, from C++ inference engines to JavaScript applications. Your responsibility is to ensure that local AI capabilities ship reliably and perform well across devices. You'll balance hands on technical work with team coordination, guiding foundation and middleware engineers toward shared goals.

This role is ideal for someone who understands both the low level challenges of edge AI and the product facing needs of app developers, and wants to drive the delivery of cohesive, production ready local AI systems.

Responsibilities
  • Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml, onnx

  • Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments

  • Integrate AI features into existing products, enriching them with the latest advancements in machine learning

  • Manage a cross functional team (pod) of middleware (JS), foundation (C++), QA and documentation engineers to produce high quality deliverables

  • Regularly assess, both qualitatively and quantitatively, our position in the market relative to similar products or platforms

  • Leverage the expertise of technical architects to ensure robust architectural choices and code quality

  • Ensure stable releases by following precise internal release processes

Qualifications
  • Excellent programming skills in C++

  • Strong experience with llama.cpp and ggml inference engines, facilitating the deployment of models to specific GPU architectures

  • Good understanding of deep learning concepts and model architectures

  • Experience with transformers and LLMs

  • Demonstrated ability to 行 rapidly assimilate new technologies and techniques

  • Has the ability to manage a small, specialized cross functional team (pod) of 3 5 people

  • Has a genuine passion for building good products that improve people's lives

  • A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI khut R&D

Bonus points if: Lu
  • You have extensive experience with JavaScript/TypeScript

  • You have experience with AWS, containerization platforms, orchestration, and automated testing suites (Maestro, Appium)

  • You understand the difficulties, nuances and importance of p2p technology

  • You have worked with MLC, TVM or similar frameworks

  • You have experience with Vulkan, CUDA

  • You have productionized models

Important information for candidates

Recruitment scams have become increasingly common. To protect yourself, please keep the following in mind when applying for roles:

  • Apply only through our official channels. We do not use third party platforms or agencies for recruitment unless clearly stated. All open roles are listed on our official careers page:

  • Verify the recruiter's identity. All our recruiters have verified LinkedIn profiles. If you're unsure, you can confirm their identity by checking their profile or contacting us through our website.

  • Be cautious of unusual communication methods. We do not conduct interviews over WhatsApp, Telegram, or SMS. All communication is done through official company emails and platforms.

  • Double check email addresses. All communication from us will come from emails ending

  • We will never request payment or financial details. If someone asks for personal financial information or payment at any point during the hiring process, it is a scam. Please report it immediately.

When in doubt, feel free to reach out through our official website.