About the Role
- DeepL is a global AI product and research company focused on building secure, intelligent solutions to complex business problems. Over 200,000 business customers and millions of individuals across 228 global markets today trust DeepL's Language AI platform for human-like translation, improved writing and real-time voice translation. Building on a history of innovation, quality and security, DeepL continues to expand its offerings beyond the field of Language, including DeepL Agent - an autonomous AI assistant designed to transform the way businesses and knowledge workers get work done. Founded in 2017 by CEO Jarek Kutylowski, DeepL now has over 1,000 passionate employees and is supported by world-renowned investors including Benchmark, IVP, and Index Ventures.
- Our goal is to become the global leader in trusted, intelligent AI technology, building products that drive better communication, foster connections, and create a meaningful impact. To achieve this, we need talented people like you to join our journey. If you’re ready to shape the future of AI and grow your career in a fast-moving, purpose-driven environment, DeepL is your next destination.
- The HPC Engineering team plays a pivotal role within DeepL Research, striving to achieve the best possible computational performance with our AI technology. At DeepL, High Performance Computing means working across a software stack that we control end-to-end. This ranges from targeted optimizations for latest-generation GPUs over efficiently parallelized LLM training at scale to high-throughput, low-latency inference solutions serving millions of users.
- We build and improve the core components of our deep learning software and iterate on model design, closely collaborating with research scientists in both the foundational model group and the language AI teams. As a member of our team, you will work in a highly dynamic environment with ample opportunities to make a significant impact across our research and product portfolio.
Responsibilities
- Enable efficient parallelization on highly interconnected GPU clusters and design ideal strategies for large-scale model training
- Build capable solutions for multimodal LLM inference in high-throughput and low-latency scenarios
- Dive deep into our tech stack: Profile, debug, and optimize GPU kernels and low-level systems configuration
- Together with our researchers, ensure that state-of-the-art models are implemented correctly and efficiently
- Evaluate the latest technologies and develop innovative ideas that push the boundaries of what is computationally possible
Requirements
- You have strong analytic skills and a scientific approach to technical challenges, as demonstrated, for example, by a master’s or doctoral degree in computer science, mathematics, physics, or a related field
- You are an accomplished software engineer, enjoy solving tough problems, and thrive building solutions independently
- A track record of taking responsibility for projects from conception over implementation to production use
- Strong experience in Python, including its bindings to native code in C++ or Rust
- Deep familiarity with PyTorch and the AI software ecosystem. Key technologies include the PyTorch Distributed library, large-scale training frameworks like Megatron-LM or TorchTitan and highly-optimized inference libraries such as TensorRT-LLM, vLLM, or SGLang
- Good understanding of the high-performance programming model for GPUs and of the collective communication primitives used in parallel computing with MPI or NCCL
- High proficiency in English; knowledge of German or other languages is a plus
Qualifications
- Experience in optimizing and troubleshooting workloads on GPU compute clusters at scale
- A thorough understanding of today’s state-of-the-art Transformer architectures, which allows you to reason about their computational envelopes and bottlenecks
Benefits
- Diverse and internationally distributed team: joining our team means becoming part of a large, global community with people of more than 90 nationalities. We're more than just colleagues; we're a group of professionals with a shared mission to connect diverse cultures. Our global presence is growing–we've doubled in size nearly every year, with our employees based in the UK, Germany, the Netherlands, Poland, the US, and Japan, and we continue to expand our network.
- Open communication, regular feedback: as a language-focused company, we value the importance of clear, honest communication. We value smooth collaboration, direct and actionable feedback, and believe that leading with empathy and growth mindset makes us better together.
- Hybrid work, flexible hours: we offer a hybrid work schedule, with team members coming into the office twice a week. This allows you to engage directly with your team and experience the unique energy of our workspace, while still enjoying the flexibility and comfort of working from home. With flexible working hours and trust in your productivity, we are in sync with your team’s general locations and time zones to foster effective and seamless collaboration.
- Virtual Shares - An ownership mindset in every role. We believe everyone should share in our success, and that’s why every employee receives Virtual Shares, linking your contribution directly to DeepL’s growth and rewarding you with a stake in our future.
- Regular in-person team events: we bond over vibrant events that are as unique as our team, from local team and business unit gatherings, to new-joiner onboardings, to company-wide events that bring us all together–literally.
- Monthly full-day hacking sessions: every month, we have Hack Fridays, where you can spend your time diving into a project you're passionate about and get the opportunity to work with other teams–we value your initiatives, impact, and creativity.
- 30 days of annual leave: we value your peace of mind. With 30 days off (excluding public holidays) and access to mental health resources, we make sure you're as strong mentally as you are professionally.
- Competitive benefits: just as our team spans the globe, so does our benefits package. We've crafted it to reflect the diversity of our team and tailored it to align with your unique location, to ensure you feel supported every step of the way.