Job Board

Senior / Staff ML Systems Engineer – Framework Integration

Posted Oct 29, 2026

Analyze in Job Fit

Roofline

Köln

EnglishSeniorNo German needed

Open the original posting

Saving starts the application package.

Job Fit

See how close your profile is to this ad.

Salary (estimate)

Broad estimate: about €68,000/year

About this job

Who we are

Roofline is building a Deployment Platform to run any model on disruptive hardware at the edge. As a Systems Engineer, you’ll own the path from a model in a framework to fast code on the target, across every layer in between. You’ll find where things break, fix them at the root, and set the technical direction that keeps our engineering teams aligned.

Why us?

The opportunity to grow. Be at the forefront of building and shaping an industry-defining venture. There are plenty of opportunities to learn and evolve.
The team succeeded. We are building the leading AI compiler team in Europe. Join our future-focused team to contribute to meaningful, disruptive innovations with us.
The flexibility you need. Whether you need to take extra time off, adjust your schedule, or have other ideas to maximize your productivity, we’ve got your back
The compensation that rewards. We are looking for world class talent and pay accordingly. We offer equity for every employee since we truly want you to participate in our success.
The culture you desire. We actively make space to build our culture. We organize dedicated regular events and retreats for the whole team.

Your mission

Own the path from a model in a ML framework down to running fast on a target hardware. Work at all levels of the software stack with a wide understanding of everything from quantization to compiler abstractions to final target code generation.

Bring up d reference models using Roofline's SDK, pinpoint which component an issue really lives in, and make sure it’s fixed at the root.

Set technical direction across multiple teams for ML, compiler, runtime, and architecture based on your first-hand data . Define contracts and interfaces between the layers and keep the teams aligned to them.

Turn your findings into products. Reflect on recurring blockers to craft solutions that benefit our customers and help improve our SDK. Think ahead to make sure that we always support the latest models and applications.

Interacting with open-source community in the ML space (e.g. PyTorch)

Raise the level of the engineers around you. Mentor junior engineers and help to maintain the best technical culture for the company.

8+ years of hands-on experience in AI and embedded systems.
Degree in Computer Science, Electrical Engineering, or related fields.
Deep practical expertise in C/C++ and Python
End-to-end experience with an accelerator toolchain for NPUs, DSPs, or GPUs spanning their compiler, runtime, kernel libraries and memory models. Strong communication and collaboration skills to align other engineers through clear ideas, abstractions, and design docs.
Demonstrated technical influence beyond your own deliverables. Have product changes you argued for and got shipped, engineers you've mentored, or practices a team adopted because you established them.
Ambition and curiosity to solve complex problems, a strong mindset to take ownership and drive our solutions forwards, and a collaborative attitude to foster our culture.

Experience working with hardware or architecture teams, and an understanding of how their approaches to problems and processes differ from software teams’.
Experience working with PyTorch, ONNX, Tensorflow
Experience shipping an accelerated model into production under real constraints for applications such as automotive, medical, industrial or consumer where memory budgets, certification and time budgets apply.

We show an excerpt and a link, and the full text when the source allows it. Brands and logos shown belong to their owners.

Job facts

Employer: Roofline
Role: Senior / Staff ML Systems Engineer – Framework Integration
City: Köln
Work mode: not stated
Language: English
Seniority: Senior
Posted: Oct 29, 2026
Source: XING

Similar jobs

Senior ML Engineer - Speech (m/f/d)
voizeKölnRemote
Kununu 4.1 (85)
EnglishGrowing fastSenior
Broad estimate: about €68,000/year
Trusted Shops SE (DE)KölnHybrid
EnglishSenior
Broad estimate: €44,000–€58,000/year
Kapten & Son GmbHKöln
Glassdoor 3.6 (14)Kununu 4.3 (153)
EnglishSenior
Estimate: about €59,000/year

Source: Statistisches Bundesamt (Destatis), table; dl-de/by-2-0; StarIn's calculation

Senior / Staff ML Systems Engineer – Framework Integration

Job Fit

About this job

Why us?

Your profile

Nice to haves:

Job facts

Similar jobs

Senior ML Engineer - Speech (m/f/d)