Skip to content
True Talent Solutions Partners

Member of Technical Staff

San FranciscoOnsite · United States
Staff · FullTime · Client Roles
POSTED 19 NOVVERIFIED 3H AGO
Apply Ask
Role
3 days opentrue age
Past the 2d median close
Reposted
×3
Same title, closed before
×13
Posted 19 Nov · n=1257
Payats field
$200k–300kposted
▲ +3% vs market median $243k
$200k$300k
Market p25–p75
$206k–$284k
True Talent Solutions Partners p25–p75
$250k–$270kn=43
SF Bay Area · n=1222 · 365d to 19 Nov
CompanyTrue Talent Solutions Partners →
187open roles
Opened · 30d
+965
Closed · 30d
−966
Signal
● Steady−1 net
17d of snapshots · 30d window
Market
9,237open · Staff Software engineering
Opened · 7d
+7608% of open
All software engineering
75,020open
All tracked boards · live 22 Nov · n=9,237
LLMs

About the Role

Join a small AI infrastructure team working to improve the performance and energy efficiency of large language model inference. You will build and operate systems that serve open-source models across a range of hardware, with ownership spanning low-level optimization through production deployment.

What You'll Do

Deliver support for new open-source models, tuning them for latency and throughput.

Optimize inference serving, including batching, KV cache management, speculative decoding, and quantization.

Write and tune GPU kernels using CUDA, HIP, and Triton across heterogeneous hardware.

Design, deploy, and operate clusters spanning multiple hardware vendors.

Run production inference systems, improving reliability, observability, and cost per token.

Work with customers to understand needs and solve infrastructure challenges.

What We're Looking For

Typically 1 to 6 years of experience in backend, infrastructure, or systems engineering, including low-level work beyond application development.

Strong understanding of computer architecture, memory hierarchy, and operating system internals.

Experience with CUDA, Triton, or GPU programming; familiarity with HIP and heterogeneous accelerators is useful.

Knowledge of ML inference optimization, such as quantization, batching, KV caching, or speculative decoding.

Experience deploying or operating infrastructure at scale, such as clusters or large GPU fleets.

Strong computer science fundamentals and evidence of ownership, rapid learning, or accomplishment on challenging technical work.

Comfort using AI coding tools to improve engineering workflows and communicating with customers as part of the role.

Early-career candidates and new graduates with relevant internships are welcome.

Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, five days per week.

Source · True Talent Solutions PartnersFirst seen 19 NovOriginal ↗