Inference / GPU engineer jobs in New York: who's hiring
Right now 15 AI companies have 52 open inference / GPU engineer in New York roles, 5 of them posted this week. The biggest hirers are Anthropic, Baseten, NVIDIA. Posted salaries put the median at $258K (p25 $236K, p75 $396K) across 45 listings that publish pay. 63% have been open 60+ days.
Who is hiring this week
Signals
- COCohereHiring surge · today
Cohere is on a hiring surge: 11 roles opened this week (vs 5 the week before)
AI labSee the 11 roles → - LALuma AINew function · 8d ago
Luma AI just started hiring for inference and GPU performance: 3 new roles
AI labSee the 3 roles →
Salary benchmark
| Segment | p25 | Median | p75 |
|---|---|---|---|
| All inference / GPU engineer in New York roles | $236K | $258K | $396K |
| Anthropic | $445K | $565K | $600K |
| Baseten | $248K | $248K | $270K |
| NVIDIA | $197K | $236K | $236K |
| Cohere | $210K | $258K | $260K |
USD, annual base. Midpoint of each posted range; p25/p75 = 25th/75th percentile.
The roles behind the numbers
- CO
- AN
- CR
- WA
- NV
- LA
- NV
- NV
- BA
- BA
- BA
- NV
- TM
- AN
- CO
Showing 15 of 19 recent roles. See all
Always hiring · 33 evergreen roles
Open 60+ days. Often standing roles companies keep open year-round.
- NV
- NV
- NV
- NV
- BA
- NV
- WA
- CR
- MO
- AN
Showing 10 of 33. See all
FAQ
How many inference / GPU engineer in New York roles are open right now?
52 open roles at 15 companies as of Oct 16, 2026, with 5 posted in the last 7 days.
What do inference / GPU engineer in New York roles pay?
The median posted salary midpoint is $258K, with the middle half between $236K and $396K (USD, annual base, 45 postings that list pay).
Which companies are hiring the most inference / GPU engineer in New York roles?
Anthropic, Baseten, NVIDIA have the most open roles; the table above shows who added the most this week.
Are inference / GPU engineer in New York roles remote?
54% of open inference / GPU engineer in New York roles mention remote work. The main hubs are New York, San Francisco, Seattle.
How is this data collected?
Every day Hiring Heat reads the public job boards (Greenhouse, Lever, Ashby) of 220 AI labs, infra, app, chip and robotics companies. Salaries are only shown when the company publishes them.