Engineering Manager - AI Serving Infrastructure

Mountain View, CA, United States

LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun, where everyone can succeed.

Join us to transform the way the world works.

This role will be based in Mountain View, CA.

At LinkedIn, we trust each other to do our best work where it works best for us and our teams. This role offers a hybrid work option, meaning you can both work from home and commute to a LinkedIn office, depending on whats best for you and when it is important for your team to be together.

Creating economic opportunity for every member of the global workforce is a responsibility we all share. To truly transform the global economy, we must evolve the way we hire and enable our talent to serve people of all backgrounds and experiences. LinkedIn is committed to diversity in its workforce and is proud to be an equal opportunity employer.

LinkedIns AI Serving Infra team develops infrastructure that serves complex relevance models at a large scale, across LLM and Personalization models and provides a simple platform for AI engineers to build, innovate and experiment.

We are looking for a leader who can lead a team in Mountain View that focuses on building infrastructure for serving LLM models for Linkedin. As a Manager, you will be a key technical leader and a role model within the AI platform Serving organization. In this role, you will be responsible for developing strategy for Model Serving infra team, building roadmap and executing on the same. This is a highly visible role which will require partnering with many ai teams and infra teams to drive a roadmap that enables impact across product surfaces at LinkedIn.

A peek into unique challenges:

1. Scale - 10s of thousands of QPS, multiple terabytes of data, and running expensive scoring operations for millions of documents per second.

2. Relevance - Our relevance partners experiment with hundreds of new ML models per quarter using thousands of features. Support Models of multiple billion parameter in size, very large MLP computations and many data transformations in the request path.

3. GPU based inference and LLM - this space is disrupting industry landscape needing to be constantly at cutting edge.

4. Cross Functional - team is central to LinkedIn and requires partnering with many ai and infra teams across LinkedIn.

Responsibilities:

- You will lead through collaboration and influence rather than decree or direction.

- Develop strategy, build roadmap and execute for AI platform Serving Infra team.

- Coach, mentor, develop career and grow talent within the team.

- Identify problems and opportunities & deliver impact by driving innovation while building and shipping software at scale.

- Actively improve the level of craftsmanship at LinkedIn by developing best practices and defining best strategies.

- Work closely with and influence AI and/or technology partners regularly to help define roadmap.

- Resolve conflicts between teams within the organization to get alignment and build team culture.

- Manage teams to scale distributed applications, make architectural trade-offs applying synchronous and asynchronous design patterns, review code, and deliver with speediness and quality.

Basic Qualifications

BA/BS Degree in Computer Science or related technical discipline, or equivalent practical experience.

1+ years of experience in software engineering/technical management and people management.

5+ years of industry experience in software design, development, and large-scale software engineering

Experience programming in object-oriented and/or functional programming languages(like Java/CPP/Scala/etc.)

Hands on experience developing distributed systems, databases, large scale data systems and/or Backend API'

Preferred Qualifications

MS or PhD in Computer Science or related technical discipline

2+ years of hands-on software engineering/technical management and people management experience

7+ years industry experience in software design, development, and algorithm related solutions.

5+ years programming experience in languages such as Java, C/C++, C#, Python, Go, etc.

Suggested Skills:

- Technical Leadership

- People Management

- Stakeholder Management

LinkedIn is committed to fair and equitable compensation practices.

The pay range for this role is $156,000 to $255,000. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to skill set, depth of experience, certifications, and specific work location. This may be different in other locations due to differences in the cost of labor.

The total compensation package for this position may also include annual performance bonus, stock, benefits and/or other applicable incentive compensation plans. For more information, visit https://careers.linkedin.com/benefits

Equal Opportunity Statement

LinkedIn is committed to diversity in its workforce and is proud to be an equal opportunity employer. LinkedIn considers qualified applicants without regard to race, color, religion, creed, gender, national origin, age, disability, veteran status, marital status, pregnancy, sex, gender expression or identity, sexual orientation, citizenship, or any other legally protected class. LinkedIn is an Affirmative Action and Equal Opportunity Employer as described in our equal opportunity statement here: https://microsoft.sharepoint.com/:b:/t/LinkedInGCI/EeE8sk7CTIdFmEp9ONzFOTEBM62TPrWLMHs4J1C_QxVTbg?e=5hfhpE. Please reference https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf and https://www.dol.gov/ofccp/regs/compliance/posters/pdf/OFCCP_EEO_Supplement_Final_JRF_QA_508c.pdf for more information.

LinkedIn is committed to offering an inclusive and accessible experience for all job seekers, including individuals with disabilities. Our goal is to foster an inclusive and accessible workplace where everyone has the opportunity to be successful.

If you need a reasonable accommodation to search for a job opening, apply for a position, or participate in the interview process, connect with us at [email protected] and describe the specific accommodation requested for a disability-related limitation.

Reasonable accommodations are modifications or adjustments to the application or hiring process that would enable you to fully participate in that process. Examples of reasonable accommodations include but are not limited to:

-Documents in alternate formats or read aloud to you

-Having interviews in an accessible location

-Being accompanied by a service dog

-Having a sign language interpreter present for the interview

A request for an accommodation will be responded to within three business days. However, non-disability related requests, such as following up on an application, will not receive a response.

LinkedIn will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by LinkedIn, or (c) consistent with LinkedIn's legal duty to furnish information.

Pay Transparency Policy Statement

As a federal contractor, LinkedIn follows the Pay Transparency and non-discrimination provisions described at this link: https://lnkd.in/paytransparency.

Global Data Privacy Notice for Job Candidates

This document provides transparency around the way in which LinkedIn handles personal data of employees and job applicants: https://lnkd.in/GlobalDataPrivacyNotice