Software Engineer - Backend (Distributed Systems)

Company: Snorkel AI
Location: Redwood City
Posted on: May 26, 2023

Job Description:

At Snorkel AI, we're redefining how people and organizations build AI applications. Snorkel started as a research project in the Stanford AI Lab in 2016, creating a higher-level interface to machine learning through programmatically labeled and managed training data. From deploying in some of the world's largest and most sophisticated tech organizations, to empowering scientists, doctors, and journalists - we've seen firsthand how this approach democratizes and accelerates AI. Now, we're building Snorkel Flow to bring our technology to everyone!
Building Snorkel Flow requires outstanding engineers and technologies across the stack, including scalable data pipelines, elegant and intuitive interfaces (both visual and programmatic), state-of-the-art ML modeling techniques, and best practices for seamless deployment. Modern AI approaches require large labeled training datasets to learn from. While traditional approaches typically rely on armies of human annotators to label by hand, Snorkel Flow empowers users to programmatically label and build training data sets to drive a radically faster, more flexible, and higher quality end-to-end AI development process. Snorkel Flow is an end-to-end development platform, complete with a GUI and powerful programmatic interfaces for driving the development process for full AI application workflows: from preprocessing, to programmatic training data creation, to ML model training, to analysis, and deployment. It's the data-first platform for enterprise AI.
Excited to help us redefine how AI applications are built? Apply to be the newest Snorkeler!
Snorkel AI is looking for a distributed systems architect and backend engineer. The company's flagship product is a cloud-based enterprise software used by data scientists and ML engineers. Snorkel products are used by large enterprises to solve their most impactful problems in today's data-centric AI world.
You will be part of the backend team that is building a scalable and reliable distributed system that empowers users to solve their most pressing needs in a data-centric AI world. The team has a variety of technical backgrounds, from machine learning PhDs to full-stack engineers who are building large-scale production systems. You will become one of these pragmatic, high-output, product-focused engineers.
Main Responsibilities

• Prototype, optimize, and maintain scalable back-end services that will power new ML development workflows
• Design extensible and testable interfaces between internal services including the underlying storage and data models
• Own the architecture, design, development, and operations of large-scale systems designed for AI/ML tasks including data management systems, data engineering workflow systems, distributed compute systems and connect to the front-end components
• Work with customers to understand their product use case, desired capabilities, and scale requirements and translate that to engineering specifications and code
• Be an engaged team player in a customer-focused cross-functional environment where you will feel excited to take on whatever is most impactful for the company and product Required Qualifications
  • Bachelor's degree in Computer Science or related field
  • 4+ years experience in delivering distributed systems and services in a production setting for cloud-native applications
  • Ability to design and build efficient scalable data storage and retrieval systems for AI/ML tasks
  • Strong communication and coding skills with emphasis on designing for scale and robustness
  • Proactive and positive attitude to lead, learn, troubleshoot and take ownership of shipping multi-quarter large feature development as well as immediate debugging and unblocking customers
  • Work a hybrid schedule with one or two days per week in our Redwood City HQ and work remotely with "No Meeting" Tuesdays and Thursdays Preferred Qualifications
    • 8+ years of professional software engineering experience
    • Experience with architecting and developing production web-scale systems (monitoring, telemetry, performance, reliability, triage and debug)
    • Strong development and debugging skills in Python
    • Experience developing enterprise software products for machine learning and/or data science applications
    • Experience with distributed compute frameworks and/or deep learning frameworks
    • Experience building and maintaining large scale, distributed and high performance data pipelines
      The salary range for our Tier 1 locations of San Francisco, Seattle, Los Angeles & New York is $191,000.00 - $225,000.00.
      Be Your Best At Snorkel
      Snorkel AI is on a mission to make machine learning practical for everyone, and it starts with building a team that welcomes, represents and gives opportunity to all. We work at the frontier of AI and software engineering, and believe that underrepresented communities need to play a part in shaping the future of these fields. At Snorkel AI, we actively work to create an environment that values end-to-end ownership, diverse forms of impact, and opportunities for personal growth.
      Snorkelers are supported by an amazing team and an amazing set of benefits. We offer comprehensive medical, dental, and vision plans for Snorkelers and their families, plus a yearly wellness stipend. Our 401k program lets Snorkelers plan for their future and our parental leave program lets new parents take up to 20 weeks of paid time off. Learn more about these benefits and more - like our workstation setup allowance - on our Careers page.
      Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.
      We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Keywords: Snorkel AI, Redwood City , Software Engineer - Backend (Distributed Systems), IT / Software / Systems , Redwood City, California