Staff Software Engineer, Data Platform @Harvey

Overview

Harvey is seeking a Staff Software Engineer for its Data Platform team to build systems that enable various teams to utilize data confidently and independently. This role is pivotal in constructing a modern data platform that meets the rigorous needs of data handling for security-conscious institutions.

Key Responsibilities

• Own the architecture and technical direction of the data platform, treating data infrastructure as a software product.
• Build and operate the ingestion layer across streaming, batch, CDC, and third-party connectors.
• Ensure reliable data ingestion into Snowflake with a focus on freshness, completeness, and cost characteristics.
• Manage the orchestration platform including scheduling, retries, and dependency management.
• Develop transformation and compute frameworks for scalable data processing.
• Design stream processing infrastructure for real-time product features and operational alerting.
• Establish data quality and observability measures.
• Set standards for data governance, including PII classification and access control.

Requirements

• 10+ years of experience in production data infrastructure.
• Deep experience with cloud data warehouses, preferably Snowflake.
• Hands-on experience with CDC and streaming pipelines using technologies like Kafka or Spark Streaming.
• Experience with managed ingestion tools such as Fivetran or Airbyte.
• Strong fluency with workflow orchestration tools like Airflow.
• Proficient in Python and advanced SQL.
• Familiarity with data governance and cloud data services.
• Ability to navigate ambiguity and define project scopes.

Benefits

Compensation ranges from $231,000 to $340,000 USD, based on location.

Location

This role can be based in San Francisco, CA or New York, NY.

How to Apply

Interested candidates can apply through the company’s career page.