Overview
Harvey is looking for a Senior Software Engineer to join their central data platform team, transforming how data is utilized across the organization. The role involves building systems for data ingestion and management that enable teams to work confidently and independently with data.
Key Responsibilities
- Own the data platform's architecture and technical direction, treating data infrastructure as a product.
- Build and operate the ingestion layer across streaming, batch, CDC, and third-party connectors, ensuring schema evolution.
- Land data into Snowflake with freshness and completeness, defining a clean handoff for Analytics Engineering.
- Manage the orchestration platform, including scheduling, retries, backfills, and dependency management.
- Build transformation and compute frameworks for scalable data processing and provide self-serve tooling for teams.
- Design and operate stream processing infrastructure for real-time use cases.
- Establish quality, observability, and lineage to ensure trust in the data.
- Develop patterns and tooling for PII and sensitive data management.
- Set technical standards through design reviews and documentation as the team grows.
Requirements
- 5+ years of experience in building and operating production data infrastructure.
- Deep experience with cloud data warehouses, preferably Snowflake.
- Hands-on experience with technologies for building CDC and streaming pipelines (e.g., Kafka, Debezium).
- Familiarity with managed ingestion tools (e.g., Fivetran, Airbyte).
- Strong fluency with workflow orchestration tools (e.g., Temporal, Airflow).
- Proficient in Python and advanced SQL.
- Experience with data quality, observability, and lineage tooling, including schema evolution.
- Working knowledge of data governance related to PII and compliance.
- Familiarity with cloud services (Azure, AWS, GCP) and infrastructure-as-code tools (e.g., Terraform).
Benefits
Compensation ranges from $193,400 to $290,000 USD, depending on location.
Location
This role can be based in San Francisco, CA, or New York, NY.
How to Apply
To apply, please visit the company’s careers page.
Deadline
No specific deadline mentioned.