1mo ago

Technical Lead/Architect (Temporal & Apache Kafka required)

EngineeringSoftware Architect

6 views0 saves0 applied

Quick Summary

Key Responsibilities

Define the multi-year technical roadmap and reference architecture for our real-time streaming infrastructure, Lakehouse ingestion engines, and distributed orchestration layers.

Technical Tools

EngineeringSoftware Architect

About the Role

~1 min read

Authority in schema specification frameworks (Apache Avro, Protocol Buffers/gRPC, JSON Schema).
Hands-on leadership implementing schema registries (Confluent, AWS Glue) with automated CI/CD schema linting, breaking-change prevention, and backward/forward compatibility strategies.
Experience standardizing automated data contract verification tooling (e.g., Great Expectations, Pandera, Pydantic, dbt tests, contract-testing frameworks).

Distributed Computing & Core Engineering: Advanced engineering capabilities in Python, Go, or Java/Scala, emphasizing distributed design patterns, concurrency models, and resilient microservice design. Extensive scale experience with Apache Spark / PySpark internals and query plan optimization.

Modern Lakehouse & Data Modeling: Expert-level knowledge of dimensional data modeling, Data Vault, or semantic layer design, with practical experience scaling multi-terabyte/petabyte systems on Snowflake, Databricks, or BigQuery.

Cross-Functional Influence: Demonstrated track record of aligning distributed engineering teams around unified architectural patterns, authoring architectural decision records (ADRs), and influencing executive stakeholders.