Senior Software Engineer, Data | ClickHouse | Remote (US)

Senior Software Engineer, Data | ClickHouse | Remote (US)

Remote US
Application ends: December 12, 2024
Apply Now

Job Description

The Cloud AutoScaling team is dedicated to implementing robust vertical and horizontal auto-scaling capabilities within the ClickHouse cloud environment. We seek exceptional software engineers to develop and maintain the auto-scaling infrastructure to transform ClickHouse into a fully functional serverless database solution. Collaborating closely with the core database team, we are actively working on evolving ClickHouse into a cloud-native database system. Additionally, we engage with other cloud teams to drive continuous improvements in cloud infrastructure for enhanced performance and scalability.

What will you do?

  • Build a cutting-edge Cloud Native platform on top of the public cloud.
  • Improve the metrics pipeline and build algorithms to generate better autoscaling statistics and recommendations.
  • Work on the autoscale and Kubernetes operator to support seamless Vertical and Horizontal Auto-scaling.
  • Work closely with our ClickHouse core development team and other data plane teams, partnering with them to support auto-scaling use cases as well as other internal infrastructure improvements.
  • Architecting and building a robust, scalable, and highly available distributed infrastructure

About you:

  • You have 5+ years of relevant software development industry experience building and operating scalable, fault-tolerant, distributed systems.
  • Hands-on experience building and estimating statistical models and time-series forecasting with large-scale, real-world datasets.
  • Software development experience in Go, C/C++, Java, or similar.
  • Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent.
  • Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools).
  • Experience developing cloud infrastructure services, preferably with Kubernetes.
  • You are passionate about solving data problems at Scale.
  • Expertise with a public cloud provider (AWS, GCP, Azure) and their infrastructure as a service offering (e.g., EC2).
  • You are a full-cycle developer with strong ownership and experience building and operating high-scale, distributed systems across the full software life cycle. 
  • You have excellent communication skills and the ability to work well within and across engineering teams.
  • You are a strong problem solver and have solid production debugging skills.

#LI-Remote