B
Brillio 210mo ago

Lead Data Engineer - R01553055

IndiaIndiaEmployeelead
Data ScienceData EngineeringData EngineerDataData & AI
2 views0 saves0 applied
Apply Now

Quick Summary

Overview

Lead Data Engineer GCP, Big Query, Python, Airflow, SQL, DBT About the Role We are seeking a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) and BigQuery to lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for…

Key Responsibilities

1. Data Migration & Cloud Modernization Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server). Lead the migration of large-scale datasets to Google BigQuery.

Requirements Summary

GCP Professional Data Engineer certification. Experience with modern data stack tools like dbt, Kafka, or Terraform. Exposure to ML pipelines, analytics engineering, or DataOps/DevOps methodologies. Why Join Us?

Technical Tools
airflowbigquerydbtgcpjavakafkapythonsparksqlterraformci-cddatabase-designetlperformance-optimizationsql-optimizationstreaming-data
Lead Data Engineer
  • GCP, Big Query, Python, Airflow, SQL, DBT
  • About the Role
  • We are seeking a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) and BigQuery to lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for enterprise-level systems. This is a high-impact role focused on driving the transformation of legacy infrastructure into a robust, cloud-native data ecosystem.

  • Key Responsibilities
  • 1. Data Migration & Cloud Modernization
  • Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server).
  • Lead the migration of large-scale datasets to Google BigQuery.
  • Design and implement data migration strategies ensuring data quality, integrity, and performance.
  • 2. Data Integration & Streaming
  • Integrate data from various structured and unstructured sources, including APIs, relational databases, and IoT devices.
  • Build real-time streaming pipelines for large-scale ingestion and processing of IoT and telemetry data.
  • 3. ETL / Data Pipeline Development
  • Modernize and refactor legacy SSIS packages into cloud-native ETL pipelines.
  • Develop scalable, reliable workflows using Apache Airflow, Python, Spark, and GCP-native tools.
  • Ensure high-performance data transformation and loading into BigQuery for analytical use cases.
  • 4. Programming & Query Optimization
  • Write and optimize complex SQL queries, stored procedures, and scheduled jobs within BigQuery.
  • Develop modular, reusable transformation scripts using Python, Java, Spark, and SQL.
  • Continuously monitor and optimize query performance and cost efficiency in the cloud data environment.

  • Required Skills & Experience
  • 5+ years in Data Engineering with a strong focus on cloud and big data technologies.
  • Minimum 2+ years of hands-on experience with GCP, specifically BigQuery.
  • Proven experience migrating on-premise data systems to the cloud.
  • Strong development experience with Apache Airflow, Python, and Apache Spark.
  • Expertise in streaming data ingestion, particularly in IoT or sensor data environments.
  • Strong SQL development skills; experience with BigQuery performance tuning.
  • Solid understanding of cloud architecture, data modeling, and data warehouse design.
  • Familiarity with Git and CI/CD practices for managing data pipelines.

  • Preferred Qualifications
  • GCP Professional Data Engineer certification.
  • Experience with modern data stack tools like dbt, Kafka, or Terraform.
  • Exposure to ML pipelines, analytics engineering, or DataOps/DevOps methodologies.

  • Why Join Us?
  • Work with cutting-edge technologies in a fast-paced, collaborative environment.
  • Lead cloud transformation initiatives at scale.
  • Competitive compensation and benefits.
  • Remote flexibility and growth opportunities.

    • Location & Eligibility

    Where is the job
    India
    Hybrid within the country
    Who can apply
    IN
    Listed under
    India

    Listing Details

    Posted
    July 17, 2025
    First seen
    March 26, 2026
    Last seen
    May 15, 2026

    Posting Health

    Days active
    49
    Repost count
    0
    Trust Level
    25%
    Scored at
    May 15, 2026

    Signal breakdown

    freshnesssource trustcontent trustemployer trust
    Apply for this position

    4 other jobs at Brillio 2

    View all →

    Explore open roles at Brillio 2.

    B
    Java Developer- R01565213
    Employee
    B
    Senior Tableau Lead/Architect (Pharma domain)- R01564874
    Employee
    B
    Senior Lead Data Analyst - R01565187
    USD 125000–130000
    Employee
    B
    Elastic Search / ELK Stack engineer - R01564999
    USD 70–74
    Third Party Contract

    Similar Data Engineer jobs

    View all →
    SpacexSpacex
    Sr. Data Engineer, Ground Network Engineering (Business Analytics)
    $160k–$225k/yr
    DataikuDataikuRemote
    Data Engineer II
    Remote
    DataikuDataikuRemote
    Data Engineer
    Remote
    F
    Fartherfinance
    AI-Native Data Platform Engineer
    I
    Ibkr
    Data Engineer (Gen AI)
    $150k–$200k/yr
    CoderioCoderioRemote
    Senior Analytics Data Engineer MS056MD
    Contract | RemoteRemote

    Browse Similar Jobs

    Machine Learning Engineer1.5kData Scientist1.3kData Analyst1kData Manager128Bi Developer71
    Newsletter

    Stay ahead of the market

    Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.

    A
    B
    C
    D
    Join 12,000+ marketers

    No spam. Unsubscribe at any time.

    B
    Lead Data Engineer - R01553055
    Apply Now