Shyftlabs
Shyftlabs2d ago
New

Databricks Engineer

Noida, Uttar PradeshFull-Timemid
OtherEngineer
0 views0 saves0 applied
Apply Now

Quick Summary

Overview

Position Overview: ShyftLabs is seeking a skilled Databricks Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP).

Technical Tools
awsazuredockergcpkafkakuberneteslookerpower-bipythonscalasparksqltableauterraformci-cdecommerceetlstreaming-data
Position Overview:
ShyftLabs is seeking a skilled Databricks Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to drive data-driven insights and ensure scalable, high-performance data architectures.
 
ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.
  • Design, implement, and optimize big data pipelines in Databricks.
  • Develop scalable ETL workflows to process large datasets.
  • Leverage Apache Spark for distributed data processing and real-time analytics.
  • Implement data governance, security policies, and compliance standards.
  • Optimize data lakehouse architectures for performance and cost-efficiency.
  • Collaborate with data scientists, analysts, and engineers to enable advanced AI/ML workflows.
  • Monitor and troubleshoot Databricks clusters, jobs, and performance bottlenecks.
  • Automate workflows using CI/CD pipelines and infrastructure-as-code practices.
  • Ensure data integrity, quality, and reliability in all pipelines.
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • 5+ years of hands-on experience with Databricks and Apache Spark.
  • Proficiency in SQL, Python, or Scala for data processing and analysis.
  • Experience with cloud platforms (AWS, Azure, or GCP) for data engineering.
  • Strong knowledge of ETL frameworks, data lakes, and Delta Lake architecture.
  • Experience with CI/CD tools and DevOps best practices.
  • Familiarity with data security, compliance, and governance best practices.
  • Strong problem-solving and analytical skills with an ability to work in a fast-paced environment.
  • Databricks certifications (e.g., Databricks Certified Data Engineer, Spark Developer).
  • Hands-on experience with MLflow, Feature Store, or Databricks SQL.
  • Exposure to Kubernetes, Docker, and Terraform.
  • Experience with streaming data architectures (Kafka, Kinesis, etc.).
  • Strong understanding of business intelligence and reporting tools (Power BI, Tableau, Looker).
  • Prior experience working with retail, e-commerce, or ad-tech data platforms.

    • Location & Eligibility

    Where is the job
    —
    Location terms not specified
    Who can apply
    Same as job location

    Listing Details

    Posted
    May 6, 2026
    First seen
    May 6, 2026
    Last seen
    May 8, 2026

    Posting Health

    Days active
    0
    Repost count
    0
    Trust Level
    70%
    Scored at
    May 6, 2026

    Signal breakdown

    freshnesssource trustcontent trustemployer trust
    Apply for this position
    Shyftlabs
    Shyftlabs
    lever
    Employees
    125
    Founded
    2018
    Domain
    shyftlabs.io
    Jobs
    View 55 jobs
    View company profile

    3 other jobs at Shyftlabs

    View all →

    Explore open roles at Shyftlabs.

    Shyftlabs
    Tech Lead / Solution Architect
    $130k–$170k/yr
    Shyftlabs
    Front Desk Receptionist
    Full-Time    Shyftlabs
    AI Engineer
    Full-Time

    Similar Engineer jobs

    View all →
    P
    Pearceservices
    OSP Engineer
    USD 30-38
    TkdaTkda
    Lead Water-Wastewater Engineer
    USD 145000–172000
    Full Time (40)
    qualcommqualcomm
    Senior Staff SoC STA/Timing Engineer
    Vertiv Group CorporationVertiv Group Corporation
    VTCJM-PE Engineer （Local）-Jiangmen
    usiglobalusiglobal
    【線上面試】AOI自動光學檢測工程師/Auto Optical Inspection Engineer
    jolerajolera
    Cloud Backup Engineer (Mumbai)

    Browse Similar Jobs

    Manager6.2kAssistant Manager5.6kTeam Member5.1kDirector3kAssistant2.8kAssociate2.7kConsultant2.6kData Collector2.2kTechnician2.2kFitness & Wellness2.1kSupervisor1.9kCoordinator1.9kRestaurant General Manager1.7kTeam Leader1.6kAnalyst1.6kPart Time1.3kBehavioral Health1.3kCrew Member1.2kDevelopment1.1kSocial Worker1.1k
    Newsletter

    Stay ahead of the market

    Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.

    A
    B
    C
    D
    Join 12,000+ marketers

    No spam. Unsubscribe at any time.

    ShyftlabsDatabricks Engineer
    Apply Now