Senior AI Data Engineer

The Senior Data Engineer sits on Scorpion's AI team and plays a critical role in building and evolving the trusted data foundation that powers our AI products, tools, and decision-making. In this role, you'll build Scorpion's unified analytical data layer, providing AI agents, machine learning models, and internal teams with a single, reliable, and secure source of client and business data.

You'll partner closely with engineering, data science, product, and AI leaders to design scalable analytical systems, build production-grade data pipelines from operational and third-party sources, and ensure data access is performant, consistent, and aligned with business needs. Your work will directly influence how Scorpion leverages data and AI to deliver value to clients and employees.

Beyond day-to-day engineering, you'll help shape Scorpion's long-term AI and data platform strategy, determining how data is organized, governed, secured, and leveraged to support future products, insights, and AI-powered experiences. You'll establish and maintain data quality standards, reliability expectations, and service-level agreements that ensure trusted, queryable data is available across the organization.

• →Evaluate and improve data quality, completeness, and consistency across 30+ databases, applications, platforms, and APIs.
• →Design and build Scorpion's analytical data platform, creating a trusted source of truth for business and client data.
• →Develop and maintain scalable data pipelines that efficiently move data from operational systems into the analytical platform.
• →Help teams transition from querying production databases directly to using trusted analytical data sources.
• →Design data access patterns that enable AI agents and applications to quickly retrieve relevant client and business information.
• →Build secure, scalable solutions that deliver client context and business insights to internal applications and AI-powered experiences.
• →Define, monitor, and improve service level agreements (SLAs) for data freshness, availability, reliability, and performance.
• →Partner with engineering, product, and data science teams to establish data standards, governance practices, and data contracts.
• →Continuously improve the scalability, performance, and reliability of Scorpion's data ecosystem.

• Education
  • Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
• Experience
  • 7+ years of data engineering experience, including designing and operating production-scale analytical data platforms.
  • Experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments.
  • Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms.
  • Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions.
  • Experience designing scalable data models that support analytics, reporting, and AI-driven applications.
  • Experience establishing data governance standards, data contracts, and documentation practices across teams.
• Technical Skills
  • Data Processing & Lakehouse Technologies
    • Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation.
  • Data Warehousing & Analytics
    • Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
  • Programming & Query Languages: 
    • Advanced SQL skills, including query optimization, execution planning, and performance tuning.
    • Strong Python skills for data pipeline development, automation, transformation, and integration with production systems.
  • Data Pipeline & Orchestration Tools
    • Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools.
  • Architecture & Security
    • Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
• Professional Skills
  • Ability to collaborate effectively across engineering, product, data science, and business teams.
  • Strong communication skills with the ability to translate business requirements into scalable data solutions.
  • Strong analytical and problem-solving skills with a focus on building scalable, maintainable systems.
  • Ability to balance long-term platform strategy with near-term business priorities.

• Winning Mindset:  When our clients win, we win.
• Genuine Care:  We only succeed when we are truly invested in our clients and each other.
• Unmatched Results:  We deliver more than expected–and then some–driving the best results and impacting lives.
• Constant Improvement:  We believe there is always a better way. We learn we ask “What if?” we build and then do it again.
• Unbeatable Teamwork:  We come from different backgrounds but have the same vision. We only get there by doing it together, as a team.

Scorpion supports a range of work arrangements, including in-office, hybrid, and remote roles. For positions designated as remote, employees who live within commuting distance of a Scorpion office may be asked to work from the office based on team needs, collaboration opportunities, or business priorities. Specific expectations will be discussed during the interview process.