Data Engineer

 

We are seeking a Data Engineer with strong data modeling, governance and data quality capabilities to transform a fragmented data estate into a trusted enterprise foundation. This role will design ODS and DWH models, establish consistent data definitions and quality controls, and ensure that governance and SOX requirements are incorporated into both the current SQL Server environment and the future Databricks platform.

 

 

Key Functions/Duties of Position: 

 

·         Analyze existing databases, marts and reporting structures to identify duplication and inconsistent models.

·         Develop conceptual, logical and physical models for ODS and DWH solutions, including dimensional models.

·         Define source-to-target mappings, business keys, historical data handling and transformation rules.

·         Help establish data ownership, stewardship, metadata, lineage and critical data element standards.

·         Define and automate data quality metrics for completeness, accuracy, validity, consistency, timeliness and reconciliation.

·         Build and maintain SQL-based pipelines supporting governed ODS and DWH models.

·         Support migration of models and pipelines to Databricks using SQL and, where appropriate, Python or PySpark.

·         Document control points and evidence supporting traceable, SOX-compliant data processes.

• Perform other duties and/or projects as assigned

 

Bachelor’s degree in Computer Science, Information Systems, Data Analytics, Data Engineering, or a related field

 

 

·                     Advanced SQL and Microsoft SQL Server experience.

·                     Strong relational and dimensional data modeling capabilities.

·                     Experience with ETL/ELT, ODS and enterprise data warehouse solutions.

·                     Experience defining data quality rules, reconciliations and source-to-target mappings.

·                     Ability to translate business concepts into scalable technical data models.

·                     Strong collaboration, documentation and problem-solving skills.

Preferred Qualifications

·                     Databricks, Python, PySpark or Spark experience.

·                     Experience implementing data governance, metadata, lineage or data catalog practices.

·                     Experience with automated data quality frameworks.

·                     Experience in a SOX-controlled or regulated environment.

·                     Property and casualty insurance industry knowledge, including policy, billing, claims or underwriting data, is a strong plus.

·                     Experience working with Guidewire applications or data, including Guidewire ClaimCenter (GWCC), Guidewire BillingCenter (GWBilling) or related policy systems.

·                     Experience designing governed, feature-ready data for predictive modeling or machine learning.

·                     Understanding of quality, lineage, privacy and control considerations for analytical models and AI solutions.

·                     Familiarity with generative AI, LLMs, RAG, vector data or unstructured data governance.

 

 

Only solicited resumes/candidate profiles that are submitted by a Berkley Preferred Agency Partner that have been requested by Berkley Internal Recruiting to engage in a particular search will be subject to the payment of Agency fees as defined in the formal agency agreement. Any unsolicited resumes/candidate profiles are not subject to payment of the agency fees. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment.

Sponsorship not Offered for this Role