Brillio 22mo ago

Consultant - R01561609

India·BangaloreThird Party Contractmid

Data ScienceOtherData EngineeringConsultant

2 views0 saves0 applied

Apply Now

Quick Summary

Overview

Consultant Spark - Pyspark, SQL, SQL (Basic + Advanced), Python, Hive, Data Modelling Fundamentals Data Analysis: Associate Data Engineer We are seeking an experienced professional who is comfortable working closely with data engineers, architects, and business stakeholders to translate…

Technical Tools

confluencejirapythonsparksqlagiledata-analysis

Consultant

Spark - Pyspark, SQL, SQL (Basic + Advanced), Python, Hive, Data Modelling Fundamentals

Data Analysis: Associate Data Engineer

We are seeking an experienced professional who is comfortable working closely with data engineers, architects, and business stakeholders to translate business requirements into robust, scalable, and well-documented data models. You will be responsible for both logical and physical data modelling and will act as the subject matter expert and owner for all data models within your domain. What you'll do • Take full ownership of the data modelling lifecycle, from requirements gathering through to deployment and ongoing maintenance. • Design, develop, and maintain logical and physical data models, primarily using Databricks and the Nova platform. • Ensure data models are aligned with business requirements, data governance standards, and best practices. • Collaborate with data engineers, architects, and business stakeholders to understand data requirements and translate them into effective data structures. • Document data models, definitions, and metadata to ensure clarity and consistency across the organisation. • Review and optimise existing data models for performance, scalability, and maintainability. • Lead model validation and quality assurance activities, ensuring models are accurate and fit for purpose. • Provide guidance and support to project teams and business users on data modelling best practices. • Act as the primary point of contact and subject matter expert for all matters relating to data models within your area of responsibility. • Champion data model governance and ensure models are maintained in line with organisational standards and policies. • Support the integration of new data sources and the evolution of the enterprise data platform. Knowledge / Experience / Skills Essential • Extensive experience in data modelling, including both logical and physical modelling, ideally within Databricks and/or similar cloud-based platforms. • Demonstrable experience of owning and maintaining enterprise data models, including responsibility for model governance and documentation. • Strong understanding of data warehousing, lakehouse architectures, and modern data platforms. • Ability to translate complex business requirements into scalable and efficient data models. • Proficient in data modelling tools and techniques, with hands-on experience in Databricks and the Nova platform (or similar). • Excellent communication skills, with the ability to work collaboratively across technical and business teams. • Experience in data governance, metadata management, and data quality assurance. • Strong analytical and problem-solving skills. • Desirable • Experience working in regulated industries such as insurance or financial services. • Familiarity with reporting requirements such as IFRS and Solvency II. • Experience with data visualisation tools and supporting analytics/reporting teams. • Knowledge of automation tools and scripting for data model management. • Experience working in Agile product teams and using tools such as JIRA/Confluence.