Senior Data Engineer / Senior Data Architect

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL.
• Build ETL/ELT pipelines to ingest data from internal and external source systems.
• Load and manage data in Databricks Delta Tables.
• Handle data from multiple and evolving source systems.
• Implement data validation, quality checks, error handling, and monitoring.
• Troubleshoot and optimize data pipelines for performance, reliability, and scalability.

• Analyze source data and business requirements to design appropriate data transformations.
• Develop standardized and curated datasets for reporting, dashboards, and analytics.
• Design and maintain logical and physical data models.
• Apply dimensional modeling concepts such as fact and dimension tables, star schema, and normalization/denormalization.
• Ensure data models are scalable and aligned with business requirements.

• Design end-to-end data architectures and data movement strategies.
• Evaluate source systems and integration patterns and recommend appropriate solutions.
• Design scalable, secure, maintainable, and reliable data solutions.
• Create technical documentation covering architecture, data flows, mappings, and integration processes.
• Contribute to reusable data engineering frameworks and best practices.

• Work directly with business users, data consumers, and technical teams to understand and clarify requirements.
• Translate business requirements into technical specifications and data models.
• Understand business processes and determine appropriate data transformation and architecture approaches.
• Communicate technical solutions effectively to both technical and non-technical stakeholders.

• Implement data quality and validation frameworks.
• Follow data governance, naming conventions, taxonomy, metadata, and lineage standards.
• Ensure data accuracy, consistency, traceability, and auditability.
• Support enterprise data management and governance initiatives.

Work Location: Hyderabad

Work Mode: Hybrid – 3 days per week from office

Working Hours: 2:00PM to 11:00 PM.

Role Type: Contract