Senior Apache Kafka Data Engineer

senior

Data EngineerData

1 views0 saves0 applied

Apply Now

Quick Summary

Requirements Summary

data transformation, ingestion, processing, and surfacing of data for large-scale applications Develop data pipeline automation using Azure technologies stack, Databricks,

Technical Tools

Data EngineerData

As a Data Engineer, you will:

Work across workstreams to support data requirements including reports and dashboards

Analyze and perform data profiling to understand data patterns and discrepancies following Data Quality and Data Management processes

Understand and follow best practices to design and develop the E2E Data Pipeline: data transformation, ingestion, processing, and surfacing of data for large-scale applications

Develop data pipeline automation using Azure technologies stack, Databricks, Data Factory

Understand business requirements to translate them into technical requirements that the system analysts and other technical team members can drive into the project design and delivery

Analyze source data and perform data ingestion in both batch and real-time patterns via various methods; for example, file transfer, API, Data Streaming using Kafka and Spark Streaming

Analyze and understand data processing and standardization requirements, develop ETL using Spark processing to transform data

Understand data/reports and dashboards requirements, develop data export, data API, or data visualization using Power BI, Tableau, or other visualization tools

We are looking for experience and qualifications in the following:

Bachelor’s degree in Computer Science, Computer Engineer, IT, or related fields

Minimum 2 years’ experience in Data Engineering fields (new graduates are also welcome for some of our job openings)

Data Engineering skills: Python, SQL, Spark, Cloud Architect, Data & Solution Architect, API, Databricks, Azure

Data Visualization skills: Power BI (or other visualization tools), DAX programming, API, Data Model, SQL, Story Telling and wireframe design

Business Analyst skills: business knowledge, data profiling, basic data model design, data analysis, requirement analysis, SQL programing

Basic knowledge in Data Lake/Data Warehousing/ Big data tools, Apache Spark, RDBMS and NoSQL, Knowledge Graph

Experience working in a client-facing/consulting environment is a plus

Team player, analytical and problem-solving skills

Good communication skills in English

We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.Join Accenture to work at the heart of change.

Visit us at www.accenture.com

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.