Data Engineer

Shirley Ryan AbilityLab is the global leader in physical medicine and rehabilitation for adults and children with the most severe, complex conditions. By joining our team, you’ll be part of our life-changing mission and vision. You’ll contribute to an innovative, multifaceted culture that is second to none — one that embraces collaboration, excellence, discovery and compassion. You’ll play a role in something that’s never been done before as we integrate science and clinical care to help patients achieve better, faster outcomes — as we Advance Human Ability, together.

• Collaborate within the Data Platform Engineering team, Data Analytics and Data Governance teams, other Information Services (IS) teams, executive leadership, external consultants, and stakeholders from various departments within the hospital to:

• Primarily utilizing existing resources, assist in developing secure, stable, scalable long-term plans for the flow of the hospital’s data.

• Assist in the development of scalable data infrastructure and platforms to collect and process large amounts of data, including structured and unstructured data for analysis by clinical, research, and business resources. Data sources may be internally (locally) or externally (cloud) sourced, both data owned by the organization and external to the organization from partners and vendors.

• Establish methods and procedures for tracking data quality, completeness, redundancy, compliance and improvement along with related system operational performance.

• Create strategies and plans for data capacity planning, data security, life cycle data management, scalability, backup and archiving.

• Create the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring data quality and accurate downstream delivery and reporting.

• Define standards for engineering and architecture including naming, describing, managing, modeling, cleaning, enriching, transforming, transferring, storing, searching, and delivering data securely within the hospital.

• Assist with data stewardship by tagging and defining data elements in collaboration with subject matter experts and the Data Governance team.

• Participate in data structure and information model design across multiple stakeholders.

• Acquire and maintain data from primary or secondary data sources.

• Identify and evaluate opportunities for enhancement of current data architecture and data management technologies.

• Monitor, update, and ensure consistent uptime, availability and access of the data platform and other data systems for performance and reliability.

• Develop processes to support the deployment of high quality, flexible, and secure data management solutions

• Leverage available tools to drive Automation of key data management processes

• Create instrumentation and metrics to ensure ecosystem health & ensure continuous improvement of KPI’s

• Reports directly to the Director Data Platform Architecture

• Bachelor’s or master’s degree in computer science or computer engineering, or in a related area (data science, mathematics, statistics, economics, etc.) with demonstrated proficiency in the skills below.

• Expertise in SQL (5 years professional) with experience with MySQL, PostgreSQL and their derivatives in building complex queries, tuning, and optimization

• Expertise in Python and/or Java (5 years professional) with a focus on data manipulation, database interaction, ETL automation, big data technologies, and performance optimization

• Knowledge and understanding of HIPAA and ability to implement data security standards in line with those requirements including inter-operability with HL7 and FHIR.

• At least 2-5 years of professional experience establishing ETL/ELT processes for securely transporting data between cloud and local databases. Experience doing so between Snowflake, AWS RDS (Aurora), OCI, Microsoft Power Apps, and using Informatica is a plus.

• Experience with other AWS data utilities (API gateway, S3, etc.) is a plus. 

• Demonstrated experience in handling large data sets and relational databases, data warehousing, scalability, reliability, access and provisioning.

• Experience evaluating and leveraging AI utilities in data warehouse and data governance tools for model and pipeline development while ensuring quality data for the analytics layer and self-services.

• Strong communication skills, particularly those relevant to translating highly technical information for non-technical audiences in terms of documentation and diagrams.

• Demonstrated ability to manage and see through long-term projects. 

• Proactive work habits such as proposing and developing new projects and initiatives or advocating and promoting incremental adoption of new technologies.

• Candidates familiar with Oracle-Cerner EHR systems, particularly the Millennium data model and CCL, will receive strong consideration.

• Candidates familiar with research CDMs like OMOP, i2b2, and PCORnet will be strongly considered.

• Candidates with experience developing REST/RESTful APIs, streaming platforms, and role-based access and encryption will also be strongly considered.

• Normal office environment with little or no exposure to dust or extreme temperature.