We are looking for a Senior Data Engineer to design, build, and maintain data pipelines across our health plan technology platform, spanning AWS-native data services and existing SQL Server/SSIS ETL processes. This role sits alongside the other engineering teams in this application landscape (software engineering, Data/BI & Integration, DevOps, and Edifecs EDI), and carries dual responsibility: keeping current SQL Server/SSIS workloads reliable, and helping migrate and modernize them onto AWS-native pipelines.
Key Responsibilities
Design, build, and maintain ETL/ELT pipelines using AWSGlue, Lambda, and Step Functions to ingest, transform, and load data acrossAWS-based data platforms (S3, Redshift, Athena)
Maintain, enhance, and troubleshoot existing SQLServer-based ETL processes built in SSIS, including packages, control flows,data flows, and error handling
Write and optimize complex T-SQL queries, storedprocedures, and views supporting reporting and downstream applications
Support ongoing migration and modernization of legacySQL Server/SSIS ETL workloads to AWS-native data pipelines
Design and maintain data models (dimensional/starschema) supporting analytics and reporting use cases
Use AWS Database Migration Service (DMS) and relatedtools to support data migration from on-premises SQL Server to AWS
Implement data quality checks, validation, andmonitoring across ETL pipelines
Optimize pipeline performance, reliability, and costacross both AWS-native and SQL Server/SSIS workloads
Partner with BI, integration, and application teams(including the Power BI and Edifecs/EDI teams within this applicationlandscape) to ensure data availability and consistency across systems
Document data flows, pipeline architecture, and datamodels to support internal knowledge sharing
Troubleshoot and resolve production data pipelineissues, including root-cause analysis
Mentor junior engineers on data engineering and ETL/ELTbest practices
Required Qualifications
Bachelor's degree in Computer Science, Engineering,Information Systems, or a related field
8–12 years of experience in data engineering or ETLdevelopment
Strong, hands-on experience with AWS data services: S3,Redshift, Glue, Athena, Lambda, and Step Functions
Strong, hands-on experience with SQL Server, includingT-SQL development, query optimization, and performance tuning
Strong, hands-on experience building and maintainingETL packages in SSIS (control flow, data flow, error handling, and deployment)
Working proficiency in Python for scripting,automation, and Glue/PySpark-based ETL development
Solid understanding of dimensional data modeling (starschema) for analytics and reporting use cases
Experience with data migration tools and approaches(e.g., AWS DMS) for moving workloads from on-premises SQL Server to AWS
Strong understanding of data quality, governance, andlineage practices
Strong debugging, performance-tuning, andproduction-support skills across ETL pipelines
Excellent written and verbal communication skills forcross-functional collaboration
AI Knowledge & AI-Assisted Development (Required)
Daily, practical use of AI coding/assistant tools(e.g., Claude Code, GitHub Copilot, Cursor, or similar) to acceleratedevelopment of Glue/PySpark scripts, SSIS package logic, and T-SQL queries
Able to critically review and validate AI-generatedcode, queries, and transformations for correctness, performance, and dataintegrity before deployment
Practical use of AI tools to assist with dataprofiling, anomaly detection, and technical documentation
Understanding of secure and compliant AI tool usage,including never entering PHI, member data, or other sensitive information intoprompts or external AI tools
Able to identify where AI-driven automation can improvepipeline development, testing, or migration efficiency, and champion adoptionwithin the team
Preferred Qualifications
Experience in the US health insurance or payer domain:claims, eligibility, enrollment, provider, or member data, with HIPAA-awaredata handling practices
Exposure to healthcare data standards (X12 EDI, HL7,FHIR)
Experience with Power BI or other BI/reporting toolsconsuming the data pipelines you build
Experience with additional AWS data services: EMR,Kinesis, or Redshift Spectrum
Experience with modern orchestration tools (e.g.,Apache Airflow) as an alternative or complement to SSIS
Relevant certifications: AWS Certified DataEngineer/Analytics Specialty, Microsoft SQL Server certifications
Software Development and IT Services and IT Consulting
What We Offer
About the Company
Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.
Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together.
Applicants
are
advised to research the bonafides of the prospective employer independently. We do NOT
endorse any
requests for money payments and strictly advice against sharing personal or bank related
information. We
also recommend you visit Security Advice for more information. If you suspect any fraud
or
malpractice,
email us at abuse@talentmate.com.
You have successfully saved for this job. Please check
saved
jobs
list
Applied
You have successfully applied for this job. Please check
applied
jobs list
Do you want to share the
link?
Please click any of the below options to share the job
details.
Report this job
Success
Successfully updated
Success
Successfully updated
Thank you
Reported Successfully.
Copied
This job link has been copied to clipboard!
Apply Job
Your application for Senior Data Engineer
has been successfully submitted!
To increase your chances of getting shortlisted, we recommend completing your profile.
Employers prioritize candidates with full profiles, and a completed profile could set you apart in the
selection process.
Why complete your profile?
Higher Visibility: Complete profiles are more likely to be viewed by employers.
Better Match: Showcase your skills and experience to improve your fit.
Stand Out: Highlight your full potential to make a stronger impression.
Complete your profile now to give your application the best chance!