Role Title: Data Engineering Advisor (Databricks)

Position Summary:

Cigna, a leading Health Services company, is looking for data engineers/developers in our Data & Analytics organization. The Data Engineer would be responsible for the delivery of a business need, end-to-end starting from understanding the requirements to deploying the software into production. This role requires you to be fluent in some of the critical technologies with proficiency in others and have a hunger to learn on the job and add value to the business. Critical attributes of being a Data Engineer, among others, is ownership & accountability. In addition to delivery, the Engineer should have an automation first and continuous improvement mindset. He/She should drive the adoption of CI/CD tools and support the improvement of the tools sets/processes. This role requires close collaboration with various teams to gather data requirements, build scalable data pipelines, and ensure the overall solution is reliable, available, and optimized for high performance.

Behaviors of a Data Engineer:

Data Engineers are able to articulate clear business objectives aligned to technical specifications and work in an iterative, agile pattern daily. They have ownership over their work tasks, and embrace interacting with all levels of the team and raise challenges when necessary. We aim to be cutting-edge engineers – not institutionalized developers.

Job Description & Responsibilities:

Engineer will work on a team of truly talented individuals and be responsible for design, build and testing (using automation scripts but not limited to unit/integration/performance testing) of Individual & Family Retail Health Insurance applications and its components that interface with complex enterprise systems and external vendor systems. Engineer will have solid knowledge working with complex distributed applications and passion for technologies by solving data integration challenges. Individual will have zeal and drive to be up to speed with latest development in tech arena.

Engineer must be a highly motivated, well-rounded, team player and self-starter that works best in a collaborative, dynamic, agile environment. Excellent communication skills both written and oral are also essential as this position will interface with remote scrum teams, business owners, enterprise architects, security, infrastructure, and end users via email, phone, IM, desktop sharing, and wiki. They should be able to demonstrate the qualities listed below

Qualities:

· Analytical Skills: Candidate must have strong analytical skills and be able to recognize the needs of customers and create simple solutions that answer those needs.

· Communication: Candidate must be able to clearly communicate their ideas to peers, stakeholders, and management.

· Creativity: Creativity is needed to help invent new ways of approaching problems and developing innovative applications as well as bringing experience from other industries.

· Customer-Service: If dealing directly with clients and customers, candidate would need good customer service skills and consultant mentality to answer questions and fix issues.

· Attention to Detail: Applications have many parts and all must work together for the application to function.

· Problem-Solving: As issues come up, candidate must be able to make decisions that move the project forward.

· Teamwork: Candidate must work well with others as part of a distributed agile (SAFe) team of engineers, analysts, product owner, and scrum master.

· Technical Skills: Candidate must be adept in computer languages and have strong technical aptitude. Must have a solid knowledge with common design patterns should seek out opportunities to implement design patterns.

· Leadership Skills: Candidate is expected to lead by example, exhibiting technical excellence and development of expert level business domain knowledge. Influences technical direction within the ART and across ARTs. Advocates for a shared technical vision, enables others to act to fulfill the vision. Challenges existing processes through relentless improvement.

Responsibilities:

· Develop and maintain scalable data pipelines using AWS services and Databricks. These processes are designed to extract data from multiple sources, transform it into meaningful formats, and load it into data lakes or downstream systems.

· A key aspect of this responsibility is ensuring that data is accurately cleaned, transformed, and loaded to enable consistent and reliable analytics and reporting along with designing data storage systems that scale, perform well, and meet the organization’s purge and archive requirements.

· Implement monitoring and alerting systems to proactively detect and resolve issues within data pipelines and oversee data storage and processing activities, ensuring optimal performance by addressing operational challenges.

· Enable a 360-degree view of customer-centric information through integration of a multitude of internal/external systems, mobile apps, devices, and data marts.

· Ability to implement test driven development with strong focus on automation testing.

· Support and enhance existing Individual & Family Retail Health Insurance applications used by consumers as well as operations staff.

· Participate in all agile ceremonies effectively.

Skillset:

Engineers should have 11 to 13 years of experience and should be very familiar with advanced concepts and have relevant, hands-on experience in many of the following areas to be a successful contributor on the team:

· Proven experience in AWS Cloud Services such as AWS Glue, ECS/EKS, Fargate, Redshift/Aurora/DocumentDB, ECR, S3, Lambda, SNS, IAM etc.

· Proficient in Databricks DLT (Delta Live Tables) and workflows, SQL, Spark, Python and/or Py Spark, Java or other relevant programming languages for data engineering workloads.

· Experience with Databricks orchestration frameworks – Internal Databricks workflows or external Apache Airflows (DAGS).

· Solid understanding of data integration strategies, ELT/ETL techniques, and data warehousing principles. Prior experience of ELT/ETL workflows such as Informatica would be useful in analysis of existing systems and their pain points to mitigate them in the future state data architecture.

· Strong analytical and problem-solving capabilities, with expertise in diagnosing complex data issues and optimizing pipeline performance and reliability.

· Apply data transformation, quality and observability techniques for production-grade pipelines.

· Experience in performance tuning of applications that involves threading, indexing, clustering, and caching.

· Knowledge of reporting/BI tools such as Tableau would be plus.

· Knowledge of data governance, lineage, and catalog tools such as Alation, Colibra, or any other would be plus.

· Knowledge of data modeling and various structured/non-structured databases would be desired but not required.

· Engineering mindset with a passion for excelling in all areas of the software development life cycle such as analysis, design, development, automated testing, and DevOps.

Desired (but not required) –

· Hands-on experience in migrating and setting up large-scale cloud data pipelines using Databricks.

· Expertise in loading billions of files across millions of partitions and resolving performance bottlenecks on AWS Databricks.

· Strong knowledge of partitioning strategies, metadata management, and file formats (Delta Lake, Iceberg, Apache Hudi).

· Experience with document databases (e.g., DocumentDB) and JSON/XML source data.

· Exposure to Lakehouse concept and dimensional modeling & Data Vault for scalable data structures.

· Skilled in real-time data ingestion, transformation, and data quality checks.

· Experience in converting on-premises pipelines to Databricks DLT (Delta Live Tables) for efficient cloud processing.

· Understanding of OLTP, OLAP concepts, normalization, denormalization, how business use cases drive data model design and implementation.

Qualifications:

· Bachelor’s degree in computer science or a related discipline strongly preferred, typically eleven or more years of solid, diverse work experience in IT with a minimum of eight years’ experience application program development, or the equivalent in education and work experience. Ideal candidate will have relevant experience either as a consultant or working for a start-up company

About Evernorth Health Services

Evernorth Health Services, a division of The Cigna Group, creates pharmacy, care and benefit solutions to improve health and increase vitality. We relentlessly innovate to make the prediction, prevention and treatment of illness and disease more accessible to millions of people. Join us in driving growth and improving lives.