Job Description

Role: Senior Py Spark Developer / Engineer
Location: Dallas, TX (3 Days onsite/week)

Job Description:

Must-Have Technical Skills: Py Spark, SQL and UNIX

Py Spark Expertise-:

Strong hands-on experience with Py Spark architecture understanding
Clear understanding of how Py Spark jobs execute in the background
Ability to read, write, analyze, and enhance Py Spark scripts and configurations

SQL Proficiency:

Strong SQL skills:

Experience working with SQL as part of data processing and Py Spark job execution

Unix Shell Scripting:

Should have good understanding of Unix shell scripting.
Ability to understand backend Unix scripts supporting Py Spark workflows
Experience in reading, analyzing, writing, and modifying shell scripts for Py Spark integration

ETL Knowledge:
Hands-on experience with ETL processes using any programming language or framework
Ability to understand and work with complementary ETL workflows alongside Py Spark

Job Scheduling & Automation:

Experience with at least one enterprise scheduling/automation tool such as: Autosys/ Control‑M/ Airflow/ or similar tools used in production environments

Nice-to-Have Skills:

Experience working with finance domain applications
Familiarity with related frameworks or tools that enhance Py Spark-based workflows