Python-Spark Scala

5–9 years of experience in Data Engineering / Big Data development.
Strong hands-on experience with Python and Apache Spark (Scala & Py Spark).
Deep understanding of Spark architecture (RDD, Data Frames, Spark SQL).
Experience in distributed computing and big data processing.
Strong knowledge of SQL and data modeling concepts.
Experience with data pipeline development (ETL/ELT).
Familiarity with Linux/Unix environments.
Experience with version control tools (Git).

• Primary skills:Technology->Big Data
• Data Processing->Spark,Technology->Functional Programming->Scala,Technology->Machine Learning->Python

Experience with cloud platforms (AWS, Azure, or GCP).
Hands-on with Databricks / EMR / Spark clusters.
Knowledge of streaming technologies (Kafka, Spark Streaming, Structured Streaming).
Experience with workflow orchestration tools (Airflow, Oozie).
Familiarity with Delta Lake / Lakehouse architecture.
Exposure to NoSQL databases (MongoDB, Cassandra).
Knowledge of CI/CD and DevOps practices.

Education: MCA,MSc,MTech,BCA,BSc,BTech

• Preferred skills: Technology->AI-Data science->PYTHON,Technology->Big Data
• Data Processing->Spark->SparkSQL,Technology->Functional Programming->Scala