Pyspark Developer

Job Description
Python, Py Spark, SPARK, Scala, Hadoop, Hive, Sqoop, Unix, Cloudera, MapR, ETLLead the team from offshore by owning project deliverables & provide technical oversight (For Tech Lead)

2. Experienced in architecting & Developing Big Data solutions (For Tech Lead)

3. Strong understanding of Big Data tools and Apache projects (For Tech Lead, Sr. Developer)

4. Good understanding on performance tuning on Big data technologies (For Tech Lead, Sr. Developer)

5 Good to have Python and Java background (For Tech Lead, Sr. Developer)

6 Experience in relational database and data warehousing concept

7 Well versed in Hive QL, Spark QL

8 Create ETL transformation using Hive, Spark

9 Support development team and testing team in implementing and testing the ETL respectively

10 Build data quality rule and orchestrate using in house framework

11 Work with Cloudera/Big Data support for root cause analysis and resolutions

12 Good team player and collaborate with other teams

Desired Candidate Profile
Qualifications :

BACHELOR OF ENGINEERING: