ADF Senior Technical Specialist

Job Summary

The Senior Technical Specialist will be responsible for overseeing and managing tasks related to Snowflake, Azure Data Factory (ADF), Data Bricks. The role involves working on complex data engineering projects, optimizing data pipelines, and ensuring data accuracy and reliability across platforms.

Key Responsibilities

1. Design, develop, and maintain data pipelines using snowflake, azure data factory (adf), data bricks.

2. Collaborate with data engineers and architects to implement data solutions and ensure data quality.

3. Optimize and troubleshoot data processes to improve efficiency and performance.

4. Develop and implement best practices for data security and compliance.

5. Provide technical expertise and guidance to cross functional teams on data related projects.

6. Stay informed about the latest advancements in data technologies and techniques.

Skill Requirements

1. Proficiency in snowflake, azure data factory (adf), and data bricks.

2. Strong experience in designing and implementing data pipelines.

3. Knowledge of data warehousing concepts and best practices.

4. Ability to optimize and finetune data processes for efficiency.

5. Familiarity with data security protocols and compliance standards.

6. Excellent problem-solving and analytical skills.

7. Strong communication and teamwork abilities.

Other Requirements

1.Relevant certifications in Snowflake, Azure Data Factory (ADF), or Data Bricks are a plus.

• Data Architecture
• Expertise in successful deployment of multiple completed complex technical projects.
• Experience in deployment of high-level design and architecture of the solution, including information modelling.
• Demonstrate ownership of technical solutions from design and architecture perspective for numerous data centric initiatives
• Robust experience with gathering end user requirements and writing technical documentation
• Review the architectural/ technological solutions for ongoing projects and ensure the right choice of solution.
• Page 2 of 7
• Work closely with CIDO, IT Domain and Business units to capture requirements, identify pain areas, and propose an ideal solution.
• Design, implement, and document data architecture, which includes the use of relational, dimensional, and NoSQL databases.
• Guarantee compliance with data governance and data security requirements while creating, improving, and operationalizing these integrated data approaches.
• Liaise with stakeholders in building trust in the data being used for decision making.
• Prepare architectural standards, guardrails, and best practices related to Data Integration / architecture. Consult about current / future industry trends and technology needs.

Extensive knowledge
 Data platforms – Fabric, Snowflake, CosmoDB, DataBricks, MongoDB, RDBMS
 Data replication/CDC – Qlik Replicate, Oracle Golden Gate
 Data modeling – ERStudio
 Message-oriented data movement
 API design and access
 Data Analytics and AL/ML - AzureML
 Data virtualization
 Streaming data
 Data integration and ETL / ELT Tools – Matillion, Alteryx, Qlik
 Power Bi
 Machine Learning, Generative AI and Agentic AI.
Strong experience
 Must have prior experience with end-to-end implementation of Cloud data technologies (i.e.Fabric, Snowflake).
 Expertise in data modelling, ELT and implementing complex stored Procedures.
 Expertise in various Snowflake technologies like Snowpark, Snow Pipe, Snow Pipe Stream, Dynamic Tables, Document AI, Cortex Analytics, Unistore etc.
 Expertise in Snowflake cost and query optimization including experience with Capital One Slingshot.
 Expertise in advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, Zero copy clone, time travel and understanding of how to use these features.
 Awareness in Data Migration from RDBMS, SAP systems, Salesforce, GIS, PI Historian to Snowflake.
 Deep understanding of relational as well as NoSQL data stores, methods, and approaches (star and snowflake, dimensional modelling and third normal form)
 Experience with data security and data access controls and design
 Deep understanding of SoX, GDPR and Regulatory/CNI control environments
 In-depth experience in providing resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface.
 Demonstrable ability to troubleshoot problems across infrastructure, platform, and application domains. Controlling access to the data and the reports
 Implementing Data security needs and implement security solutions
 Working with the business intelligence / analytics teams to gather requirements for the database design and model

Work experience in data disciplines including data integration, model optimization, and/or other areas directly relevant to data management.