Lead Data Analyst L1

Job Title: GCP Data Architect

• Data Pipelines and Data Ops

Location: Offshore

Job Responsibilities:

• Data Architecture and Design:

• Lead the design and development of scalable and efficient data architectures on GCP, with a focus on data pipelines and Data Ops principles.

• Collaborate with cross-functional teams to understand business requirements and translate them into comprehensive data solutions.

• Experience in Data Products principles and designing Data API’s

• Data Ingestion considering System of Records, Systems of Engagement and Systems of Insight

• Data Pipelines Expertise:

• Design, implement, and optimize end-to-end data pipelines, ensuring seamless integration with various data sources and destinations.

• Implement data streaming and batch processing solutions to support real-time and batch analytics.

• Data Ops Implementation:

• Establish and maintain robust Data Ops processes to streamline the development, deployment, and monitoring of data pipelines.

• Implement version control, automated testing, and continuous integration practices for data pipelines.

• GCP Data Services Mastery:

• Possess advanced knowledge and hands-on experience with GCP data services, including Big Query, Dataflow, Dataprep, Dataproc, and other relevant tools.

• Stay updated on the latest GCP data services offerings and integrate new technologies into data pipeline architectures.

• Data Governance and Security:

• Implement and enforce data governance policies within the context of Data Ops, ensuring data integrity, security, and compliance.

• Collaborate with security and compliance teams to address any data security concerns in data pipeline processes.

• Collaboration and Leadership:

• Collaborate with data engineers, data scientists, and business stakeholders to understand their requirements and align data architectures with organizational goals.

• Provide technical leadership and mentorship to junior team members.

• Documentation and Best Practices:

• Maintain comprehensive documentation for data architectures, data pipeline processes, and configurations.

• Define and promote best practices for data pipeline development, deployment, and monitoring within the organization.

• Documenting Conceptual, Logical Data Models, data principles, data dictionaries, schema definition and Data API specifications

• Documenting UML Entity relationship diagrams with entity description, enumerations, payload structure and error response structures.

Qualifications:

• Bachelor’s degree in computer science, Information Technology, or a related field.

• Minimum of 10 years of hands-on experience with GCP data services, data engineering, and a focus on data pipelines and Data Ops.

• Proven experience in designing and implementing complex data architectures with a strong emphasis on data pipelines.

• Strong proficiency in SQL, Python, or other relevant programming languages.

• Excellent understanding of data modelling, ETL processes, and data warehousing.

• Experience with version control systems and CI/CD practices for data pipelines.

• Strong problem-solving and troubleshooting skills.

• Ability to communicate complex technical concepts to non-technical stakeholders effectively.

• Google Cloud Professional Data Engineer or Data Architect certification.

• Google Products on data like Big Query, Cloud Spanner, Cloud SQL

Preferred Qualifications:

• Experience with machine learning and AI technologies on the GCP platform.

• Familiarity with advanced analytics, data lakes, and streaming data architectures.

• Previous experience in financial services is a plus.

If you are a result driven GCP Data Architect with a focus on data pipelines and Data Ops practices, we invite you to apply for this exciting opportunity.

Bottom of Form: