Sr. Consultant (Airflow Support)

• India is among the top ten priority markets for General Mills, and hosts our Global Shared Services Centre. This is the Global Shared Services arm of General Mills Inc., which supports its operations worldwide. With over 1,300 employees in Mumbai, the center has capabilities in the areas of Supply Chain, Finance, HR, Digital and Technology, Sales Capabilities, Consumer Insights, ITQ (R&D & Quality), and Enterprise Business Services. Learning and capacity-building is a key ingredient of our success. Job Overview Digital & Technology team is an integral part of the General Mills growth strategy. We are building capabilities that will help shape the future as we aspire to be the undisputed leader in food and lead CPG in Digital, Data and Analytics. We have exciting opportunity for Airflow Engineers to work with General Mill’s various Advanced Data & Analytics teams and partner to achieve required business outcomes by transforming, simplifying, integrating and managing our data technologies ion cloud. We are looking for someone with an extensive experience to author workflows as directed acyclic graphs (DAGs) of tasks with Airflow or similar other workflow management tools. You should have prior experience or willing to learn workflow orchestration for programmatically authoring, scheduling, and monitoring workflows and be responsible for managing the GMI Airflow platform. Primary responsibilities include operational excellence, consultation, optimization and implementation. Desired Profile Education Minimum Degree Requirements: Bachelors Preferred Degree Requirements: Masters Preferred Major Area of Study: Computers Experience Minimum years of related experience required: 7 Preferred years of related experience: 9 Specific Job Experience or Skills Needed Responsibilities
• Installing/ configuring/ supporting Apache Airflow.
• Stay up to date with the Airflow open-source community enhancements.
• Planning the installation, upgrades & configurations of Airflow.
• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements by automating manual processes, optimizing data delivery for greater scalability, etc.
• Work with stakeholders including the Product, Data & Analytics teams and support their data infrastructure needs. Qualifications
• Overall 7+ years of experience with minimum 1 year of experience on Apache Airflow in a recent projects
• Experience with Orchestrating the Airflow / workflow in a hybrid cloud environment
• Experience in developing guidelines for Airflow clusters and DAG's.
• Working knowledge of performance tuning of the DAG's and task implementation
• Experience in developing DAG - data pipeline to on-board and change management of datasets
• Experience with installing, configuring and monitoring Airflow cluster
• Understanding of airflow rest services and integration of airflow of platform eco-system
• Experience working with relational databases, Hadoop, Google Big Query and No SQL databases.
• Experience working closely with Data Engineers and Advanced Analytics teams
• Good communication and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.

Required Skills:

• Workflow Management: Apache Airflow
• Database Platform experience
• Software Development experience
• DevOps CI/CD experience
• Familiarity with Agile methodologies
• Familiarity with modern Software Engineering principles.

Desired Skills:

• Big Data: Hadoop, Spark, Kafka, Google Big Query
• RDBMS: Experience with SQL/Oracle and/or NoSQL databases
• Workflow Management: Google Cloud Composer
• Cloud: Google cloud platform (GCP)
• Scripting Languages: Python, Scala
• Familiarity with Data & Analytics concepts and tools.
• Ability to manage multiple priorities in a dynamic environment.
• Strong aptitude to learn and passion for problem solving.
• Comfortable with cross-functional and collaborative team-work. Competencies/Behaviors required for job Technical Competencies
• Lead cultural change for adoption of new technologies
• Develop and coordinate workflow strategy
• Own the technical/product road map for Airflow, Cloud Composer and participate in the transformation process by identify the likely approaches and platforms that will be used
• Review upgrade/migration projects
• Translation of strategy and architecture into a highly available and secure technical implementation, in accordance with best practices
• Continuous support of, and collaboration with, other data engineer, data and analytics teams and projects Leadership Competencies
• Continuous Improvement of team processes
• Industry Trends
• Promote best practices,
• Regular communication to stake holders Troubleshooting competencies
• Troubleshoot complex problems impacting individual applications COMPANY OVERVIEW We exist to make food the world loves. But we do more than that. Our company is a place that prioritizes being a force for good, a place to expand learning, explore new perspectives and reimagine new possibilities, every day. We look for people who want to bring their best — bold thinkers with big hearts who challenge one other and grow together. Because becoming the undisputed leader in food means surrounding ourselves with people who are hungry for what’s next.