
Data Engineer-Data Platforms-Google - 4
ポジションについて
As a Data Engineer specializing in Google's data platforms, you will design, build, and maintain data engineering solutions on Google's Cloud ecosystem. You will utilize various Google services to develop batch and real-time data pipelines, manage data migration, and design data layers.
Your primary responsibilities will include:
-
Design Data Pipelines: Design and build data pipelines using Google Data Proc, Data Flow, Pub Sub, Big Query, and other Google services to meet business requirements.
-
Develop Data Engineering Solutions: Utilize Google Cloud Storage, Big Table, Big Query Data Proc with Spark and Hadoop, and Google Data Flow with Apache Beam or Python to develop and manage data engineering solutions.
-
Manage Data Platforms: Schedule and manage the data platform using Google Cloud Scheduler and Cloud Composer (Airflow) to ensure seamless data pipeline operations.
-
Ensure Data Quality: Develop and manage batch and real-time data pipelines for Data Warehouse and Datalake to ensure high-quality data delivery.
-
Optimize Data Solutions: Collaborate with stakeholders to optimize data solutions and ensure alignment with business objectives.
This position can be performed from anywhere in the United States of America.
