Key Responsibilities:

• Data Integration: Integrating various data sources into a unified data warehouse or data lake using tools like Cloud Dataflow, Cloud Dataproc, and Cloud Pub/Sub.
• Data Pipeline Development: Creating and managing data pipelines to automate the movement and transformation of data.
• Data Storage Management: Selecting and managing appropriate storage solutions such as BigQuery, Cloud Storage, and Cloud SQL.
• Data Transformation: Transforming raw data into a format that can be easily analyzed using tools like Dataflow and Dataprep.
• Performance Optimization: Monitoring system performance, identifying bottlenecks, and implementing solutions to improve efficiency.
• Security and Compliance: Ensuring data security and compliance with regulations through best practices for data encryption, access control, and auditing.
• Collaboration and Communication: Working closely with other teams to ensure the integrity and usability of data.
• Proficiency in BigQuery, Cloud Dataflow, Dataproc, Pub/Sub, Cloud Functions, Cloud SQL, and Cloud Storage.
• Experience with Python and SQL for data processing and querying.
• Knowledge of Apache Beam for data processing.
• Strong understanding of cloud-native architectures and optimization strategies within GCP
• Familiarity with data governance frameworks and best practices for data security and compliance.