Back to listing

GCP Data Engineer

Talentmate

India

5th August 2026

2608-23162-7

Job Description

Build batch and streaming data ingestion pipelines using Pub/Sub, Dataflow, Datastream (CDC), and Storage Transfer Service
Load and ingest data into BigQuery via batch loads, the BigQuery Storage Write API and external/BigLake tables
Manage Cloud Storage (GCS) landing zones, buckets, lifecycle policies and storage classes
Develop ETL/ELT workflows using Dataflow (Apache Beam), Dataproc (Spark/Hadoop) and Dataprep
Build SQL-based transformations using Dataform and BigQuery scheduled queries
Implement medallion/layered architecture (raw → staging → curated/gold)
Design and optimize BigQuery data warehouses with partitioning, clustering, materialized views and cost controls
Orchestrate pipelines using Cloud Composer (Airflow) and Workflows
Schedule and automate jobs with Cloud Scheduler and Cloud Functions
Manage access and security using IAM, service accounts and Workload Identity Federation
Implement data governance, lineage and quality using Knowledge Catalog
Apply encryption (CMEK/CSEK, Cloud KMS), VPC Service Controls and DLP via Sensitive Data Protection
Ensure compliance with PII masking and column/row-level security in BigQuery
Enable analytics consumption through Looker, Looker Studio and BigQuery BI Engine
Monitor pipelines and resources with Cloud Monitoring, Cloud Logging, and Cloud Trace
Optimize query performance, slot usage, and overall cloud cost
Implement CI/CD using Cloud Build, Artifact Registry, and Cloud Source Repositories
Manage infrastructure-as-code using Terraform and Deployment Manager
Maintain version control, automated testing and pipeline reliability with alerting and SLAs

Job Details

Role Level:	Not Applicable	Work Type:	Full-Time
Country:	India	City:	Hyderabad ,Telangana
Company Website:	https://Pal.Tech/	Job Function:	Data Science & AI
Company Industry/ Sector:	IT Services and IT Consulting and Software Development

What We Offer

About the Company

Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.

Report

Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.