Data Engineer - GCP

Inclusion without Exception

Tata Consultancy Services (BSE: 532540, NSE: TCS) is the technology partner of choice for industry-leading organizations worldwide. Since its inception in 1968, TCS has upheld the highest standards of innovation, engineering excellence and customer service.

It has set an aspiration to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence.

Rooted in the heritage of the Tata Group, TCS is focused on creating long term value for its clients, its investors, its employees, and the community at large. With a highly skilled workforce spread across 56 countries and 194 service delivery centers across the world, the company has been recognized as a top employer in six continents. With the ability to rapidly apply and scale new technologies, the company has built long term partnerships with its clients. Many of these relationships have endured into decades and navigated every technology cycle, from mainframes in the 1970s to artificial intelligence today.

Role Description:

Experienced GCP Data Engineer with 8-10 years of expertise in designing, developing, and optimizing large-scale data platforms and cloud-native data solutions. Strong hands-on experience in PySpark, Python, BigQuery, Dataproc, Kafka, Airflow, SQL, and GCP services, with proven success in building scalable ETL/ELT pipelines, batch and real-time data processing frameworks, and enterprise data warehouse solutions. Adept at data modeli ng, performance tuning, cloud security, automation, and collaborating with cross-functional teams to deliver high-quality data solutions that support analytics, reporting, and business intelligence initiatives.

Key Skills & Responsibilities

1. Design and develop scalable ETL/ELT pipelines using PySpark, Python, and Spark SQL.

2. Build and optimize large-scale data processing solutions on GCP using Dataproc, BigQuery, and GCS.

3. Develop and maintain Kafka-based streaming pipelines for real-time data ingestion and processing.

4. Create, manage, and optimize BigQuery datasets, tables, views, stored procedures, and complex SQL queries.

5. Implement workflow orchestration and scheduling using Cloud Composer (Airflow).

6. Manage cloud security through IAM roles, service accounts, and access control policies following best practices.

7. Work extensively with Hive, Hadoop, Spark, and distributed data processing technologies.

8. Develop automation and monitoring solutions using Python and Shell scripting to improve operational efficiency.

9. Utilize Git, CI/CD pipelines, and Terraform for code management, deployment, and infrastructure automation.

10. Collaborate with Data Architects, DevOps teams, Data Scientists, and business stakeholders while providing production support, troubleshooting, and performance optimization.

Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodation during the recruitment and selection process, please inform Human Resources.

Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.

Location

Toronto, ON

Job Function

TECHNOLOGY

Role

Engineer

Job Id

427558

Desired Skills

GCP - IT Service Management Consulting