GCP data Engineer

4 weeks ago


Chennai, Tamil Nadu, India Wpp Groups Full time
Job Description

WPP is a world leader in marketing services, with deep AI, data and technology capabilities, global presence and unrivalled creative talent. Our clients include many of the biggest companies and advertisers in the world, including approximately 300 of the Fortune Global 500.

Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow.

Why we're hiring:

At WPP, technology is at the heart of everything we do, and it is WPP IT's mission to enable everyone to collaborate, create and thrive. WPP IT is undergoing a significant transformation to modernise ways of working, shift to cloud and micro-service-based architectures, drive automation, digitise colleague and client experiences and deliver insight from WPP's petabytes of data.

GroupM is the world's leading media investment company responsible for more than $63B in annual media investment through agencies Mindshare, MediaCom, Wavemaker, Essence and m/SIX, as well as the outcomes-driven programmatic audience company, Xaxis and data and technology company Choreograph. GroupM's portfolio includes Data & Technology, Investment and Services, all united in a vision to shape the next era of media where advertising works better for people. By leveraging all the benefits of scale, the company innovates, differentiates and generates sustained value for our clients wherever they do business.

The GroupM IT team in WPP IT are the technology solutions partner for the GroupM group of agencies and are accountable for co-ordinating and assuring end-to-end change delivery, managing the GroupM IT technology life-cycle and innovation pipeline.

This role will work as part of the Local Systems Team for EMEA. You will be part of a new team Data team in Chennai, that will support our existing and future BI setup for EMEA markets. You will be responsible for delivering the solutions formulated by product owners and key stakeholders for different EMEA markets. In collaboration with the Data development team, you update the architecture and data models to new data needs and changes in source systems.

What you'll be doing:

- Assist in the build, development, and management of custom databases/solutions using SSIS.
- Monitoring and optimizing data processing and storage resources on GCP.
- Clearly communicate technical terms to non-technical people and help them understand why change might be required to achieve a specific goal or to complete a project
- Design, build and deploy ETL and data management processes. Develop and deploy ETL job workflow with reliable error/exception handling and rollback framework.
- Monitoring and optimizing data processing and storage resources on GCP.
- Troubleshooting and resolving data pipeline issues and performance bottlenecks.
- Documenting data engineering processes, best practices, and technical specifications.
- Conform to agile development practices Evolutionary design, refactoring, continuous integration/delivery, test-driven development.
- Work collaboratively with Business Partner Team and Business Stakeholder during projects scoping and feasibility phases as a SME for concept investigation/viability and technical impact; Identify and communicate technical risks and mitigations.
- Provide production support for data load jobs.
- Write customized query to generate automatic periodic reports.
- Build applications writing SQL scripts to manipulate data and / or writing specific instructions for an off-shore programmer to write the scripts.
- Maintain or upgrade existing applications.
- Attend key design meetings and provide support.
- Other ad hoc duties.
-

What you'll need:

- 2+ years experience with creating and managing SSIS and writing TSQL (views/functions/stored procedures).
- 3+ years experienced engineer who has worked on GCP environment and its relevant tools/services. (Big Query, Data Proc, Data flow, Workflows, Cloud Storage, Terraform, Cloudrun , Cloud scheduler, Astronomer/Airflow)
- 1 or 2 + years of strong experience in Python development (Object oriented/Functional Programming, Pandas, Pyspark etc)
- 1 or 2 + years of strong experience in SQL Language (CTEs, Window functions, Aggregate functions etc)
- Good to have DBT knowledge
- Experience with major RDBMS systems like MS-SQL, Oracle, PostgreSQL, Teradata etc
- Hands-on with GitHub or equivalent source control repositories
- Bachelor's degree in Computer Science, Engineering, Mathematics or other technical field is highly preferred.
- Experience with data modeling, and working with star schema
- Experience with the full development life cycle of an application stack - from architecture through test and deployment.
- Demonstrated experience in data warehouse analysis and design, with full knowledge of data warehouse methodologies and data modelling.
- Unit testing low level components SQL scripts, Stored Procedures, ETL modules; Integration testing data transition points; Performance, load and stress testing.
- Knowledge and experience in software development methodology and toolset for implementing, lifecycle and management Agile methodology.
- TFS/GIT code repository and branching strategies; Microsoft Release Management and any deployment tools; Jira knowledge.
- Team player
- Organized and detail oriented
- Excellent communication, presentation, and writing skills
  • GCP Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring GCP Data Engineer Position: GCP Data EngineerJob Location: Chennai/Bangalore/Hyderabad/Gurugram/PuneExperience : 10-12 yearsInterested professionals kindly apply through the link.Must Have:Proficiency in programming languages: Python, Java- Expertise in data processing frameworks: Apache Beam (Data Flow)-...

  • GCP Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services We are hiring GCP Data Engineer Position: GCP Data Engineer Job Location: Chennai/Bangalore/Hyderabad/Gurugram/Pune Experience : 10-12 years Interested professionals kindly apply through the link. Must Have: Proficiency in programming languages: Python, Java - Expertise in data processing frameworks: Apache...

  • GCP Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Location- Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience- 10-12 years Requirements: - Proficiency in programming languages: Python, Java - Expertise in data processing frameworks: Apache Beam (Data Flow) - Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT etc., - Data...

  • GCP Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Location- Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience- 10-12 years Requirements: - Proficiency in programming languages: Python, Java - Expertise in data processing frameworks: Apache Beam (Data Flow) - Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT etc., - Data...


  • Chennai, Tamil Nadu, India Qode Full time US$ 90,000 - US$ 1,20,000 per year

    Data Engineer Location: Chennai, India or Hyderabad, India Workplace Type: HybridAbout the RoleWe are seeking a highly motivated and experienced Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining our data infrastructure on Google Cloud Platform (GCP). You will work closely with data...

  • GCP Data Engineer

    1 day ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Greetings from TCS.TCS is Hiring For GCP Data EngineerExperience: 10 to 14yrsLocation: Chennai, Pune, Bangalore , Hyderabad and GurugramJob Description:Bigquery / DataProc - handon 5yrs +Google Cloud Storage - handon 5yrs +Pub sub / Cloud Data flow - handon 5yrs +

  • GCP Data Engineer

    4 days ago


    Chennai, Tamil Nadu, India Qode Full time US$ 1,20,000 - US$ 2,00,000 per year

    Data Engineer Location: Chennai, India or Hyderabad, India Workplace Type: HybridRequired Skills & QualificationsBachelor's degree in Computer Science, Engineering, or a related field. 5-7 years of experience in data engineering. Strong proficiency in Python programming. Extensive experience with GCP services, including Dataflow, Dataproc, BigQuery, Cloud...

  • GCP Data Engineer

    3 days ago


    Chennai, Tamil Nadu, India Qode Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Data Engineer Location: Chennai, India or Hyderabad, India Workplace Type: Hybrid Required Skills & QualificationsBachelor's degree in Computer Science, Engineering, or a related field. 5-7 years of experience in data engineering. Strong proficiency in Python programming. Extensive experience with GCP services, including Dataflow, Dataproc, BigQuery, Cloud...


  • Chennai, Tamil Nadu, India Getronics Full time

    Greeting from Getronics We have multiple opportunities for Senior GCP Data Engineers for our automotive client in Chennai Location. Position Description: Data Analytics team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analysing and manipulating large...


  • Chennai, Tamil Nadu, India Getronics Full time

    Greeting from GetronicsWe have multiple opportunities for Senior GCP Data Engineers for our automotive client in Chennai Location.Position Description:Data Analytics team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analysing and manipulating large datasets...