Only 24h Left) Lead Data Engineer

4 weeks ago


Mumbai, Maharashtra, India dentsu Full time
Job Description

The Lead GCP Data Engineer will design, implement, and maintain scalable, reliable, and efficient data solutions on Google Cloud Platform (GCP). The role focuses on enabling data-driven decision-making by developing ETL/ELT pipelines, managing large-scale datasets, and optimizing data workflows. The ideal candidate is a proactive problem-solver with strong technical expertise in GCP, a passion for data engineering, and a commitment to delivering high-quality solutions aligned with business needs

Job Description:

Key Responsibilities:

Data Engineering & Development:

- Design, build, and maintain scalable ETL/ELT pipelines for ingesting, processing, and transforming structured and unstructured data.
- Implement enterprise-level data solutions using GCP services such as BigQuery, Dataform, Cloud Storage, Dataflow, Cloud Functions, Cloud Pub/Sub, and Cloud Composer.
- Develop and optimize data architectures that support real-time and batch data processing.

Cloud Infrastructure Management:

- Manage and deploy GCP infrastructure components to enable seamless data workflows.
- Ensure data solutions are robust, scalable, and cost-effective, leveraging GCP best practices.

Collaboration and Stakeholder Engagement:

- Work closely with cross-functional teams, including data analysts, data scientists, DevOps, and business stakeholders, to deliver data projects aligned with business goals.
- Translate business requirements into scalable, technical solutions while collaborating with team members to ensure successful implementation.

Quality Assurance & Optimization:

- Implement best practices for data governance, security, and privacy, ensuring compliance with organizational policies and regulations.
- Conduct thorough quality assurance, including testing and validation, to ensure the accuracy and reliability of data pipelines.
- Monitor and optimize pipeline performance to meet SLAs and minimize operational costs.

Qualifications and Certifications:

- Education:

- Bachelors or masters degree in computer science, Information Technology, Engineering, or a related field.

- Experience:

- Minimum of 5 years of experience in data engineering, with at least 3 years working on GCP cloud platforms.
- Proven experience designing and implementing data workflows using GCP services like BigQuery, Dataform, Cloud Dataflow, Cloud Pub/Sub, and Cloud Composer.

- Certifications:

- Google Cloud Professional Data Engineer certification preferred.

Key Skills:

- Mandatory Skills:

- Advanced proficiency in Python for data pipelines and automation.
- Strong SQL skills for querying, transforming, and analyzing large datasets.
- Expertise in GCP services such as BigQuery, Dataform, Cloud Functions, Cloud Storage, Dataflow, and Kubernetes (GKE).
- Hands-on experience with CI/CD tools like Jenkins, Git, or Bitbucket for automation, deployment, and version control.
- Familiarity with workflow orchestration tools like Apache Airflow or Cloud Composer.

- Nice-to-Have Skills:

- Experience with other cloud platforms like AWS or Azure.
- Knowledge of data visualization tools (e.g., Looker, Tableau).
- Understanding of machine learning workflows and their integration with data pipelines.

Soft Skills:

- Strong problem-solving and critical-thinking abilities.
- Excellent communication skills to collaborate with technical and non-technical stakeholders.
- Proactive attitude towards innovation and learning.
- Ability to work independently and as part of a collaborative team.

Location:

Bengaluru

Brand:

Merkle

Time Type:

Full time

Contract Type:

Permanent

  • Mumbai, Maharashtra, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...


  • Mumbai, Maharashtra, India Sixer - Powered by Dream Sports Full time

    Job DescriptionAbout SixerSixer is an innovative online platform that enables cricket fans to experience the excitement of trading cricket players. By tracking player performance, our revolutionary fantasy game allows you to build a portfolio of players and watch as their value fluctuates based on their on-field success. Sixer is transforming fan engagement...


  • Mumbai, Maharashtra, India Procter & Gamble Full time

    Job Location MUMBAI GENERAL OFFICE Template Data AnalystOverview of the jobData Analyst P G IndiaThis role reports to Director India Data Platforms P GAbout India Data Solutions Team We take pride in managing the most-valuable asset of company in Digital World called Data Our vision is to deliver Data as a competitive advantage for India Business by...


  • Mumbai, Maharashtra, India Neksoft Consultancy Services Full time

    Job DescriptionJob Title: Pinecone Database EngineerLocation: MumbaiJob Overview:As a Staff Software Engineer on the Pinecone Database team, you will play a key role in developing our core database engine. You will be involved in the entire development cycle, from designing and implementing database components to deploying and optimizing them in production....


  • Mumbai, Maharashtra, India Jones Lang LaSalle Full time

    JLL empowers you to shape a brighter way Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world class services advisory and technology for our clients We are committed to hiring the best most talented people and empowering them to thrive grow meaningful careers and to find a place where they...


  • Mumbai, Maharashtra, India S&P Global Full time

    About the Role Grade Level for internal use 08The Team The S P Global Ratings Data and Content Management team is a team tasked with unlocking data delivering content to our analysts and customers The team acts as the main point of engagement with our customers on projects including analytical partners to discover and drive new and enhanced content...


  • Mumbai, Maharashtra, India Tech Consulting Full time

    Job Requirements:• 8+ years of professional experience in the IT industry.• Bachelor's degree in computer science, Information Technology, or a related field.• Fluent in English (written/spoken).• Expertise in backend programming using Python and Scala (Java or C++ is a plus).• Strong SQL skills, including aggregate/window functions, stored...


  • Mumbai, Maharashtra, India Jones Lang LaSalle Full time

    JLL empowers you to shape a brighter way Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world class services advisory and technology for our clients We are committed to hiring the best most talented people and empowering them to thrive grow meaningful careers and to find a place where they...


  • Mumbai, Maharashtra, India Cisco Full time

    Job DescriptionWe are seeking a Solutions Engineer - Artificial Intelligence (AI) to join our dynamic sales team. As an SE (AI), you will drive the adoption of our AI solutions across various industries. You will identify potential clients, understand their specific needs, and provide tailored AI solutions that enhance their business operations. This role...


  • Mumbai, Maharashtra, India Ground Zero Full time

    Program Lead - Swayamshree Mumbai Experience 12 years Salary Up to 40 LPAProject Overview Org is launching a project to empower aspiring women entrepreneurs including individuals and members of Self-Help Groups SHGs and SHG Federations by fostering an environment conducive to their proactive participation in local economic development This...


  • Mumbai, Maharashtra, India NTT DATA Global Delivery Services Limited Full time

    Job DescriptionWe are seeking a highly skilled Technical Services Implementation Engineer (L1) to join our team at N TT DATA Global Delivery Services Limited. As a key member of the Technical Services Implementation Engineering team, you will play a critical role in executing configurations, installations, and resolving break/fix events deemed less complex...


  • Mumbai, Maharashtra, India Care infotech Full time

    Job DescriptionCare Infotech, a leading name in IT Services and IT Consulting, is seeking a skilled Mac Engineer to join our dynamic team. As a Mac Engineer, you will be responsible for the deployment, configuration, and maintenance of Mac systems within our organization. Your expertise will be crucial in ensuring seamless integration, optimal performance,...


  • Mumbai, Maharashtra, India Netcore Cloud Full time

    Job DescriptionJob Title: Senior Software Engineer Production SupportExperience: 7 to 10 yearsJob Description:We are seeking a highly skilled Senior Software Engineer Production Support with 7 to 10 years of experience to join our dynamic team in Thane, Maharashtra. The ideal candidate will have strong debugging skills for production applications, expertise...


  • Navi Mumbai, Maharashtra, India Jacobs Full time

    Job DescriptionAt Jacobs, we're challenging today to reinvent tomorrow by solving the world's most critical problems for thriving cities, resilient environments, mission-critical outcomes, operational advancement, scientific discovery and cutting-edge manufacturing, turning abstract ideas into realities that transform the world for good.Your impactYour...


  • Mumbai, Maharashtra, India VABA Aluminium Formwork System Full time

    Company DescriptionVABA Aluminium Formwork System specializes in structural concrete formwork engineering and design services for construction projects across India. The company offers proprietary, custom, and job-built formwork systems and collaborates closely with clients to plan cost-effective and secure solutions. Their experienced formwork engineers...


  • Mumbai, Maharashtra, India 7 HR CONSULTING AND SERVICES Full time

    Job DescriptionMANAGER OR SR MANAGER - DESIGN & DEVELOPMENT (FACTORY ELECTRONICS)Job Description:Expertise with product Design & Development, Concept Design and hands on calculation of the design.Develop the electrical components considering cost & safety.To complete electrical deliverable like wiring diagram, bill of material, PLC programing, logic,...

  • Only 24h Left Director

    24 hours ago


    Mumbai, Maharashtra, India The Edge Partnership Full time

    Our client is an international financial services provider engaged in personal banking credit cards corporate and investment banking and wealth management with an extensive presence in Europe the Americas Africa and Asia Actively seeking an experienced individual to be part of their Finance Control team primarily responsible for Financial Accounting ...

  • Only 24h Left Head

    2 weeks ago


    Mumbai, Maharashtra, India Welspun Corp Limited Full time

    The Head of Estimation is responsible for leading the estimation department, overseeing cost estimation for projects, and ensuring accurate and competitive bid proposals. This role involves analyzing project requirements, developing cost estimates, managing estimation teams, and collaborating with various departments to optimize project feasibility and...


  • Mumbai, Maharashtra, India Salesforce Full time

    Job DescriptionJob descriptionWe have an outstanding opportunity for an expert Solutions Engineer to work with our outstanding Financial Services customers in crafting ground-breaking customer engagement roadmaps demonstrating the Salesforce applications and platform in Mumbai, India The successful applicant will have a track record of working with financial...


  • Mumbai, Maharashtra, India EisnerAmper Full time

    Job DescriptionJob DescriptionAt EisnerAmper, we look for individuals who welcome new ideas, encourage innovation, and are eager to make an impact. Whether you're starting out in your career or taking your next step as a seasoned professional, the EisnerAmper experience is one-of-a-kind. You can design a career you'll love from top to bottom we give you the...