Lead GCP Data Engineer

1 week ago

PuneGurgaonGurugram, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

Location :
Pune, Gurgaon

Experience : 8 to 10 year

Notice period :
Immediate to 15 Days

Job Description :

Skills :

  • 8+ years of proven experience as a Lead in Big Data Engineering.


 Mandatory Technical Proficiency
  • Handson experience with Python, PySpark, Google Cloud Full Stack, SQL, DevOps, Databricks, DBT & Terraform.
  • Experience with Google Cloud Services such as Streaming +Batch, Cloud Storage, Cloud Dataflow, Data Proc, Big Query & Big Table
  • Proven realtime exposure and use of contemporary data mining, cloud computing, and data management ecosystems like Google Cloud, Hadoop, HDFS, and Spark.
  • Proficient in Data Modelling that can represent complex data structures while ensuring accuracy, consistency, and efficiency; data warehousing, and ETL processes.
  • Ability to perform system analysis and assessment of existing Systems Design and operating methodologies leveraging indepth knowledge of big data technologies and ecosystems.
  • Experience with GitHub, Anaplan, Looker & Power BI,
  • Excellent problemsolving skills and the ability to address complex technical challenges.
  • Strong communication and leadership skills.

Highly Desired :

  • Experience with Apigee, Apollo GraphQL.
  • Experience with Quality Assurance, Agile, Documentation & Presentation.
  • Experience with serverless Data warehousing concepts,
  • Knowledge of Snowflake, ML
  • Machine Learning, Gen AI (LLMs), Marketing activation.

Role & Responsibilities :

  • Accountable for overall technical implementations and management of respective engineering POD
  • Liaise with Foundry on solutions design; Agile Project Manager on planning & estimation; Engineers on task assignment; Business stakeholders on prioritization
  • Streamline workflows and orchestrate Data pipelines.
  • Automate deployments and facilitate MTQ/MTP through CI-CD/DevOps
  • Conduct code reviews, automate regression tests, and facilitate data reloads.
  • Participate in requirements gathering and architectural discussions.
  • Responsible for the Overall Quality of Engineering builds and Architecture.
  • Technical Leadership : Lead creation of technical design/specifications and provide technical leadership and guidance to development teams, promoting best practices. Provide expertise in Master Data Management, Reference Data Management, Data Quality, Meta Data Management, and Data Governance in General.
  • Programming Hands on : Develop and maintain software components using Python, PySpark, and GCP services to process and analyze large datasets efficiently. Build data pipelines and perform data transformations.
  • Enforce consistent standards and quality through endtoend review of all artifacts (incl. BRD, HLD, LLD, Data Models, STTMs, UI-UX, NFRs, Code, Test, PBI architecture design)
  • POC and Pilot of new reusable frameworks, tools & technologies.
  • Evaluate the newest technologies for optimization opportunities and future enhancement needs like selfserve and ad hoc reporting. Implement necessary infrastructure for optimal and efficient ETL from disparate data.
  • Performance Optimization : Identify and address performance bottlenecks, ensuring the system meets required throughput and latency targets.
  • Security and Compliance : Ensure that data solutions adhere to security and compliance standards, implementing necessary controls and encryption mechanisms.
  • Scalability : Architect scalable and highly available data solutions, considering both batch and realtime processing.
  • Documentation : Create and maintain comprehensive technical documentation to support the development and maintenance of data solutions.

Education :

  • Bachelor's degree in computer science, Software Engineering, MIS or Equivalent combination of Education and Experience
)

  • GCP Data engineering Lead

    1 week ago

    Pune, India Evonence Full time

    Company DescriptionEvonence is a Google Cloud partner company founded in 2014 and located in Pune. As one of the fastest-growing partners in the Google Cloud ecosystem, we provide Google Cloud solutions specifically tailored to the mid-market across North America. With a customer base of over 1000 clients, we have deep technical expertise in Google...

  • Gcp Data Engineering Lead

    1 week ago

    Pune, Maharashtra, India Evonence Full time

    Company Description Evonence is a Google Cloud partner company founded in 2014 and located in Pune.As one of the fastest-growing partners in the Google Cloud ecosystem, we provide Google Cloud solutions specifically tailored to the mid-market across North America.With a customer base of over 1000 clients, we have deep technical expertise in Google Workspace,...

  • GCP Data engineering Lead

    1 week ago

    Pune, India Evonence Full time

    Company DescriptionEvonence is a Google Cloud partner company founded in 2014 and located in Pune. As one of the fastest-growing partners in the Google Cloud ecosystem, we provide Google Cloud solutions specifically tailored to the mid-market across North America. With a customer base of over 1000 clients, we have deep technical expertise in Google...

  • GCP Data engineering Lead

    1 week ago

    Pune, India Evonence Full time

    Company DescriptionEvonence is a Google Cloud partner company founded in 2014 and located in Pune. As one of the fastest-growing partners in the Google Cloud ecosystem, we provide Google Cloud solutions specifically tailored to the mid-market across North America. With a customer base of over 1000 clients, we have deep technical expertise in Google...

  • GCP Data engineering Lead

    1 week ago

    pune, India Evonence Full time

    Company Description Evonence is a Google Cloud partner company founded in 2014 and located in Pune. As one of the fastest-growing partners in the Google Cloud ecosystem, we provide Google Cloud solutions specifically tailored to the mid-market across North America. With a customer base of over 1000 clients, we have deep technical expertise in Google...

  • Lead GCP Data Engineer

    1 week ago

    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description Have : 7+ years of experience in the Software and IT industry 4 + years of relevant work experience in GCP cloud data engineering Hands on in one of the programming languages like Python / Scala/ Java Collaborate with clients to understand business requirements and translate them into technical solutions on GCP. Experience in migrating...

  • Lead GCP Data Engineer

    3 weeks ago

    pune, India EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Lead GCP Data Engineer

    3 weeks ago

    Pune, India EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Lead GCP Data Engineer

    4 weeks ago

    Pune, India EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Lead GCP Data Engineer

    4 weeks ago

    Pune, India EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Lead GCP Data Engineer

    3 weeks ago

    Pune, India EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Lead GCP Data Engineer

    3 weeks ago

    Pune, India EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Lead GCP Data Engineer

    3 weeks ago

    Pune, India EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Senior or Lead Data Engineer with GCP

    1 week ago

    Pune, Maharashtra, India PURVIEW Full time

    Role: Lead Data Engineer with GCPLocation: Pune or Hyderabad (Onsite)Job Type: Contract (Permanent to Purview Services)Experience Level - 6+ YearsNOTE: Client will accept immediate joiners or serving notice period candidates only.Job description:Technical leadership for a team of engineers that focus on development, deployment and operationsLead and...

  • Lead GCP Data Engineer

    2 months ago

    Gurgaon,Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description Have : 7+ years of experience in the Software and IT industry 4 + years of relevant work experience in GCP cloud data engineering Hands on in one of the programming languages like Python / Scala/ Java Collaborate with clients to understand business requirements and translate them into technical solutions on GCP. Experience in migrating...

  • Senior or Lead Data Engineer with GCP

    16 hours ago

    Pune, India PURVIEW Full time

    Role: Lead Data Engineer with GCPLocation: Pune or Hyderabad (Onsite)Job Type: Contract (Permanent to Purview Services)Experience Level - 6+ YearsNOTE: Client will accept immediate joiners or serving notice period candidates only.Job description:Technical leadership for a team of engineers that focus on development, deployment and operationsLead and...

  • Senior or Lead Data Engineer with GCP

    1 week ago

    pune, India PURVIEW Full time

    Role: Lead Data Engineer with GCP Location: Pune or Hyderabad (Onsite) Job Type: Contract (Permanent to Purview Services) Experience Level - 6+ Years NOTE: Client will accept immediate joiners or serving notice period candidates only. Job description: Technical leadership for a team of engineers that focus on development, deployment and operations Lead...

  • Senior or Lead Data Engineer with GCP

    1 week ago

    Pune, India PURVIEW Full time

    Role: Lead Data Engineer with GCPLocation: Pune or Hyderabad (Onsite)Job Type: Contract (Permanent to Purview Services)Experience Level - 6+ YearsNOTE: Client will accept immediate joiners or serving notice period candidates only.Job description:Technical leadership for a team of engineers that focus on development, deployment and operationsLead and...

  • Senior or Lead Data Engineer with GCP

    1 week ago

    Pune, India PURVIEW Full time

    Role: Lead Data Engineer with GCPLocation: Pune or Hyderabad (Onsite)Job Type: Contract (Permanent to Purview Services)Experience Level - 6+ YearsNOTE: Client will accept immediate joiners or serving notice period candidates only.Job description:Technical leadership for a team of engineers that focus on development, deployment and operationsLead and...

  • GCP Data Engineer

    3 weeks ago

    Pune, India LTIMindtree Full time

    Job Title: GCP Sr. Data Engineer Experience: 5-12 years Education: Bachelor of engineering in any discipline/equivalent Location: Bangalore, Chennai, Mumbai, Pune, Kolkata, Hyderabad, DelhiDesired Candidate Profile Job Description: Overall, more than 5+ Yrs of experience in Data projects. Good Knowledge of GCP Bigquery, SQL, Python, dataflow skills. Has...