Lead GCP Data Engineer

18 hours ago

Gurgaon, Haryana, India i-Qode Digital Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Key Skills
  • Data GCP
  • Pyspark
  • Python

Lead experience: 2-4 Years



Technical Expertise
  • Data engineering: ETL/ELT, Spark, DBT
  • Infrastructure: GCP, Kubernetes/Docker
  • Tools: Airflow, BigQuery, Dataflow, Kafka/PubSub, Vertex AI, Jenkins/GitHub Actions
  • Programming languages: Python, SQL
  • Methods: dimensional modeling, OO


Responsibilities
  • Develop and maintain data models, transformations, and workflows using DBT to support analytics and reporting requirements.
  • Collaborate with data analysts, data engineers, and stakeholders to understand data needs and translate them into DBT models and transformations.
  • Optimize and enhance existing DBT processes for improved performance, reliability, and maintainability.
  • Ensure data quality and consistency by implementing data validation checks and monitoring data pipelines.
  • Document DBT models, transformations, and processes for knowledge sharing and future reference
  • Stay current with industry best practices and trends in data modelling, data warehousing, and analytics
  • Write efficient and well-organized software to ship products in an iterative, continual release environment
  • Contribute to and promote good software engineering practices across the team
  • Mentor and educate team members to adopt best practices in writing and maintaining production code
  • Communicate clearly and effectively to technical and non-technical audiences
  • Actively contribute to and re-use community best practices


Requirements
  • University or advanced degree in engineering, computer science, mathematics, or a related field
  • Proficiency in SQL and experience working with relational databases and NoSQL databases
  • Hands-on experience with DBT data modelling and transformation tools.
  • Strong understanding of data warehousing concepts and best practices.
  • Experience working with cloud-based data platforms such as Snowflake, BigQuery, or Redshift.
  • Strong experience working with big data tools: Big Data tech stack (Hadoop, Spark, Kafka etc.)
  • Experience with at least one cloud provider solution (AWS, GCP, Azure, GCP preferred)
  • Strong experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
  • Strong knowledge of data pipeline and workflow management tools
  • Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation
  • Experience creating Data pipelines that prepare data for ingestion & consumption appropriately
  • Experience in setting up, maintaining and optimizing databases/filesystems for production usage in reporting, analytics.
  • Experience with workflow orchestration (Airflow, Tivoli etc.)
  • Working knowledge of Git hub /Git Toolkit
  • Familiarity with analytics and visualization tools such as Looker, Tableau, or Power BI.
  • Experience working in an Agile development environment.

  • Lead GCP Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Impetus Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location:GurgaonExperience:8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers,...

  • Data Engineer-GCP

    16 hours ago

    Gurgaon, Haryana, India NucleusTeq Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Data Engineer – GCPRequired Skills: Python, PySpark, SQL, Airflow, GCP, BigdataYears of experience: 5+ YearsLocations: Gurgaon We are seeking skilled Data Engineers with experience in modern data engineering practices and data modeling. You will leverage your knowledge and experience in programming languages and data engineering tools to...

  • GCP Data Engineer

    6 hours ago

    Gurgaon, Haryana, India Impetus Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    QualificationNeed to hire GCP enabled Module Leads and Leads with proficiency on data engineering technologies and languages. These folks should be able to to drive and lead migration from On Prem to GCP for Amex use casesRole7-10 years of experience in the role of implementation of high end software products.Provides technical leadership in Big Data space...

  • GCP Data Engineer

    4 days ago

    Gurgaon, Haryana, India BT Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description: Data Engineer (Specialist)Platform: GCPPosition Overview:We are seeking a skilled and experienced GCP Data Engineer to join our team. As a GCP Data Engineer, you will be responsible for designing, implementing and maintaining our data infrastructure and pipelines on the Google Cloud Platform (GCP).Key Responsibilities:Design &...

  • Senior Data Engineer GCP Migration

    1 week ago

    Gurgaon, Haryana, India Xebia It Architects Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    Were Hiring: Senior Data Engineer GCP Migration | Gurgaon (Hybrid, 3 days office per week)Location: Gurgaon (Hybrid 3 days in office per week)Start Date: End of SeptemberExperience Level: 5+ years relevant Data Engineering experienceAbout the Role: We are looking for a highly skilled Senior Data Engineer to lead and support our strategic migration of data...

  • Statusneo - GCP Data Engineer

    11 hours ago

    Gurgaon, Haryana, India Nexthire Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company - Statusneo Position - GCP Data EngineerLocation - Gurgaon Experience - 3-9 years Job Summary:We are seeking a skilled GCP Data Engineer with over 3-9 years of experience to design, build, and maintain scalable data pipelines on Google Cloud Platform. The ideal candidate will have strong proficiency in SQL, Python, and BigQuery, with a bonus for...

  • GCP Big Data Engineer

    2 days ago

    Gurgaon, Haryana, India Acme Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for GCP Big Data Engineer who has skill set with Big Query and Airflow

  • Consultant – Cloud Data Engineer – GCP

    13 hours ago

    Gurgaon, Haryana, India Sirius AI Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design, develop, and manage scalable, secure, and efficient data pipelines on Google Cloud Platform (GCP) to process and transform large datasets from multiple sources.Implement and optimize GCP data services such as BigQuery, Cloud Storage, Cloud SQL, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.Architect and maintain ETL/ELT...

  • Senior/Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Lead Data EngineerAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Lead Data Engineer

    11 hours ago

    Gurgaon, Haryana, India RemoteStar Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Lead Data EngineerJob Location: Gurugram, Haryana, India Employment Type: Full Time Work Type: On-site 5 days a weekRole overview:As a Team Lead of Data Engineering, you'll drive the design, development, and optimization of our data engineering pipelines and services with a strong software engineering mindset. You'll also play a pivotal role in...