Lead GCP Data Engineer

3 hours ago

Gurgaon, Haryana, India i-Qode Digital Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Key Skills
  • Data GCP
  • Pyspark
  • Python

Lead experience: 2-4 Years



Technical Expertise
  • Data engineering: ETL/ELT, Spark, DBT
  • Infrastructure: GCP, Kubernetes/Docker
  • Tools: Airflow, BigQuery, Dataflow, Kafka/PubSub, Vertex AI, Jenkins/GitHub Actions
  • Programming languages: Python, SQL
  • Methods: dimensional modeling, OO


Responsibilities
  • Develop and maintain data models, transformations, and workflows using DBT to support analytics and reporting requirements.
  • Collaborate with data analysts, data engineers, and stakeholders to understand data needs and translate them into DBT models and transformations.
  • Optimize and enhance existing DBT processes for improved performance, reliability, and maintainability.
  • Ensure data quality and consistency by implementing data validation checks and monitoring data pipelines.
  • Document DBT models, transformations, and processes for knowledge sharing and future reference
  • Stay current with industry best practices and trends in data modelling, data warehousing, and analytics
  • Write efficient and well-organized software to ship products in an iterative, continual release environment
  • Contribute to and promote good software engineering practices across the team
  • Mentor and educate team members to adopt best practices in writing and maintaining production code
  • Communicate clearly and effectively to technical and non-technical audiences
  • Actively contribute to and re-use community best practices


Requirements
  • University or advanced degree in engineering, computer science, mathematics, or a related field
  • Proficiency in SQL and experience working with relational databases and NoSQL databases
  • Hands-on experience with DBT data modelling and transformation tools.
  • Strong understanding of data warehousing concepts and best practices.
  • Experience working with cloud-based data platforms such as Snowflake, BigQuery, or Redshift.
  • Strong experience working with big data tools: Big Data tech stack (Hadoop, Spark, Kafka etc.)
  • Experience with at least one cloud provider solution (AWS, GCP, Azure, GCP preferred)
  • Strong experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
  • Strong knowledge of data pipeline and workflow management tools
  • Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation
  • Experience creating Data pipelines that prepare data for ingestion & consumption appropriately
  • Experience in setting up, maintaining and optimizing databases/filesystems for production usage in reporting, analytics.
  • Experience with workflow orchestration (Airflow, Tivoli etc.)
  • Working knowledge of Git hub /Git Toolkit
  • Familiarity with analytics and visualization tools such as Looker, Tableau, or Power BI.
  • Experience working in an Agile development environment.

  • Lead GCP Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Impetus Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location:GurgaonExperience:8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers,...

  • Data Engineer-GCP

    1 hour ago

    Gurgaon, Haryana, India NucleusTeq Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Data Engineer – GCPRequired Skills: Python, PySpark, SQL, Airflow, GCP, BigdataYears of experience: 5+ YearsLocations: Gurgaon We are seeking skilled Data Engineers with experience in modern data engineering practices and data modeling. You will leverage your knowledge and experience in programming languages and data engineering tools to...

  • GCP Big Data Engineer

    1 day ago

    Gurgaon, Haryana, India Acme Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for GCP Big Data Engineer who has skill set with Big Query and Airflow

  • Senior/Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Lead Data EngineerAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Power BI-GCP Integration

    3 days ago

    Gurgaon, Haryana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Perform detailed design of application and technical architecture components. Configure, program, and test application or technical architecture components. Identify and resolve defects and performance issues in integration solutions. Ensure timely delivery and accountability for service commitments at the individual request level for in-scope applications....

  • Lead Consultant, GCP Senior Engineer

    1 week ago

    Gurgaon, Haryana, India Genpact Full time US$ 55,000 - US$ 68,500 per year

    Genpact (NYSE\: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Big Data + GCP Engineer

    3 days ago

    Gurgaon, Haryana, India Impetus Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Gurugram, Haryana, India; Bangalore, Karnataka, IndiaQualification:Must have : Bigdata ,GCPRoles And Responsibilities :Must have : Bigdata ,GCP, Dataproc, Dataflow, SQL, SparkExperience:3 to 12 yearsJob Reference Number:13154Skills Required:Big DataRole:Must have : Bigdata ,GCP

  • Gcp Data Engineer_Immediate Joiners Preferred

    5 days ago

    Gurgaon, Haryana, India Niftel Communications Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    GCP Data EngineerExp :  5+ years of ExperienceYears of Minimum Relevant : 3+ Years in data engineering.Mandatory Skills :Python, GCP, Bigquery, SQL, RBAC, etl, Data Warehousing,Good to have: Data structures and algorithms Looker(BI tool)

  • Senior Data Engineer

    1 week ago

    Gurgaon, Haryana, India Pacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST)Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Senior DevOps Engineer

    2 days ago

    Gurgaon, Haryana, India NTT DATA Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Req ID: 347832NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior DevOps Engineer - GCP Infrastructure & Networking to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). ...