Urgent Search Lead Data Engineer

4 weeks ago


Pune, Maharashtra, India TerraGiG Full time
Job Title : Data Engineer

Experience : 8-12 Years

Location : Noida, Chennai & Pune

Skills : Python, Pyspark, Snowflake & Redshift, AWS, DBT, Data Modeling, Airflow, SQL

Key Responsibilities

• Migration & Modernization

• Lead the migration of data pipelines, models, and workloads from Redshift to Snowflake/Yellowbrick.

• Design and implement landing, staging, and curated data zones to support scalable ingestion and consumption patterns.

• Evaluate and recommend tools and frameworks for migration, including file formats, ingestion tools, and orchestration.

• Design and build robust ETL/ELT pipelines using Python, PySpark, SQL, and orchestration tools (e.g., Airflow, dbt).

• Support both batch and streaming pipelines, with real-time processing via Kafka, Snowpipe, or Spark Structured Streaming.

• Build modular, reusable, and testable pipeline components that handle high volume and ensure data integrity.

• Define and implement data modeling strategies (star, snowflake, normalization/denormalization) for analytics and BI layers.

• Implement strategies for data versioning, late-arriving data, and slowly changing dimensions.

• Implement automated data validation and anomaly detection (using tools like dbt tests, Great Expectations, or custom checks).

• Build logging and alerting into pipelines to monitor SLA adherence, data freshness, and pipeline health.

• Contribute to data governance initiatives including metadata tracking, data lineage, and access control.

Required Skills & Experience

• 10+ years in data engineering roles with increasing responsibility.

• Proven experience leading data migration or re-platforming projects.

• Strong command of Python, SQL, and PySpark for data pipeline development.

• Hands-on experience with modern data platforms like Snowflake, Redshift, Yellowbrick, or BigQuery.

• Proficient in building streaming pipelines with tools like Kafka, Flink, or Snowpipe.

• Deep understanding of data modeling, partitioning, indexing, and query optimization.

• Expertise with ETL orchestration tools (e.g., Apache Airflow, Prefect, Dagster, or dbt).

• Comfortable working with large datasets and solving performance bottlenecks.

• Experience in designing data validation frameworks and implementing DQ rules.

  • Pune, Maharashtra, India VidPro Consultancy Services Full time

    Job DescriptionExperience: 5-8 YearsWork Mode: Pune & HyderabadJob Type: FulltimeMandatory Skills: Python, Pyspark, SQL, Snowflake, Airflow, ETL, Data Pipelines, Elastic Search, or AWS.Role OverviewWe are looking for a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling...


  • Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionJava Lead Engineer - VPPosition OverviewJob Title: Lead EngineerLocation: Pune, IndiaRole DescriptionEngineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering...

  • Lead Data Engineer

    4 days ago


    Pune, Maharashtra, India MSD Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job DescriptionLead Data EngineerAt our Company we are leveraging analytics and technology, as we invent for life on behalf of patients around the world. We are seeking those who have a passion for using data, analytics, and insights to drive decision making, that will allow us to tackle some of the world's greatest health threats.Within our commercial...


  • Pune, Maharashtra, India myGwork Full time

    This job is with MSCI, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Your Team Responsibilities:Our team is responsible for building and maintaining the Fund ESG Ratings platform, a business-critical component that powers MSCI's ESG offerings at...


  • Pune, Maharashtra, India Expert Global Group Full time

    Hi,Greetings of the DayWe are urgently looking for a Associate Engineer for Pune Location.ALTEN is a French multinational technology consulting and engineering company founded in 1988, it has offices in 25 countries.Expert Global Solutions Pvt Ltd is a Group company of Alten (India) an ISO 9001:2008 certified company founded in 1991, providing engineering...


  • Pune, Maharashtra, India Vanderlande Industries Software Private Limited Full time

    Job DescriptionData Engineer at Operational Awareness Warehouse team within Digital Service Platform (DSP)Job Location: PuneVanderlande provides baggage handling systems for 600 airports around the globe, capable of moving over 4 billion pieces of baggage around the world per year. For the parcel market our systems handle 52 million parcels per day. All...


  • Pune, Maharashtra, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking ETL Developer to join our team in IndiaWe need an experienced, collaborative Data Engineers with. 5 Yrs of experience in...


  • Pune, Maharashtra, India beBeeSearch Full time ₹ 15,00,000 - ₹ 30,00,000

    Senior Digital Marketing SpecialistAbout the Role:We are looking for a seasoned digital marketing expert to lead our search engine optimization and pay-per-click advertising efforts.About You:You have 4-8 years of experience in digital marketing, with a strong understanding of search engine algorithms and online user behavior.You possess excellent analytical...


  • Pune, Maharashtra, India DDN Full time

    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to financial...


  • Pune, Maharashtra, India Michael Page Full time

    Job Description- To be a part of one of the largest manufacturing companies in India- To be a part of a forward looking digital organisationJob Description- Develop and maintain scalable data pipelines to support analytics and reporting needs using Azure Fabric and Databricks.- Optimise data integration processes to ensure accuracy and performance.-...