Big Data Engineer

22 hours ago


Kanpur, Uttar Pradesh, India Umanist Staffing Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Summary:

We are hiring an experienced Big Data Engineer to design, build, and maintain high-performance data processing systems. The role requires strong expertise in Hadoop ecosystem, Spark, and cloud-based data pipelines with a focus on scalability, reliability, and performance.

Key Responsibilities:
  • Design and develop end-to-end big data pipelines for batch and real-time processing.

  • Work with large datasets using Spark, Hadoop, Hive, HBase, and Kafka.

  • Develop data ingestion, transformation, and storage layers.

  • Optimize data workflows for speed, cost, and efficiency.

  • Collaborate with analysts, data scientists, and application teams for data delivery.

  • Ensure data security, lineage, and quality across the platform.

  • Deploy and manage workloads on AWS, Azure, or GCP.

Required Skills:
  • Proficiency in Spark (PySpark/Scala), Hadoop, Hive, Kafka, HBase, and Sqoop.

  • Strong programming skills in Python, Scala, or Java.

  • Experience with ETL/ELT pipelines and data modeling.

  • Good knowledge of cloud data platforms (AWS EMR, Dataproc, Databricks, Azure HDInsight).

  • Familiar with data lake and data warehouse integration.

  • Proficient in SQL and performance tuning.

  • Knowledge of CI/CD, Docker, and Kubernetes preferred.

Education:
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

Preferred:
  • Cloud certifications (AWS Big Data, GCP Data Engineer, or Azure Data Engineer).

  • Experience in streaming data pipelines using Kafka / Flink / Spark Streaming.

  • Exposure to machine learning pipelines and data governance frameworks.


  • Big Data Engineer

    1 week ago


    Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Skill : Big Data Need to Have : Python, Pyspark, Trino, Hive Good to Have : Snowflake, SQL, Airflow, Openshift, Kubernentes Location : Hyderabad, Pune, Bangalore Job Description : Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark to ensure the efficient and reliable delivery of data....


  • Kanpur, Uttar Pradesh, India Umanist Staffing Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Summary:We are looking for a skilled Data Warehouse Engineer to design, build, and optimize large-scale data warehouse and analytics solutions. The candidate must have deep expertise in data modeling, ETL development, SQL optimization, and cloud-based data platforms.Key Responsibilities:Design and develop data warehouse architecture, ETL pipelines, and...

  • Azure Data Engineer

    1 week ago


    Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experienced Azure Data Engineer Tech Lead ( Tech Lead ) with 7 to 10 years of expertise Design, develop, and maintain robust data pipelines using Azure Databricks, Azure Data Factory, Pyspark / Python, Azure Data Lake Gen2, and Azure SQL Database.Integrate and manage data from various source systems, ensuring data quality and consistency.Mandatory Skills :...


  • Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Advanced Azure data Engineer : 4+ Years Proficiency In Python, SQL, Databricks, Snowflake Data Modelling, ETL Process, Apache Spark, Pyspark, Data Integration and workflow orchestration , real time data processing experience and frameworks, Azure cloud experience


  • Kanpur, Uttar Pradesh, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 341827NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Networking Specialist to join our team in Anywhere in india, Uttar Pradesh (IN-UP), India (IN). Job OverviewThe Senior...


  • Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Azure DevOps Engineer JD Must Have::5+ years experience on Azure DevOps Engineer, Azure Pipelines/Repos, Microsoft Azure, GitHub . Work Location :a. City:Hyderabad, Pune, Chennai, Bangalore b. Office [Client ODC in TechM campus / Client office / Flexible]:Client ODC in TechM campus c. WFO/WFH/Hybrid :Hybrid 4. Band:U3 band


  • Kanpur, Uttar Pradesh, India Ignitus Labs Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer (Architecture & Implementation) - Team LeadScope of WorkLead technical architecture decisions for data platform modernization.Plan and execute refactoring of core data pipelines from timer-based to event-driven orchestration.Implement subscription schema alignment between Chargebee and Shopify/Recharge.Collaborate with internal Data...


  • Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are looking for Terraform expert who can automate GCP environment.  Job Overview: We are seeking a skilled Senior Cloud Infrastructure Engineer to automate infrastructure creation on Google Cloud Platform (GCP) using Terraform . The candidate will be responsible for provisioning and setting up GCP projects and environments for the entire GCP data...

  • Lead Data Analyst

    5 days ago


    Kanpur, Uttar Pradesh, India Technip Energies Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job DescriptionBe part of the solution at Technip Energies and embark on a one-of-a-kind journey. You will be helping to develop cutting-edge solutions to solve real-world energy problems.About us:Technip Energies is a global technology and engineering powerhouse. With leadership positions in LNG, hydrogen, ethylene, sustainable chemistry, and CO2...


  • Kanpur, Uttar Pradesh, India Department of Management Sciences, IIT Kanpur Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Open Position for Sr. Project Engineer (02) and Project Engineer (02) at Centre for Energy Regulation (CER), IIT Kanpur. Last Date for submitting online applications is 8 Oct., 2025.Qualifications include (Check weblink for details)Sr. Project Engineer (02)M. E. / M. Tech. (Power Systems, Energy Systems, Renewable Energy Technologies, or related fields) + 3...