Big Data Engineer
22 hours ago
Job Summary:
We are hiring an experienced Big Data Engineer to design, build, and maintain high-performance data processing systems. The role requires strong expertise in Hadoop ecosystem, Spark, and cloud-based data pipelines with a focus on scalability, reliability, and performance.
Key Responsibilities:Design and develop end-to-end big data pipelines for batch and real-time processing.
Work with large datasets using Spark, Hadoop, Hive, HBase, and Kafka.
Develop data ingestion, transformation, and storage layers.
Optimize data workflows for speed, cost, and efficiency.
Collaborate with analysts, data scientists, and application teams for data delivery.
Ensure data security, lineage, and quality across the platform.
Deploy and manage workloads on AWS, Azure, or GCP.
Proficiency in Spark (PySpark/Scala), Hadoop, Hive, Kafka, HBase, and Sqoop.
Strong programming skills in Python, Scala, or Java.
Experience with ETL/ELT pipelines and data modeling.
Good knowledge of cloud data platforms (AWS EMR, Dataproc, Databricks, Azure HDInsight).
Familiar with data lake and data warehouse integration.
Proficient in SQL and performance tuning.
Knowledge of CI/CD, Docker, and Kubernetes preferred.
Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
Cloud certifications (AWS Big Data, GCP Data Engineer, or Azure Data Engineer).
Experience in streaming data pipelines using Kafka / Flink / Spark Streaming.
Exposure to machine learning pipelines and data governance frameworks.
-
Big Data Engineer
1 week ago
Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per yearSkill : Big Data Need to Have : Python, Pyspark, Trino, Hive Good to Have : Snowflake, SQL, Airflow, Openshift, Kubernentes Location : Hyderabad, Pune, Bangalore Job Description : Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark to ensure the efficient and reliable delivery of data....
-
Data Warehouse Engineer
1 day ago
Kanpur, Uttar Pradesh, India Umanist Staffing Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Summary:We are looking for a skilled Data Warehouse Engineer to design, build, and optimize large-scale data warehouse and analytics solutions. The candidate must have deep expertise in data modeling, ETL development, SQL optimization, and cloud-based data platforms.Key Responsibilities:Design and develop data warehouse architecture, ETL pipelines, and...
-
Azure Data Engineer
1 week ago
Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearExperienced Azure Data Engineer Tech Lead ( Tech Lead ) with 7 to 10 years of expertise Design, develop, and maintain robust data pipelines using Azure Databricks, Azure Data Factory, Pyspark / Python, Azure Data Lake Gen2, and Azure SQL Database.Integrate and manage data from various source systems, ensuring data quality and consistency.Mandatory Skills :...
-
Advanced Azure Data engineer
5 days ago
Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAdvanced Azure data Engineer : 4+ Years Proficiency In Python, SQL, Databricks, Snowflake Data Modelling, ETL Process, Apache Spark, Pyspark, Data Integration and workflow orchestration , real time data processing experience and frameworks, Azure cloud experience
-
Networking Specialist
1 week ago
Kanpur, Uttar Pradesh, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per yearReq ID: 341827NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Networking Specialist to join our team in Anywhere in india, Uttar Pradesh (IN-UP), India (IN). Job OverviewThe Senior...
-
Data Engineer(DevOps)
5 days ago
Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAzure DevOps Engineer JD Must Have::5+ years experience on Azure DevOps Engineer, Azure Pipelines/Repos, Microsoft Azure, GitHub . Work Location :a. City:Hyderabad, Pune, Chennai, Bangalore b. Office [Client ODC in TechM campus / Client office / Flexible]:Client ODC in TechM campus c. WFO/WFH/Hybrid :Hybrid 4. Band:U3 band
-
Data & Analytics Team
1 week ago
Kanpur, Uttar Pradesh, India Ignitus Labs Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSenior Data Engineer (Architecture & Implementation) - Team LeadScope of WorkLead technical architecture decisions for data platform modernization.Plan and execute refactoring of core data pipelines from timer-based to event-driven orchestration.Implement subscription schema alignment between Chargebee and Shopify/Recharge.Collaborate with internal Data...
-
GCP + Terraform Expert
1 week ago
Kanpur, Uttar Pradesh, India Growel Softech Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are looking for Terraform expert who can automate GCP environment. Job Overview: We are seeking a skilled Senior Cloud Infrastructure Engineer to automate infrastructure creation on Google Cloud Platform (GCP) using Terraform . The candidate will be responsible for provisioning and setting up GCP projects and environments for the entire GCP data...
-
Lead Data Analyst
5 days ago
Kanpur, Uttar Pradesh, India Technip Energies Full time ₹ 10,00,000 - ₹ 25,00,000 per yearJob DescriptionBe part of the solution at Technip Energies and embark on a one-of-a-kind journey. You will be helping to develop cutting-edge solutions to solve real-world energy problems.About us:Technip Energies is a global technology and engineering powerhouse. With leadership positions in LNG, hydrogen, ethylene, sustainable chemistry, and CO2...
-
Sr. Project Engineer and Project Engineer
20 hours ago
Kanpur, Uttar Pradesh, India Department of Management Sciences, IIT Kanpur Full time ₹ 9,00,000 - ₹ 12,00,000 per yearOpen Position for Sr. Project Engineer (02) and Project Engineer (02) at Centre for Energy Regulation (CER), IIT Kanpur. Last Date for submitting online applications is 8 Oct., 2025.Qualifications include (Check weblink for details)Sr. Project Engineer (02)M. E. / M. Tech. (Power Systems, Energy Systems, Renewable Energy Technologies, or related fields) + 3...