
Senior Big Data Engineer
6 days ago
Design, build and maintain scalable data pipelines using Python, PySpark and Airflow.
- Responsibilities:
- - Design, build, and maintain scalable data pipelines using Python, PySpark, and Airflow.
- - Develop and optimize ETL workflows on Cloudera Data Platform (CDP).
- - Implement data quality checks, monitoring, and alerting mechanisms.
- - Ensure data security, governance, and compliance across all data pipelines.
- - Work closely with cross-functional teams to understand data requirements and deliver solutions.
- - Troubleshoot and resolve issues in production data pipelines.
- - Contribute to the architecture and design of the data platform.
- - Collaborate with engineering teams and analysts to work on AI/ML and Gen AI use cases.
- - Automate deployment and monitoring of data workflows using DevOps tools and practices.
Skills and Qualifications:
- Must-Have:
- - Strong hands-on experience in Apache Airflow, PySpark, and Python.
- - Expertise in Cloudera Data Platform (CDP).
- - In-depth knowledge of ETL workflows, data pipelines, and automation tools.
- - Solid understanding of DevOps practices for automation and deployment.
- - Experience with AI/ML and Generative AI use cases is a plus.
- Nice-to-Have:
- - Strong problem-solving skills and the ability to troubleshoot data pipeline issues.
- - Excellent communication skills and the ability to collaborate effectively with cross-functional teams.
- - Knowledge of data security, governance, and compliance.
-
Big Data Engineering Expertise Sought
6 days ago
Delhi, Delhi, India beBeeData Full time ₹ 20,00,000 - ₹ 27,00,000Senior Data EngineerOur organization seeks a highly experienced Senior Data Engineer to lead data engineering initiatives. This senior professional will have a strong background in software development, with 8+ years of experience designing and implementing big data ETL pipelines, data processing, analytics applications using PySpark.Key...
-
Senior Big Data Developer
2 days ago
Delhi, Delhi, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000Big Data Engineer RoleThe role of a big data engineer is pivotal in designing, developing, and maintaining scalable and secure big data solutions on cloud-based platforms. The ideal candidate will have expertise in cloud architecture, big data technologies, and data engineering best practices.",
-
Big Data Engineer
6 days ago
Delhi, Delhi, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Big Data EngineerWe are seeking a skilled data expert to fill this challenging role. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced environment.Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and cloud storage services.Work in...
-
Big Data Engineer
6 days ago
Delhi, Delhi, India Eqaim Technology & Services Full timeJob Description : Big Data Engineer We are looking for a highly skilled Big Data Engineer to join our team. In this role, you will contribute to building and optimizing scalable data solutions that empower businesses to optimize promotional activities and maximize return on investment. You will work on data collection, validation, and analysis, while...
-
Senior Big Data Engineer
2 days ago
Delhi, Delhi, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Job Title:A seasoned professional with extensive experience in designing and developing scalable data pipelines using Python is sought after.About the Role:Develop and implement robust data ingestion techniques from APIs, databases, and file-based sources.Work on API development, testing, and deployment utilizing various tools and frameworks.Collaborate with...
-
Senior Data Engineer
6 days ago
Delhi, Delhi, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in big data processing using Apache Spark, AWS, and cloud-based...
-
Big Data Engineer
5 days ago
Delhi, Delhi, India prudential Manpower Pvt Full time ₹ 15,00,000 - ₹ 20,00,000 per yearEducation and Experience :Bachelor's degree in computer science, or similar technical field Minimum 5 years of experience in Big Data Engineering/Data Analysis5 Days Work From Office :Preferred Skills and Qualifications : Proficiency in Python, SQL and Apache SparkAWS services such as EMR, Glue (server less architecture), S3, Athena, IAM, Lambda and Cloud...
-
NucleusTeq - Big Data Engineer - Spark/Scala
2 days ago
Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full timeRole : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...
-
Big Data Solutions Specialist
6 days ago
Delhi, Delhi, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Big Data Engineer OpportunityWe are seeking an experienced Big Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in designing and developing scalable data pipelines, processing systems, and workflows.About the RoleThe ideal candidate will have hands-on experience with big data technologies such as...
-
Big Data Solutions Architect
1 week ago
Delhi, Delhi, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000Job Title:AWS Data EngineerDescription:We are seeking an experienced AWS Data Engineer to design, develop and maintain big data solutions on AWS.The ideal candidate will have a deep understanding of big data technologies, cloud architecture, and best practices in data engineering.Responsibilities:Design, develop and maintain big data solutions using AWS...