
Big Data Engineering Expert
3 days ago
Job Summary
We are seeking an experienced Data Engineer to design, develop, and optimize large-scale data pipelines and distributed data processing systems.
The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka, with a focus on data engineering principles, cloud architecture, and software engineering concepts.
- Design and implement scalable data architectures for big data processing.
- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi/Airflow.
- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
- Collaborate with cross-functional teams to ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
Required Skills:
- Scala - Minimum 3+ years of hands-on experience.
- Strong expertise in Spark (PySpark) and Python.
- Hands-on experience with Apache Kafka.
- Knowledge of NiFi/Airflow for orchestration.
- Strong experience in Distributed Data Systems (5+ years).
- Proficiency in SQL and query optimization.
Preferred Skills:
- Exposure to messaging technologies like Apache Kafka or equivalent.
- Familiarity with Splunk or other monitoring/alerting solutions.
- Hands-on experience with CI/CD tools (Git, Jenkins).
-
Senior Big Data Engineer
3 days ago
Thāne, Maharashtra, India beBeeBigDataExpert Full time ₹ 1,50,00,000 - ₹ 2,50,00,000As a Big Data Developer, you will play a crucial role in driving business growth through data-driven insights.Key Responsibilities:Design and implement scalable big data solutions using Hadoop, Spark, Hive, HDFS, and KafkaCollaborate with senior engineers to develop and deliver high-quality projects on timeMentor junior engineers in coding standards, best...
-
Big Data Professional
2 weeks ago
Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000We are looking for a skilled Big Data professional to join our team as a Big Data Engineer"> Big Data Engineer ", we require a candidate with strong skills in data engineering and analytics. The ideal candidate will have hands-on experience with Big Data technologies, including data ingestion, processing, and storage.">Key Responsibilities:Data Ingestion:...
-
Big Data Developer
4 days ago
Thāne, Maharashtra, India Tech Consulting Full timePosition Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...
-
Big Data Engineering Specialist
2 weeks ago
Thāne, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 16,00,000Job DescriptionWe are seeking a skilled Big Data Engineer to join our team. As a key member of our Professional Services, you will play a vital role in designing, building, and maintaining high-performance data pipelines that process massive amounts of data.Key Responsibilities:Design and implement scalable batch processing systems using Python and big data...
-
Big Data Specialist
2 weeks ago
Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Databricks Data Engineer OpportunityKey Responsibilities:Develop and maintain scalable data pipelines and ETL processes on Databricks.Lead the architecture and implementation of high-performance data solutions.Collaborate with stakeholders to deliver actionable data insights.Optimize data workflows for performance, cost-efficiency, and reliability.Integrate...
-
AWS Big Data Engineer
7 days ago
Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000Job Description:As a data engineer, you play a vital role in crafting and implementing robust data pipelines to process channel activity data from diverse sources. This encompasses digital channels, Hadoop environments, and Terradata.Key Responsibilities:Design and maintain scalable data architectures that integrate multiple sources of data for effective...
-
Big Data Expert Wanted
2 weeks ago
Thāne, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Big Data Professional OpportunityKey Responsibilities:Greetings from a top IT services company.PySparkHiveTo succeed in this role, you should have experience with Big Data platforms and data ingestion from disparate sources. You will work closely with cross-functional teams to drive business outcomes.We offer competitive compensation and benefits packages to...
-
Senior Big Data Specialist
7 days ago
Thāne, Maharashtra, India beBeeData Full time US$ 90,000 - US$ 1,60,000Data Engineering RoleWe are seeking a skilled Data Engineer to join our team.About the Role:This is an exciting opportunity for a seasoned professional with experience in designing and executing large-scale distributed data systems.The ideal candidate will have expertise in big data technologies, including Apache Hadoop, relational databases (e.g., MS SQL...
-
Senior Big Data Engineering Specialist
5 days ago
Thāne, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Big Data EngineerWe are seeking an experienced big data engineer to join our team. The ideal candidate will have a strong background in designing and implementing large-scale data processing systems on Azure.The successful candidate will be responsible for developing and maintaining complex data pipelines, creating efficient data models, and integrating and...
-
Big Data Leader
7 days ago
Thāne, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000">Senior Data Architect">This role is responsible for leading data engineering teams globally and collaborating with cross-functional teams to drive business outcomes. ">Lead large-scale data engineering projects using distributed systems like Apache Spark, HDFS, and Kubernetes.Design and implement scalable data pipelines for big data processing using Scala,...