
Big Data Pipeline Specialist
1 week ago
Job Summary
We are seeking an experienced Data Engineering Specialist to join our team.
The ideal candidate will have a strong background in designing and developing scalable data pipelines using big data technologies.
- Main Responsibilities:
- Developing ETL processes using PySpark and Hive to extract, transform, and load data into Big Data platforms.
- Designing and implementing data ingestion processes from disparate sources onto Big Data platforms.
- Collaborating with cross-functional teams to identify business requirements and translate them into technical solutions.
- Maintaining and improving the overall quality of data within the Big Data platform.
Requirements:
- 6-12 years of experience in big data engineering.
- Strong knowledge of PySpark, Hive, Spark, HBase, and DQ tools.
- Experience with Agile Scrum methodologies.
About This Role
This is an excellent opportunity for a skilled Data Engineer to take on new challenges and contribute to the success of our organization.
What We Offer
A competitive salary and benefits package, as well as opportunities for career growth and professional development.
-
Big Data Specialist
1 week ago
Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Big Data SpecialistWe are on the lookout for a highly skilled and experienced Big Data Specialist to spearhead our data pipeline development. This individual will play a pivotal role in designing, building, and maintaining robust data pipelines using cloud-based technologies.Design and develop scalable data pipelines using cloud services (GCP, AWS, or...
-
Big Data Innovator
6 days ago
Ellore, Andhra Pradesh, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000We are seeking experienced professionals to fill a Big Data Specialist role.This is an opportunity for individuals with 6-12 years of experience in Bigdata and related technologies.The ideal candidate will have:Over 5.8 years of experience in Big Data projectsProficiency in Big Data technologies including PySpark, Scala Spark, Java Spark SQLA good...
-
Senior Data Pipeline Developer
4 days ago
Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Opportunity: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to lead the design, development, and deployment of scalable data pipelines and ETL processes using Databricks.Responsibilities:Collaborate with stakeholders to understand data requirements and develop technical solutions that meet their needs.Design,...
-
Big Data Specialist
1 week ago
Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,25,00,000Job Overview:Data architects at top organizations design and develop large-scale data pipelines for ingestion, transformation, and storage. They work with Big Data ecosystems such as Hadoop, Spark, Hive, and similar technologies to process structured and unstructured data.ResponsibilitiesDevelop efficient ETL processes to integrate data from multiple sources...
-
Big Data Leader
5 hours ago
Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000We are seeking a seasoned Big Data professional to spearhead the design and implementation of scalable big data analytics platforms.This senior role requires a deep understanding of key technologies like Spark, Druid, Drill, ClickHouse, and experience with big data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.A strong background in...
-
Senior Big Data Engineer
2 weeks ago
Ellore, Andhra Pradesh, India beBeeAzureDatabricksEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000Job Title: Azure Databricks Developer About the Role:We are seeking a seasoned professional with 7+ years of experience in designing, developing, and optimizing data pipelines using Azure Data Factory. The ideal candidate will be proficient in leveraging big data technologies to drive business growth and enhance operational efficiency. Key...
-
Big Data Engineering Expert
6 days ago
Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Description:We are seeking a highly skilled Big Data Engineer to lead our data engineering teams and manage cross-team collaboration.The ideal candidate will have a strong background in big data engineering, with experience in designing and developing large-scale data processing pipelines using Apache Spark and Scala/Python.Responsibilities include...
-
A Pioneer in Scalable Data Pipelines
1 week ago
Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,29,74,400 - ₹ 2,03,60,600Data Engineering ProfessionalAs a skilled Data Engineer, you will play a pivotal role in designing and developing scalable data pipelines that drive business growth. Our innovative platform harnesses the power of big data to deliver real-time insights and strategic recommendations.Key Responsibilities:Design and build production-level data pipelines that...
-
Leading Big Data Initiatives
5 days ago
Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,10,000Job Title: Senior Data EngineerWe are seeking a highly skilled data engineer to lead our big data initiatives.Designs and develops scalable data pipelines using Apache Spark, Hive, and PySpark technologies.Collaborates with analytics teams to improve data models that feed business intelligence tools, driving data-driven decision making.Develops efficient ETL...
-
Optimizing Data Pipelines
5 days ago
Ellore, Andhra Pradesh, India beBeeData Full time ₹ 12,60,000 - ₹ 20,16,000Job Role: Senior Data EngineerThe role of a Senior Data Engineer is to design and implement data pipeline architecture that is optimal.Key Responsibilities:Create and maintain data pipeline architecture that is efficient and scalable.Design and implement events/streaming based architecture/design.Identify and implement internal process improvements.Build the...