
Senior Data Engineer Position
1 day ago
The role of Data Engineer involves designing, developing and optimizing data pipelines using PySpark, Spark and Python.
Key responsibilities include implementing ETL/ELT solutions to integrate structured and unstructured data from multiple sources, developing and maintaining Hive queries ensuring seamless data transformations.
The candidate will also work on Databricks to create, manage and optimize data workflows and deploy and manage solutions in Azure cloud services.
Additionally, the role requires strong knowledge of Spark, Hive, SQL and Unix shell scripting with experience with Databricks in a production environment and Azure cloud services preferred.
">- Data Pipeline Development: Design and develop data pipelines using PySpark, Spark and Python to extract, transform and load data.
- ETL/ELT Solutions: Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
- Hive Query Development: Develop and maintain Hive queries ensuring seamless data transformations.
- SQL Query Optimization: Optimize SQL queries for better performance.
- Real-Time Streaming Solution Development: Develop real-time streaming solutions using PySpark and Spark.
- Databricks Workflow Management: Work on Databricks to create, manage and optimize data workflows.
- Azure Cloud Service Deployment and Management: Deploy and manage solutions in Azure cloud services.
Key Skills: Strong knowledge of Spark, Hive, SQL and Unix shell scripting with experience with Databricks in a production environment and Azure cloud services preferred.
Benefits: Competitive salary and benefits package, opportunities for professional growth and development.
-
Cloud Data Engineer Position
1 week ago
Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 1,50,00,000Senior Data Engineer Job DescriptionWe are seeking a seasoned and proficient Senior Python Data Engineer with substantial experience in cloud technologies. This pivotal role plays a crucial part in our data engineering team, where you will design, implement, and optimize data pipelines ensuring seamless integration with cloud platforms.The ideal candidate...
-
Advanced Data Architect Position
2 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,10,00,000Senior Data Engineer JobWe are seeking a skilled Senior Data Engineer to fill this critical role. As a key member of our data engineering team, you will be responsible for designing and optimizing data pipelines, architecting scalable cloud and big data solutions, and ensuring data governance and security.Data Pipeline Design & Optimization: Build ETL/ELT...
-
Data Engineering Position
4 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Data Engineer RoleAbout this role. We're looking for a skilled Data Engineer to join our team and help us scale and optimize our data processing capabilities.This is a critical role that requires strong technical skills and experience with big data technologies.
-
Transforming Data Landscape
4 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Senior Data Engineer - Transforming Data LandscapeThe role of a Senior Data Engineer involves the analysis and optimization of data integration frameworks to enhance their impact. Key responsibilities include developing Spark jobs using Scala for new project requirements, as well as enhancing existing ones as needed.Job Requirements:7-9 years of IT...
-
Senior Data Engineer
4 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 19,00,000A senior data engineer is responsible for developing, maintaining, and optimizing the flow of data within our organization.Key responsibilities include:Designing, building, and testing data pipelines to ensure timely and accurate data deliveryCollaborating with cross-functional teams to identify data requirements and implement solutionsMaintaining and...
-
Highly Skilled Data Engineer Position
1 week ago
Erode, Tamil Nadu, India beBeeRedshift Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Redshift Engineer Job OpportunityWe are seeking a highly skilled Senior Redshift Engineer to join our team and support our clients in architecting, optimizing, and scaling AWS Redshift environments.Lead architecture review and validation for multiple AWS Redshift clustersValidate sizing assumptions and provide right-sizing recommendationsDefine and...
-
Senior Data Engineer
4 days ago
Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000We are seeking a seasoned Senior Data Engineer to elevate our data engineering capabilities.Job Description:The successful candidate will be responsible for designing and implementing scalable data processing solutions using Azure Functions, ADF, and SQL/T-SQL.Key Responsibilities:Develop and maintain complex Azure Functions for high-performance data...
-
Senior Data Engineering Leader
1 week ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,50,000About Our Role">We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering department, you will play a critical role in designing and implementing large-scale data pipelines that drive business growth and innovation.
-
Senior Data Engineer
1 week ago
Erode, Tamil Nadu, India Collabera Full timeSenior Data EngineerArrangement: Fully RemoteShift: US Time Zone (Night Shift)Industry: Financial Institution (FI) - Credit UnionJob SummaryCollabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for...
-
Senior Data Engineer
1 week ago
Erode, Tamil Nadu, India beBeeEngineering Full time ₹ 25,00,000 - ₹ 30,00,000Strategic Data Engineering ManagerThis is a senior-level data engineering management position that requires extensive experience in Big Data platforms, cloud architecture, and team leadership.The ideal candidate will oversee the development of end-to-end data solutions using Azure Data Services and Databricks, collaborate with cross-functional teams to...