
Lead Data Pipelining Specialist
18 hours ago
We are seeking a highly skilled data professional to join our team. The ideal candidate will have 6+ years of experience in development and maintenance in data engineering projects.
- Candidate must be able to collaborate with stakeholders to understand data requirements and translate them into technical solutions.
- Must design, develop, and deploy scalable data pipelines and ETL processes using Databricks.
- Ongoing optimization of Spark jobs and ensuring efficient data processing and storage is required.
- Candidate should be able to develop and maintain Databricks notebooks, workflows, and dashboards.
- Troubleshooting and resolving data pipeline issues and performance bottlenecks is essential.
- Monitoring and managing data processing jobs to ensure high availability and reliability is necessary.
- Ability to work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services is required.
- Staying current with the latest Databricks and big data technologies and trends is a must.
Required skills and qualifications include:
- 6+ years of experience in development and maintenance in data engineering projects.
- Good communication skills.
Benefits of working with us include:
- A dynamic and challenging work environment.
- Opportunities for growth and professional development.
-
Data Pipeline Specialist
7 days ago
Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Overview">The role of a Data Engineer involves designing and developing scalable data pipelines to support the organization's growing data needs. This will involve collaborating with analytics and business teams to improve data models, making data more accessible and driving informed decision-making across the organization.Key Responsibilities">Develops...
-
Cloud Data Pipeline Specialist
3 days ago
Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000We are seeking a highly skilled professional to design, build and maintain scalable data pipelines in a cloud environment.The ideal candidate will have hands-on experience with big data technologies and cloud platforms.Requirements:5+ years of experience in data engineering or related roles.Strong proficiency in Spark and Python programming...
-
Senior Data Pipeline Specialist
1 week ago
Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000ETL Developer Job DescriptionWe are seeking a talented ETL Developer to join our data engineering team. As an ETL Developer, you will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL...
-
Building Scalable Clinical Data Pipelines
1 week ago
Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Senior Data Engineer - Clinical Data Pipeline LeadAbout the RoleWe're seeking a highly experienced Senior Data Engineer to lead the design and operation of our AI-powered applications' backbone. This critical role involves creating scalable pipelines that process clinical data, retrieve medical documents, and deliver validated information to machine learning...
-
Data Engineering Specialist
7 days ago
Belgaum, Karnataka, India beBeeDataEngineering Full time US$ 15,00,000 - US$ 20,00,000Job DescriptionWe are seeking a seasoned Data Engineering Specialist to join our team. As a key member of our data engineering group, you will play a pivotal role in designing, building, and maintaining our data pipeline architecture.Our ideal candidate is an experienced professional with a passion for data engineering, a strong track record of delivering...
-
Data Pipeline Architect
7 days ago
Belgaum, Karnataka, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000Job OverviewThis role focuses on designing, developing and maintaining data pipelines using Python and AWS services. The ideal candidate will have experience in building scalable and efficient data systems.Developing and implementing data processing solutions using AWS services (S3, Redshift, Lambda, Glue)Ensuring data quality and integrity throughout the...
-
Innovative Data Pipeline Developer
3 days ago
Belgaum, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000Job Title: Azure Databricks EngineerThe company is seeking a skilled Azure Databricks Engineer to join our team. This role involves designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks.Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement...
-
Chief Data Pipeline Architect
1 day ago
Belgaum, Karnataka, India beBeeDataPlatformEngineer Full time ₹ 1,21,48,969 - ₹ 2,03,87,866Job Title: Data Platform EngineerWe are seeking a highly skilled professional to design, develop and maintain data pipelines.Your Impact:Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse or data lake environment.Automate, manage, and scale the underlying infrastructure for our...
-
Senior Data Pipeline Specialist
7 days ago
Belgaum, Karnataka, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000Job Overview:We are seeking a skilled Tester to join our team. As a Tester, you will play a critical role in ensuring the quality and reliability of our data pipelines.The ideal candidate will have a strong background in Data Migration Testing, with experience in source-to-target validation, record count verification, data integrity and validation,...
-
Data Quality Specialist
1 day ago
Belgaum, Karnataka, India beBeeDataQuality Full time ₹ 12,00,000 - ₹ 20,00,000Job Title: Data Quality SpecialistDescriptionAn experienced Data Quality Specialist is needed to ensure data accuracy and integrity throughout the organization. This role involves validating data pipelines and transformations, identifying and addressing discrepancies, and implementing processes to prevent future issues.Main Responsibilities:Validate data...