
Senior Data Engineer for Data Pipeline Development
9 hours ago
We are seeking a highly experienced Senior ETL Data Engineer to contribute to our organization's data engineering projects.
The ideal candidate will have extensive experience in designing, developing, and deploying scalable data pipelines and ETL processes using Databricks.">- Collaborate with stakeholders to understand data requirements and translate them into technical solutions, utilizing expertise in writing complex SQL queries and knowledge of SQL Analytical functions.
- Design, develop, and deploy efficient data processing jobs and workflows, ensuring high availability and reliability in cloud platforms such as AWS, Azure, or Google Cloud.
- Develop and maintain Databricks notebooks, workflows, and dashboards, optimizing performance and efficiency.
- Troubleshoot and resolve data pipeline issues and performance bottlenecks, implementing effective solutions to ensure seamless data processing.
- Monitor and manage data processing jobs, staying up-to-date with the latest Databricks and big data technologies and trends.
- 6+ years of experience in development and maintenance in data engineering projects.
- Expertise in writing complex SQL queries and knowledge of SQL Analytical functions.
- Proficient in building and optimizing data pipelines and workflows in Databricks.
- Experience working in cloud platforms (Azure/AWS platforms) and familiar with the cloud tools and technologies.
- Knowledge of programming languages such as Python, Scala.
- Stay current with the latest Databricks and big data technologies and trends.
-
Senior Data Engineer
6 days ago
Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000About This RoleWe're looking for a seasoned data engineer to design, develop, and maintain efficient ETL pipelines using IBM DataStage and AWS Glue. The ideal candidate will have expertise in building scalable data flows, collaborating with cross-functional teams, and ensuring timely delivery of critical data assets.Key Responsibilities:Design and develop...
-
Senior Data Engineer
9 hours ago
Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Data Engineering RoleWe are seeking a senior data engineer to lead the design and development of large-scale data pipelines. The ideal candidate will have 3-5 years of experience in data engineering and management, with a strong background in data modeling tools and techniques.The successful candidate will have experience with Snowflake DB, including...
-
Senior Data Pipeline Developer
7 days ago
Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job OverviewWe are seeking an experienced data pipeline developer with expertise in building and managing large-scale data processing jobs, continuous integration/deployment pipelines, and multi-environment deployments.
-
Senior Data Engineer
20 hours ago
Alleppey, Kerala, India eClerx Full timeJob Title: Senior Data Engineering Lead (Databricks) Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong...
-
Data Pipeline Specialist
6 days ago
Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job DescriptionWe are seeking an experienced Freelance Data Engineer to design, build, and optimize large-scale data pipelines.The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.Design, develop, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks.Perform data...
-
Data Engineer for Cloud Pipelines
3 days ago
Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 72,00,000 - ₹ 1,24,00,000About us: We empower clients to transform data into valuable insights by leveraging cloud-based technologies. Our goal is to deliver innovative solutions that drive business outcomes.We operate globally, serving major industries such as Banking, Financial Services & Insurance (BFSI), Technology, Media & Telecommunications (TMT), Healthcare & Life Sciences,...
-
Senior Data Pipeline Specialist
7 days ago
Alleppey, Kerala, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000Data Engineering RoleAbout the Role:We are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines using Python and AWS services.Develop and maintain scalable data pipelines that extract, transform, and load data into various data stores, ensuring...
-
Senior Financial Data Pipeline Specialist
6 days ago
Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 14,50,000Job OverviewWe are seeking a skilled Data Engineer to join our team and contribute to the design, development, and maintenance of robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and implement end-to-end data pipelines for stocks, cryptocurrencies, and other financial datasets using distributed data systems.Integrate...
-
Oil & Gas Data Pipeline Engineer
7 days ago
Alleppey, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Key Role: Data Engineer - Oil & GasTransform data into actionable insights by designing, developing, and maintaining scalable data pipelines using AWS cloud services.Extract and process structured/unstructured data from multiple sources including IoT devices, sensors, ERP systems, drilling logs, and production data.Implement data lake and warehouse solutions...
-
Senior Data Pipeline Architect
7 days ago
Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Description:As a data engineer, you will play a pivotal role in building and maintaining our data infrastructure. This involves working closely with our data science team to design and implement complex algorithms that provide valuable insights into our data.You will be responsible for modeling front-end and back-end data sources to draw a comprehensive...