Current jobs related to Innovative Data Pipeline Developer - Belgaum, Karnataka - beBeeData
-
Chief Data Pipeline Architect
2 weeks ago
Belgaum, Karnataka, India beBeeDataPlatformEngineer Full time ₹ 1,21,48,969 - ₹ 2,03,87,866Job Title: Data Platform EngineerWe are seeking a highly skilled professional to design, develop and maintain data pipelines.Your Impact:Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse or data lake environment.Automate, manage, and scale the underlying infrastructure for our...
-
Data Pipeline Specialist
1 week ago
Belgaum, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 10,00,000We are seeking a highly skilled professional to join our data engineering team as a Big Data Engineer. This role involves designing, developing and optimizing large-scale data pipelines and distributed data processing systems.This person will work extensively with Scala, Spark (PySpark) and Python for data processing and transformation. A strong...
-
Senior Data Analyst
2 weeks ago
Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Job Description:Analyze and process large datasets to extract valuable insights. Develop and maintain efficient data pipelines, leveraging Python and key libraries such as Pandas and NumPy. Design and implement web scraping solutions using Scrapy and BeautifulSoup.Collaborate with cross-functional teams to understand business requirements and translate them...
-
Lead Data Pipelining Specialist
2 weeks ago
Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Senior ETL DeveloperWe are seeking a highly skilled data professional to join our team. The ideal candidate will have 6+ years of experience in development and maintenance in data engineering projects.Candidate must be able to collaborate with stakeholders to understand data requirements and translate them into technical solutions.Must design, develop, and...
-
Data Architect and Innovation Leader
2 weeks ago
Belgaum, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 18,20,000Job Title: Data Architect and Innovation LeaderWe are seeking a skilled professional to lead our data architecture initiatives and drive innovation in the field of artificial intelligence. As a Data Architect and Innovation Leader, you will be responsible for designing and implementing scalable data platforms that support business growth and...
-
Senior Data Pipeline Specialist
2 weeks ago
Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,50,00,000Transform your career with a Data Engineering role.We're seeking an expert with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills.The ideal candidate will have hands-on experience in data transformation, data ingestion, GCP BQ Dataflow Airflow, and Python programming.Key Responsibilities:Develop scalable IoT data pipelines using...
-
Senior Data Pipeline Specialist
2 weeks ago
Belgaum, Karnataka, India beBeeETLPipeline Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job OverviewWe are seeking an accomplished Data Pipeline Specialist with a strong background in database engineering to join our data team.
-
Cloud Data Engineer
2 weeks ago
Belgaum, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Cloud Data Engineer - Innovative SolutionsWe are seeking an experienced Cloud Data Engineer to design, develop, and maintain large-scale data processing systems using Azure technologies.This role involves implementing data pipelines, integrating various data sources using ELT processes, and developing scalable data models and architectures.Maintain a deep...
-
Senior Data Pipeline Automation Specialist
2 weeks ago
Belgaum, Karnataka, India beBeeETL Full time ₹ 10,00,000 - ₹ 15,00,000Job Description:We are seeking an experienced ETL Test Engineer to join our team for a challenging in-house project. The successful candidate will be responsible for performing ETL testing across complex data pipelines and enterprise-grade data systems.Key Responsibilities:Develop and execute advanced SQL queries for data validation, reconciliation, and...
-
Senior Informatica Developer
4 weeks ago
Belgaum, Karnataka, India Pacific Data Integrators Full timeJob Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL Concepts BaseLocation: RemoteShift: US EST (5 PM to 2 AM IST)Experience: 5-12 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading...
Innovative Data Pipeline Developer
2 weeks ago
Job Title: Azure Databricks Engineer
The company is seeking a skilled Azure Databricks Engineer to join our team. This role involves designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks.
- Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
- Implement and maintain CI/CD pipelines for data workflows.
- Deploy and manage containerized applications using Kubernetes.
- Ensure data integrity, security, and compliance throughout the ingestion process.
- Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
- Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
- Proven experience in data ingestion and pipeline development.
- Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
- Strong knowledge of Kubernetes and container orchestration.
- Experience with Databricks, Spark, and data lake architectures.
- Proficiency in Python, Scala, or SQL for data processing.
- Familiarity with cloud platforms such as AWS, Azure, or GCP.
- Strong problem-solving and analytical skills.
Preferred Qualifications:
- Experience with Infrastructure as Code (Terraform, Helm, etc.).
- Background in streaming data ingestion (Kafka, Kinesis, etc.).
- Knowledge of data governance and security best practices.
