Data Pipeline Specialist
11 hours ago
As a Data Pipeline Specialist, you will play a critical role in ensuring the accuracy and reliability of data processing systems.
Job Description- You will test and validate data pipelines to guarantee seamless data flow across multiple systems.
- Your responsibilities will include testing ETL processes, performing data reconciliation, and validating Kafka/Redpanda pipelines.
- You will also write and run MongoDB queries to maintain data quality and create test cases, defect reports, and collaborate with developers/product teams.
- A minimum of 2 years of experience as a QA Engineer with expertise in process methodologies used in the software industry.
- You should have hands-on experience with Kafka/Redpanda, Git, CI/CD, and tools like JIRA or Azure DevOps.
- This role offers opportunities for growth and development, with exposure to cutting-edge technologies and frameworks such as Flink/Spark.
- You will work on complex projects that require strong problem-solving skills and attention to detail.
- Familiarity with scripting languages like Python/Java for automation and cloud platforms (Azure, AWS, GCP).
-
Senior Data Pipeline Engineer
2 days ago
Thoothukudi, Tamil Nadu, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data Integration SpecialistAs a skilled professional, you will play a vital role in building scalable and efficient data pipelines using industry-leading technologies.Key Responsibilities:Design, develop, and maintain ETL pipelines for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.Build and optimize data flows for loading...
-
Data Pipeline Specialist
2 days ago
Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time US$ 8,00,000 - US$ 15,00,000About the Role:Drive digital transformation and enhance operational efficiency by designing and implementing scalable data pipelines using Azure Databricks (PySpark/Scala).Key Responsibilities:
-
ETL Data Pipelines Specialist
5 days ago
Thoothukudi, Tamil Nadu, India beBeeInformatica Full time ₹ 18,00,000 - ₹ 20,00,000Job Title:">A seasoned professional is required to lead the design, development, and maintenance of data pipelines using Informatica IICS.The ideal candidate will have experience integrating IICS solutions with cloud-based data platforms such as Google Cloud Platform (GCP) and Google BigQuery (GBQ).Pipeline optimization for scalability and performance is...
-
AI Pipeline Developer
1 week ago
Thoothukudi, Tamil Nadu, India beBeeArtificialIntelligence Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior AI Specialist PositionExcelgig is hiring an AI Specialist with expertise in custom model development and end-to-end pipeline creation.Key Responsibilities:Design and develop custom machine learning and deep learning models for business-specific problems (NLP, computer vision, predictive modeling, recommendation systems, etc.).Build and maintain...
-
Senior Data Pipeline Developer
6 days ago
Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000Senior Data Pipeline DeveloperAbout the Role:We are seeking an experienced Senior Data Pipeline Developer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing comprehensive test cases for Azure Data Factory ETL pipelines using Python and Pytest.Key Responsibilities:Design and develop manual and...
-
Data Pipeline Optimization Specialist
2 days ago
Thoothukudi, Tamil Nadu, India beBeeExpert Full time ₹ 1,50,00,000 - ₹ 2,00,00,000System Administrator of Elasticsearch ClustersAbout the Role:In this pivotal position, you will be responsible for continually evaluating and optimizing the performance of our Elasticsearch clusters. Your proactive approach will enable us to identify potential issues before they impact our services.Key Responsibilities:Maintain and enhance data pipelines,...
-
Chief Data Pipeline Architect
5 days ago
Thoothukudi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Senior Data Engineer PositionWe are seeking an experienced professional to lead our data engineering team. As a key member, you will be responsible for designing, developing, and optimizing large-scale data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Key Responsibilities:Design, develop, and optimize ETL/ELT data pipelines using Apache...
-
Data Pipeline Architect
1 week ago
Thoothukudi, Tamil Nadu, India beBeeInformatician Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Profile:">Lead Informatica Developer">We are seeking a highly skilled and experienced Informatica ETL Developer with expertise in designing, developing, testing, and maintaining large-scale ETL applications. The ideal candidate will have a strong background in data pipeline development and take ownership in delivering scalable solutions that meet...
-
Lead Data Pipeline Tester
6 days ago
Thoothukudi, Tamil Nadu, India beBeeData Full time US$ 1,00,000 - US$ 1,45,000Job Opportunity: Data Pipeline TesterJob Summary:We are looking for a seasoned professional to lead the development and execution of testing strategies for data pipeline projects. The ideal candidate will have expertise in testing ETL workflows, SQL Data Warehouses, and BI reports.Key Responsibilities:Develop and execute testing strategies for data pipelines...
-
Senior Data Pipeline Developer
7 days ago
Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 19,80,000 - ₹ 25,20,000Key ResponsibilitiesWe are seeking a skilled professional to design, develop and maintain data pipelines that ingest data from various sources into our data warehouse.Data Ingestion: The ideal candidate will design and implement data pipelines using AWS services such as Lambda, DMS and Glue.Data Transformation: They must have expertise in SQL scripting and...
