
Senior Data Pipeline Developer
6 days ago
We are currently seeking a talented Data Engineer with extensive experience in developing and implementing data pipelines, managing complex deployments, and collaborating with cross-functional teams to design and deliver high-quality data solutions.
The ideal candidate will have hands-on expertise in building scalable data architectures, designing efficient data workflows, and troubleshooting complex data engineering challenges. They will also possess excellent problem-solving skills, strong analytical abilities, and a passion for staying up-to-date with the latest advancements in data engineering.
Key Responsibilities:
- Design and implement robust data pipelines using Spark, Python, and SQL.
- Maintain and optimize existing data systems, ensuring reliability and consistency across multiple environments.
- Collaborate with development teams to integrate data solutions into existing applications.
- Develop and maintain unit tests and quality checks for data workflows.
- Implement data contracts and quality checks to ensure long-term reliability.
Requirements:
- Strong knowledge of Spark, Python, and SQL.
- Experience with GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
- Familiarity with Databricks Asset Bundles (DABs) or similar automation tools.
- Hands-on experience with Snowflake or another cloud data warehouse.
- Strong problem-solving and debugging skills in data engineering workflows.
-
Senior Pipeline Developer
2 weeks ago
Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000As a Data Engineer, you will play a pivotal role in building scalable pipelines and working with streaming data to deliver high-quality solutions.About the RoleThis position involves designing, building, and optimizing data pipelines and ETL workflows.You will manage and process large datasets using Spark, PySpark, and SQL.Experience with real-time streaming...
-
Senior Data Pipeline Specialist
1 week ago
Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job TitleBig Data ArchitectRole Description:As a senior data engineer, you will lead the design, development and deployment of scalable data pipelines using Apache Spark.Developing robust data processing workflows in PySpark is essential for delivering insights to our stakeholders.You will collaborate with cross-functional teams to ensure alignment on data...
-
Data Pipeline Architect
1 week ago
Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 23,10,000Senior Data Engineer Job DescriptionWe are seeking a seasoned data engineer to design and optimize complex data pipelines. The ideal candidate will have a strong background in ETL, Cloud, Data Warehousing, and Big Data ecosystems.Key Responsibilities:Design and Optimize Data Pipelines: Build ETL/ELT workflows using AWS Glue, Airflow, Databricks, StreamSets,...
-
Senior Data Pipeline Validator
1 week ago
Tiruppur, Tamil Nadu, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 22,00,000ETL Data Quality EngineerWe are seeking a meticulous ETL Data Quality Engineer with expertise in testing large-scale data pipelines and ensuring data accuracy, consistency, and throughput in event-driven systems.Key Responsibilities:Test ETL processes and perform data reconciliation across systems to guarantee seamless data flow.Validate Kafka/Redpanda...
-
Crafting Scalable Data Pipelines Specialist
1 week ago
Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000As a senior data engineer, you will play a pivotal role in crafting and implementing scalable data pipelines and transformation frameworks to drive analytics, reporting, and business intelligence across the enterprise.You will collaborate closely with data architects, platform engineers, and DevOps teams to develop efficient data engineering solutions using...
-
Data Pipeline Specialist
1 week ago
Tiruppur, Tamil Nadu, India beBeeData Full time US$ 1,00,000 - US$ 1,50,000Job Role:We are seeking a skilled professional to fill the position of Data Engineer.Responsibilities:Develop and maintain large-scale data pipelines using Python, PySpark, SQL, and Bash scripting.Process both structured and unstructured data.Collaborate with cross-functional teams to implement ETL processes and data transformations.Stay updated with...
-
Data Pipeline Specialist
1 week ago
Tiruppur, Tamil Nadu, India beBeeDataStage Full time ₹ 18,00,000 - ₹ 24,00,000Job Title: Teradata with DataStage DeveloperWe are seeking a skilled professional to fill the role of Teradata and DataStage developer. The ideal candidate will have expertise in ETL development and data warehousing concepts, with hands-on experience in designing, building, and optimizing data pipelines using IBM DataStage.The successful candidate will...
-
Data Pipeline Assurance Professional
1 week ago
Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Data Pipeline Integrity Specialist">We are seeking a skilled Data Pipeline Integrity Specialist to ensure the accuracy, completeness, and performance of our data pipelines. This role involves analyzing source data, identifying discrepancies, and collaborating with developers and data engineers for resolution.Key Responsibilities:Data Profiling:...
-
Chief Data Pipeline Architect
2 weeks ago
Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 25,00,000Data Engineering OpportunityWe are looking for a skilled professional to lead our data engineering efforts. As a data engineer, you will be responsible for designing and implementing scalable data pipelines using modern tools and technologies.About the Role:Develop and maintain large-scale data processing systems using Spark and Databricks.Implement CI/CD...
-
Tiruppur, Tamil Nadu, India beBeeAutomation Full time ₹ 12,50,000 - ₹ 17,50,000Job Opportunity:We are seeking a highly skilled Senior Automation Developer to join our team and drive data excellence through innovative automation solutions.The role focuses on designing and developing efficient automated scripts in Python to create golden models within relational databases for test automation.Candidates must have experience with software...