
Mastering Data Pipelines
4 days ago
We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and ETL workflows.
The ideal candidate will have strong expertise in Python, Spark, PySpark, and experience working with streaming data and collaborating with data scientists and business stakeholders to deliver high-quality solutions.
Required Skills and Qualifications- Technical Skills:
- Expertise in Python, Spark, PySpark, and SQL
- Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution
- Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC)
- Proficiency in Airflow/Prefect for scheduling and orchestration
- Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins)
- Experience:
- Minimum 4 years of professional experience as a Data Engineer
- Proven experience in building ETL pipelines, real-time streaming, and data transformations
- Collaboration with data scientists and product teams to integrate AI/ML models into production
- Education:
- Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field
This role offers the opportunity to work with cutting-edge technology and collaborate with a talented team to deliver high-quality solutions.
Other InformationThe ideal candidate will be able to manage and process large datasets using Spark, PySpark, and SQL, and deploy and manage Spark workloads on cloud platforms.
-
Data Pipeline Specialist
1 week ago
Thrissur, Kerala, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: OCI Data Flow SpecialistOverview:We are seeking a skilled professional to design, develop and manage data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns, Python, and SQL.Responsibilities:3–12 years of experience in building and managing Data Lakes, Data Warehouses, and Data...
-
Data Pipeline Architect
1 week ago
Thrissur, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000Unlock the Power of Data EngineeringAs a Senior Data Engineer, you will play a vital role in building and maintaining scalable data pipelines that integrate healthcare data. This is a critical position where you will create high-performance pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated...
-
Data Pipeline Specialist
1 week ago
Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000We are seeking a skilled data engineer to take on the challenge of designing, developing and maintaining scalable data pipelines. The successful candidate will ensure high-quality, reliable data for player behavior analysis, game performance and optimization.Key Responsibilities:Build, maintain and optimize data pipelines for large-scale slot game and player...
-
Master Data Integration Specialist
4 days ago
Thrissur, Kerala, India beBeeReltiodataintegration Full time ₹ 15,00,000 - ₹ 20,00,000Job OverviewThe role entails designing, configuring and integrating Reltio with enterprise systems to ensure data quality, governance and scalability for business-critical master data domains.Key Responsibilities:Implementing Reltio MDM platform configuration, workflows, APIs and ensuring smooth integration with other systems.Maintaining a strong...
-
Data Pipeline Architect
1 week ago
Thrissur, Kerala, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000As a highly skilled ETL specialist, you will be responsible for designing and deploying efficient data pipelines that drive business growth.The ideal candidate will have hands-on experience with ETL development using Informatica and a strong understanding of data warehousing concepts. Additionally, proficiency in Python programming for data processing and...
-
Data Pipeline Specialist
1 week ago
Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Opportunity: Data EngineerWe are seeking a skilled professional to join our team as a Data Engineer.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Integrate data from various sources, ensuring data quality and consistency.Optimize data processing workflows for...
-
Data Engineer
1 week ago
Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000Job Title:Data Engineer - Pipeline Architect\About the Role:\We are seeking a highly skilled Data Engineer to design, implement and manage data pipelines. Key responsibilities include building CI/CD pipelines using GitHub Actions or equivalent tools, configuring and maintaining branch protection rules and workflows, automating Databricks deployments using...
-
Data Pipeline Specialist
1 week ago
Thrissur, Kerala, India beBeeElasticsearch Full time ₹ 1,20,00,000 - ₹ 1,50,00,000About this position:We are seeking a highly skilled professional to manage and maintain our Elasticsearch clusters.This includes evaluating cluster performance, planning changes for high-load events, applying security fixes, testing and performing incremental upgrades, and extending and improving our monitoring and alert infrastructure.Key...
-
Master Data Specialist
1 week ago
Thrissur, Kerala, India beBeeDataGovernance Full time ₹ 80,00,000 - ₹ 1,25,00,000Job SummaryData Governance SpecialistThe Data Governance Specialist plays a critical role in ensuring the accuracy, completeness, and integrity of master data across various domains. This involves providing expert guidance, training, and support to business units on master data standards and processes.ResponsibilitiesExpert Guidance & Training Develop and...
-
Expert Data Pipeline Architect
2 weeks ago
Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Freelance Data EngineerWe are seeking a Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.Job Description:Data Engineering is a key component of our organization's ability to drive business outcomes through data-driven decision making. We are...