
Expert Data Pipeline Developer
2 weeks ago
We are seeking a highly skilled data engineer to take on the challenge of building scalable and efficient data pipelines.
Responsibilities:
- Design, develop, and maintain large-scale data pipelines using Python, PySpark, and SQL.
- Optimize existing data pipelines for improved performance and efficiency.
- Collaborate with cross-functional teams to integrate data engineering solutions and drive business outcomes.
- Evaluate and ensure data quality, integrity, and security through effective testing and validation.
Technical Skills:
- AWS cloud platform
- Python programming language
- PySpark and SQL
- Databricks (Delta Lake, Workflows, CLI, Job Clusters, Workspace)
- Cloud data warehousing (Redshift, Snowflake, Databricks SQL)
- REST APIs, Flask/FastAPI, containerization (Docker/Kubernetes)
- Machine learning lifecycle and libraries (scikit-learn, XGBoost)
- Cross-functional team collaboration and communication skills
Requirements:
- 3–6 years of experience in data pipeline development and maintenance.
- Strong understanding of cloud computing and big data platforms.
-
Building Scalable Data Pipelines
1 week ago
Cochin, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000Cloud Data Solutions ArchitectJob Summary:We are seeking an experienced Cloud Data Solutions Architect to design and develop scalable cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery.Key Responsibilities:Design, develop, and optimize robust data...
-
Chief Data Pipeline Architect
2 weeks ago
Cochin, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Senior Data EngineerJob Description:We are seeking an experienced senior data engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation.The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for...
-
Cloud Data Engineer
2 weeks ago
Cochin, Kerala, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Cloud Data Engineer - Pipelines SpecialistThis is a senior role requiring experience in designing, developing and managing large-scale data pipelines using Oracle Data Flow or Apache Spark.Our ideal candidate will have extensive knowledge of data patterns, Python, and SQL, with a proven track record of successfully orchestrating data workflows and ensuring...
-
Data Pipeline Engineer
1 week ago
Cochin, Kerala, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000About this Role:We're seeking a skilled Developer with expertise in building high-performance data pipelines, leveraging Go or Rust.This position is ideal for someone who enjoys working on low-level protocol implementations, understands blockchain mechanics, and can build robust data systems that power real-time analytics engines.Responsibilities...
-
Software Engineer
7 days ago
Cochin, Kerala, India beBeeBackend Full time ₹ 1,20,00,000 - ₹ 2,50,00,000Senior Backend Data & Integration Engineer OpportunityWe are seeking a highly skilled Senior Backend Data and Integration Engineer to join our team. The ideal candidate will have expertise in designing and implementing scalable data pipelines using Python/TypeScript, Azure infrastructure, and integrations.The key responsibilities of this role...
-
Experienced Data Pipeline Architect Wanted
1 week ago
Cochin, Kerala, India beBeeDataEngineer Full time ₹ 19,32,000 - ₹ 26,16,000Seeking an experienced Data Engineer with expertise in designing, developing, and maintaining data pipelines using AWS services.About this opportunity:Collaborate with cross-functional teams to deliver high-quality data solutions.Design, develop, and maintain scalable data pipelines using AWS services such as S3, Lambda, Glue, Redshift, RDS, and EC2.Write...
-
Senior Big Data Expert
2 weeks ago
Cochin, Kerala, India beBeeDataengineer Full time ₹ 15,00,000 - ₹ 28,00,000Data Engineer PositionWe are seeking an experienced Data Engineer to lead our data engineering efforts. Job Description:As a Senior Big Data Expert, you will be responsible for designing and implementing large-scale data processing systems using technologies such as Apache Spark, Hadoop, and cloud-based platforms like Azure, AWS, or GCP.Required Skills and...
-
Chief Data Pipeline Architect
1 week ago
Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data Engineer Job DescriptionOur organization is seeking an experienced Senior Data Engineer to join our team. In this role, you will be responsible for designing and implementing data processing pipelines to extract, transform, and load data from various systems into our enterprise data warehouse.This position requires strong technical skills in data...
-
Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Senior Data EngineerThis is a unique opportunity to join our team as a Senior Data Engineer and play a key role in architecting and building scalable systems that unify data lakes and warehouses.Key Responsibilities:Design and implement petabyte-scale lakehouse architecturesDevelop and optimize streaming pipelinesLeverage Java to build scalable,...
-
Expert Data Processor
2 weeks ago
Cochin, Kerala, India beBeeDataProcessing Full time ₹ 15,00,000 - ₹ 25,00,000Job OverviewWe are seeking an experienced Data Processing Specialist to join our team.The ideal candidate will have strong expertise in data integration, ELT pipelines, and data warehousing concepts.Develop and maintain data processing workflows with Azure Functions (.NET)Build end-to-end data pipelines with ADF / Azure Data ServicesCollaborate with BI teams...