Large Scale Data Pipeline Developer
3 days ago
Develop and maintain large-scale data pipelines, integrating structured and unstructured data from multiple sources.
- Design, implement, and optimize ETL processes using Big Data ecosystems like Hadoop, Spark, Hive, or similar technologies.
- Collaborate with data analysts, data scientists, and business stakeholders to deliver reliable solutions that meet business requirements.
Key Responsibilities:
- Develop efficient SQL queries for data validation, transformation, and analytics.
- Implement data quality, governance, and security standards to ensure data integrity and compliance.
Required Skills & Qualifications:
- Proven experience in Big Data technologies (Hadoop, Spark, Hive, HDFS, Kafka, etc.).
- Strong expertise in SQL (query optimization, stored procedures, complex joins).
- Hands-on experience with ETL tools/processes (Informatica, Talend, Apache NiFi, Airflow, or custom ETL).
- Deep understanding of Data Warehousing concepts (star schema, snowflake schema, fact/dimension tables).
Benefits:
- Competitive salary and comprehensive benefits package.
- Flexible work environment with a supportive company culture.
- Continuous learning opportunities and professional growth.
Why Join Us?
- Work on innovative, high-impact projects with a team of top-tier professionals.
- Contribute to the development of cutting-edge data engineering solutions.
-
Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data EngineerAbout the RoleWe are seeking an experienced data engineer to design, build and maintain large-scale data pipelines in Google Cloud Platform. The ideal candidate will have a strong background in data engineering with expertise in GCP.The primary responsibility of this role is to develop, construct, test and maintain data acquisition...
-
Expert in Large Scale Data Engineering
3 days ago
Ahmedabad, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000**Job Overview**We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Data Factory (ADF) and Databricks.",
-
Leading Large-Scale Distributed Systems
5 days ago
Ahmedabad, Gujarat, India beBeeSoftwareEngineeringLead Full time ₹ 2,00,00,000 - ₹ 3,00,00,000Senior Software Engineering LeadOur team seeks a seasoned software engineering leader to drive the development of large-scale distributed systems.The ideal candidate will have extensive experience in designing, building, and deploying scalable, highly available, and fault-tolerant services.This role requires strong leadership skills to guide technical...
-
Data Pipeline Developer
4 days ago
Ahmedabad, Gujarat, India beBeeTechnical Full time ₹ 60,00,000 - ₹ 1,20,00,000Job DescriptionWe are seeking a highly skilled technical professional to design, implement, and manage data pipelines using Azure Data Factory.As a technical specialist, you will be responsible for developing scalable data processing solutions within Azure Synapse Analytics, with a strong understanding of data modeling, ETL processes, and query...
-
Data Engineering Specialist
6 days ago
Ahmedabad, Gujarat, India beBeeDataEngineer Full time US$ 80,000 - US$ 1,00,000Job Title: Data Engineer">Description Summary: We have an immediate requirement for an experienced professional to develop and maintain large-scale data pipelines.">">Design, develop, and maintain large-scale data pipelines.">Develop scalable data processing solutions using PySpark.">Work on high-performance data architectures.">">About Us: Our organization...
-
Master Data Pipeline Architect
3 days ago
Ahmedabad, Gujarat, India beBeeDataEngineer Full time US$ 1,17,000 - US$ 1,63,000Key Data Engineer RoleThe ideal candidate will possess a deep understanding of data infrastructure, data modeling, and data governance. They should be well-versed in cloud computing platforms, ELT/ETL processes, and data warehousing concepts.We are seeking an experienced Data Engineer to join our team. The successful candidate will be responsible for...
-
Senior Data Systems Architect
19 hours ago
Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Data Engineering Role OverviewWe are seeking an experienced professional to fill a Data Engineer position. The ideal candidate will have a strong background in data engineering and extensive experience in designing, developing, and maintaining large-scale data systems.Key Responsibilities:Design, develop, implement, and maintain large-scale data systems...
-
Chief Data Pipeline Architect
1 day ago
Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Job OverviewWe are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines. As a key member of our team, you will be responsible for managing and processing large datasets, building real-time streaming applications, and collaborating with data scientists to integrate AI/ML models into production.
-
Lead Data Solutions Architect
19 hours ago
Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000Job DescriptionWe are seeking a skilled Data Engineer to take on the challenge of designing, developing, and maintaining large-scale ETL pipelines.The ideal candidate will have experience with distributed data processing technologies such as Apache Spark and Hadoop.Design and develop production-ready ETL pipelines.Develop expertise in cloud-based development...
-
Senior Data Engineer
19 hours ago
Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 14,68,800 - ₹ 19,12,000Job OpportunityA senior data engineer with expertise in Airflow, Python, and Snowflake is required to design, develop, and maintain complex data pipelines.Able to leverage distributed systems, containerization, and cloud-based technologies.The ideal candidate will have experience working on scalable data processing solutions using Apache Airflow, implement...
