
Data Pipeline Architect
7 days ago
We are seeking a Data Engineering professional to design, develop, and maintain our data pipelines using cutting-edge technologies. This role is ideal for an analytical and problem-solving expert with hands-on experience in Glue, Python, EMR/Spark, and Kafka/Kinesis streaming.
Key Responsibilities- Develop scalable and reliable data pipelines using AWS services like Glue, Lambda, and S3.
- Design and implement relational databases with a preference for Aurora Postgres.
- Write complex SQL queries and stored procedures to optimize database performance.
- Troubleshoot and resolve data quality issues to ensure high-quality insights.
- Collaborate with stakeholders to understand data requirements and develop tailored solutions.
- Document data pipelines and procedures to ensure transparency and knowledge sharing.
To succeed in this role, you will need strong analytical and problem-solving skills, as well as hands-on experience building data pipelines using Glue, Python, EMR/Spark, and Kafka/Kinesis streaming. You should also have extensive experience with relational database design and development, with a preference for Aurora Postgres.
Required Skills- Proficiency in cloud technologies (AWS preferred), with expertise in services like Aurora/RDS, Glue, Lambda, EC2, S3, EMR, Step Functions, Cloud Trail, and Cloud Watch.
- Hands-on experience building data pipelines using Glue, Python, EMR/Spark, and Kafka/Kinesis streaming.
- Extensive experience with relational database design and development, with a preference for Aurora Postgres.
- Expertise in writing complex SQL queries and stored procedures.
-
Data Pipeline Architect
1 week ago
Bharatpur, Rajasthan, India beBeePipeline Full time ₹ 1,00,00,000 - ₹ 2,00,00,000Job Title: Data Pipeline ArchitectAbout the Role:We are seeking a highly skilled Data Pipeline Architect to join our team. In this role, you will design and develop data pipelines using Oracle Data Flow or Apache Spark (PySpark) with a solid understanding of data patterns, Python, and SQL.Key Responsibilities:Develop data pipelines that ensure seamless...
-
Data Pipeline Architect
6 days ago
Bharatpur, Rajasthan, India beBeeEtldeliver Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: ETL Developer - Data Engineering RoleWe are seeking a highly motivated ETL Developer to join our data engineering team. As an integral part of our organization, you will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Your key...
-
Data Pipeline Architect
1 week ago
Bharatpur, Rajasthan, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 25,00,000Cloud Data SpecialistWe are seeking a highly skilled Cloud Data Specialist with expertise in building scalable data pipelines and working on modern cloud & big data platforms.Key Responsibilities:Design, build, test, and deploy large-scale data processing systems using Python, PySpark, SQL, and Bash scripting.Develop ETL processes and data pipelines using...
-
Chief Data Pipeline Architect
4 days ago
Bharatpur, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job DescriptionWe are seeking a motivated data engineer with 3-4 years of experience in building, designing and maintaining large-scale data processing solutions using PySpark and Python.The ideal candidate will bring expertise in designing scalable data pipelines in cloud environments such as Azure. Responsibilities include designing, developing and...
-
Enterprise Data Architect
1 week ago
Bharatpur, Rajasthan, India beBeeDataArchitect Full time ₹ 32,32,000Enterprise Data ArchitectThis is a challenging role for an experienced data architect to design and implement scalable, secure, and high-performance data architectures using Azure.We are seeking a seasoned professional with strong expertise in Azure Services, hands-on experience with AWS/GCP, and advanced knowledge of Azure Data Factory and ETL/ELT...
-
Data Pipeline Engineer
2 weeks ago
Bharatpur, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Job Title:ETL Developer - Data Pipeline SpecialistKey Responsibilities:Design and develop ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for data ingestion from diverse sources.Create and optimize data flows for loading curated datasets into Snowflake, incorporating best practices for schema design, partitioning, and transformation...
-
Data Pipelines Specialist
2 weeks ago
Bharatpur, Rajasthan, India beBeeAzure Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Freelance Azure Data FactoryJob Description:We are seeking a skilled professional to support our data integration and ETL needs. The ideal candidate will have hands-on expertise in designing, building, and maintaining ADF pipelines for scalable and secure data flows.The role involves several key responsibilities, including:Designing and optimizing...
-
Chief Data Architect
2 weeks ago
Bharatpur, Rajasthan, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,30,00,000Unlock Your Career PotentialWe are seeking a talented Data Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining ETL pipelines using Azure Data Factory.As a Data Engineer, you will work closely with data architects, analysts, and business stakeholders to understand data requirements and implement data...
-
Cloud Data Architect Opportunity
1 week ago
Bharatpur, Rajasthan, India beBeeData Full time ₹ 18,00,000 - ₹ 21,00,000Cloud Data Architect OpportunityWe are seeking a highly skilled data architect to design, develop and optimize data pipelines and integration solutions in the cloud. This is a fantastic opportunity for an individual with strong technical skills and a passion for designing scalable data architectures.Key Responsibilities:Design and develop advanced ETL...
-
Cloud Data Architect
1 week ago
Bharatpur, Rajasthan, India beBeeCloudDataArchitect Full time ₹ 35,00,000 - ₹ 45,00,000About the RoleThis is a highly experienced Cloud Data Architect position requiring 5+ years of experience in designing, building, and optimizing scalable data pipelines and architectures on Google Cloud Platform (GCP).Design and implement highly scalable, reliable, and secure data pipelines on GCP using Google Cloud Storage (GCS), BigQuery, and Apache...