
Cloud Data Pipeline Expert
1 day ago
Job Title: Data Pipeline Specialist
Key Responsibilities:- Design and develop scalable data pipelines using cloud services to process high-volume, real-time data.
- Implement data ingestion, transformation, and storage solutions ensuring data quality, integrity, and security across all data systems.
- Monitor and troubleshoot data pipelines identifying and resolving issues to ensure 99.999% uptime & performance SLAs of the production environment.
- Collaborate with data scientists and stakeholders understanding data requirements to optimize data pipelines for performance, reliability, and cost-effectiveness.
- Create clear documentation of data flows, system architecture, and operational procedures.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- At least 2 years of experience in data engineering or related roles.
- Proficiency in cloud services such as GCP, AWS, or Azure is required.
- Hands-on experience with distributed stream processing technology ecosystem, including Apache Kafka, Flink, or Beam etc.
- Strong programming skills in languages such as Python, Scala, or NodeJS.
- Experience with SQL, NoSQL, and especially Timeseries databases.
- Experience with parallel programming and distributed data processing.
- Solid understanding of data warehousing concepts and technologies.
- Ability to design and implement data architectures.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
-
Data Pipeline Specialist
7 days ago
Mumbai, Maharashtra, India beBeeSpark Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Big Data Expert Wanted We are seeking a skilled Big Data expert to join our team. As a Big Data Engineer, you will design and develop scalable data pipelines using Apache Spark and Scala. Responsibilities :Design and develop scalable data pipelines using Apache Spark and Scala.Optimize and troubleshoot Spark jobs for performance (e.g. memory management,...
-
Leading Data Pipeline Expert
7 days ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Cloud Data EngineerWe are seeking a seasoned Cloud Data Engineer with expertise in designing, building and maintaining large-scale data pipelines. The ideal candidate has experience with AWS cloud services such as S3, EC2, RDS, DynamoDB, Athena and Redshift.Design, build and maintain production-level data pipelines that handle terabytes of structured and...
-
Data Pipelines Expert
4 days ago
Mumbai, Maharashtra, India beBeePipeline Full time ₹ 15,00,000 - ₹ 28,00,000Job Title: Data Pipeline SpecialistWe are seeking a highly skilled and experienced professional to join our team as a Data Pipeline Specialist. In this role, you will be responsible for designing, developing, and maintaining large-scale data pipelines that enable us to extract insights from complex datasets.Required Skills:Proficiency in cloud-based...
-
Cloud Data Solutions Expert
2 days ago
Mumbai, Maharashtra, India beBeeDataArchitect Full time ₹ 70,000 - ₹ 28,00,000We are seeking a skilled and experienced professional to drive the development of scalable, secure data architectures in a cloud environment. The ideal candidate will be a technical expert who not only delivers high-quality solutions but also collaborates with cross-functional teams to create assets and artifacts that support business growth.Main...
-
Data Pipeline Architect
5 days ago
Mumbai, Maharashtra, India beBeePipeline Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop and manage scalable data pipelines.Key Responsibilities:Design and Develop Pipelines: Utilize expertise in designing and developing data pipelines using Oracle Data Flow or Apache Spark (PySpark) to create efficient and reliable data solutions.Ensure Seamless...
-
Senior Data Pipeline Developer
3 days ago
Mumbai, Maharashtra, India beBeeDataPipeline Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Senior Data Pipeline DeveloperKey Responsibilities:Design and implement efficient data pipelines using IBM DataStage to extract, transform, and load data.Collaborate with data analysts and business stakeholders to deliver integration solutions.Develop reusable job components and follow best practices for data modeling.Monitor ETL jobs and manage...
-
Data Pipeline Architect
6 days ago
Mumbai, Maharashtra, India beBeeETL Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job OverviewThe ETL Developer role encompasses the design, development, and automation of data pipelines in a cloud-based environment. Key responsibilities include crafting efficient and scalable data transformation processes, ensuring data quality and integrity, optimizing workflow performance, and implementing security measures.Key...
-
Chief Cloud Data Architect
2 days ago
Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Cloud Data EngineerWe are looking for a seasoned professional to design, develop and maintain scalable data pipelines using cloud-based services.The ideal candidate will have extensive experience in ETL processes and cloud-based analytics.Key Responsibilities:Design and develop cloud-based data pipelines using Azure Data Factory.Process and transform large...
-
Data Architect and Pipeline Specialist
6 days ago
Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Job SummaryWe are seeking a seasoned Senior Data Engineer to spearhead data engineering efforts.The successful candidate will design and develop scalable data pipelines, oversee junior data engineers, and collaborate with cross-functional teams to drive business outcomes.Key Responsibilities:Create and maintain optimal data pipeline architecture for...
-
Microsoft Cloud Data Engineering Lead
3 days ago
Mumbai, Maharashtra, India Crisil Full time ₹ 5,00,000 - ₹ 8,00,000 per yearPosition Overview:The Microsoft Cloud Data Engineering Lead role is ideal for an experienced Microsoft Cloud Data Engineer who will architect, build, and optimize data platforms using Microsoft Azure technologies. The role requires the candidate to have deep technical expertise in Azure data services, strong leadership capabilities, and a passion for...