
Expert Cloud Data Pipeline Engineer
2 days ago
We are seeking an experienced professional to support our data integration and ETL needs.
The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines across multiple sources and destinations.
- Design and Build Pipelines: Create efficient Azure Data Factory (ADF) pipelines for ETL and ELT processes.
- Integrate Diverse Data Sources: Integrate data from multiple sources including on-premise, cloud, structured, and unstructured data.
- Optimize Performance: Optimize pipelines for performance, scalability, and cost efficiency.
- Implement Data Transformations: Implement data transformations, mapping, and workflow orchestration.
- Configure Triggers and Parameters: Configure triggers, parameters, and dynamic pipelines in ADF.
- Collaborate with Stakeholders: Collaborate with data engineers, analysts, and business stakeholders to meet data requirements.
- Ensure Security and Compliance: Ensure security, compliance, and monitoring of pipelines using Azure best practices.
- Proven experience with Azure Data Factory (ADF).
- Strong knowledge of ETL/ELT processes, data integration, and pipeline design.
- Familiarity with Azure services such as Data Lake, Synapse Analytics, SQL Database, and Key Vault.
- Experience in parameterization, linked services, datasets, and integration runtimes.
- Strong troubleshooting and optimization skills.
- Excellent communication and problem-solving abilities.
- Experience with Azure DevOps (CI/CD for ADF pipelines).
- Knowledge of Azure Monitor / Log Analytics for pipeline monitoring.
- Familiarity with JSON-based ADF configurations.
- Understanding of data governance and security in Azure.
-
Gulbarga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Cloud Infrastructure and Data Engineering ExpertJob Description:We are seeking a seasoned expert to lead full lifecycle implementations of cloud infrastructure and data engineering solutions. This includes secure platform setup, cloud integration, high-performance data pipeline development, and scalable architecture.This role involves architecting...
-
Cloud Data Engineer
3 days ago
Gulbarga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Cloud Data Engineering SpecialistWe are seeking an experienced Cloud Data Engineering Specialist to design, implement and maintain large-scale data processing pipelines.Main Responsibilities:Designing, implementing and maintaining data processing pipelines using Azure Data Factory (ADF), Azure Databricks (ADB), PySpark and SQL.Collaborating with...
-
Cloud-based Data Engineering Specialist
5 days ago
Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data Engineer for Cloud-based SolutionsLocation: RemoteJob Overview:We are seeking an experienced data engineer to work in a hybrid development and support role. You will be responsible for designing, building, and maintaining data analytics solutions using cloud technologies with a strong focus on performance, scalability, and reliability.Develop...
-
Scalable Data Pipeline Expert
3 days ago
Gulbarga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data Engineer RoleWe are seeking a seasoned Senior Data Engineer to spearhead the design, development, and maintenance of scalable data pipelines using PySpark. This is an exceptional opportunity for someone with strong expertise in PySpark and hands-on experience in building robust data pipelines.
-
Senior Data Pipeline Specialist
3 days ago
Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,60,00,000Key Roles and Responsibilities:Data Engineers are required to design, develop, and maintain ETL/ELT data pipelines. They must be able to ingest data from various sources into our data warehouse.This includes databases and flat files. The ideal candidate will have experience with AWS Cloud services, including Lambda, DMS, and Glue.A solid understanding of...
-
Data Engineer
2 days ago
Gulbarga, Karnataka, India beBeeDatastage Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: ETL Lead with IBM DataStageAbout the RoleWe are seeking a motivated and talented ETL developer to join our data engineering team. As an ETL lead, you will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL pipelines using...
-
Financial Data Pipeline Specialist
2 days ago
Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Job Title:Data Engineer for Financial and Crypto DomainsDescription:We are seeking a skilled data engineer to design, build, and maintain robust data pipelines for high-volume financial data. This role involves collaborating with cross-functional teams to provide clean, structured, and scalable datasets.Design end-to-end data pipelines for stocks, crypto,...
-
Chief Data Pipeline Architect
5 days ago
Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000We are seeking a candidate who is comfortable working on shifts that align with our global operations.Data Engineering OpportunitiesDevelop and maintain data pipelines using advanced frameworks to ensure seamless data flow.Critical Data TransformationsImplement high-touch data transformations for integration to meet client needs.Data Ingestion and...
-
Cloud Data Architect
3 days ago
Gulbarga, Karnataka, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000Cloud Data Engineering OpportunityDesign, develop and deploy end-to-end data pipelines on AWS cloud infrastructure.The ideal candidate will have a strong background in designing and building data pipelines on AWS cloud infrastructure, with hands-on experience in Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Key Responsibilities:Designing and...
-
Cloud Data Leader
2 days ago
Gulbarga, Karnataka, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000Senior Cloud Data ArchitectWe are seeking a Senior Cloud Data Architect to lead our data engineering efforts. With 6+ years of experience in cloud computing and data development, this role will design, develop, and optimize ETL/ELT pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Pipeline Design and Development: Work with structured and...