Senior Data Pipeline Engineer

3 days ago

Thāne, Maharashtra, India beBeeAzure Full time ₹ 10,00,000 - ₹ 15,00,000

Job Opportunity

Threats to businesses and organizations are a growing concern in the digital age.

A proactive approach to cybersecurity involves continuous monitoring and testing of digital environments to identify vulnerabilities.

Job Description

Seeking an experienced Freelance Azure Data Factory Specialist to support data integration and ETL needs. The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations for smooth, scalable, and secure data flows across multiple sources and destinations.

  • Pipeline Development: Design, build, and maintain Azure Data Factory pipelines for ETL and ELT processes.
  • Data Integration: Integrate data from multiple sources (on-premise, cloud, structured, and unstructured).
  • Performance Optimization: Optimize pipelines for performance, scalability, and cost efficiency.
  • Data Transformations: Implement data transformations, mapping, and workflow orchestration.
  • Azure Configuration: Configure triggers, parameters, and dynamic pipelines in ADF.
  • Collaboration: Collaborate with data engineers, analysts, and business stakeholders to meet data requirements.
  • Pipeline Security: Ensure security, compliance, and monitoring of pipelines using Azure best practices.
  • Knowledge Transfer: Provide documentation and knowledge transfer to internal teams.

Requirements

  • Proven hands-on experience with Azure Data Factory (ADF).
  • Strong knowledge of ETL/ELT processes, data integration, and pipeline design.
  • Familiarity with Azure services such as Data Lake, Synapse Analytics, SQL Database, and Key Vault.
  • Experience in parameterization, linked services, datasets, and integration runtimes.
  • Strong troubleshooting and optimization skills.
  • Excellent communication and problem-solving abilities.

  • Data Engineer

    3 hours ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock a career in data engineering and join the movement towards informed decision-making.About this roleWe are seeking an experienced data engineer to design and build efficient data pipelines that drive business outcomes. This is a hands-on role that requires problem-solving skills, collaboration with cross-functional teams, and a passion for building...

  • Data Pipeline Lead

    4 days ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Job OverviewWe are seeking a seasoned data engineer to lead our team in designing and developing scalable data pipelines. This role requires expertise in cloud computing, data engineering, and ETL/ELT processes.Key ResponsibilitiesDesign, develop, and optimize complex data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Collaborate with...

  • Data Pipeline Architect

    1 week ago

    Thāne, Maharashtra, India beBeeCloudDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Enterprise Data Engineering LeaderWe are seeking a seasoned data engineering professional to lead the development of secure, scalable, and high-performance data pipelines using Snowflake.Design and implement end-to-end data solutions from data ingestion to analytics and AI projects.Leverage expertise in cloud infrastructure, Terraform, and Pulumi to...

  • Senior Data Engineer Position

    5 days ago

    Thāne, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerJob OverviewWe are seeking a highly skilled and motivated Senior Data Engineer to lead the design, development, and maintenance of our modern data platform.This role is ideal for a seasoned professional with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure who excels in a fast-paced,...

  • Data Pipeline Specialist

    7 days ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineering RoleJob Overview:We are seeking a skilled Data Engineer with expertise in Informatica DEI to design, develop, and implement efficient data pipelines.Main Responsibilities:Design and develop scalable data engineering solutions using Informatica DEICollaborate closely with cross-functional teams to ensure seamless data integration and delivery...

  • Databricks Engineer with Expertise in Data Pipelines

    7 days ago

    Thāne, Maharashtra, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Ingestion SpecialistWe are seeking a seasoned professional to design, develop, and optimize data ingestion pipelines that integrate multiple data sources into Databricks.This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks for efficient workflow management.The...

  • Machine Learning Engineer

    3 hours ago

    Thāne, Maharashtra, India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 30,00,000

    Job TitleMachine Learning Engineering SpecialistJob DescriptionWe are seeking a seasoned Machine Learning Engineering Specialist to join our AI/ML team. This role will involve developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI/ML solutions.The ideal candidate will possess a robust background in traditional...

  • Senior Cloud Data Engineering Specialist

    5 days ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering automation.This role will play a pivotal part in...

  • Senior Pipeline Developer

    5 days ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Data EngineerWe are seeking an experienced professional to build scalable pipelines, work with streaming data, and collaborate with data scientists and stakeholders to deliver high-quality solutions.Key Responsibilities:Design and optimize data pipelines and ETL workflows.Manage and process large datasets using Spark, PySpark, and SQL.Build and...

  • Senior Data Pipeline Developer

    4 days ago

    Thāne, Maharashtra, India beBeeData Full time US$ 80,000 - US$ 1,50,000

    Job SummaryThe ideal candidate will have expertise in developing and maintaining scalable data pipelines using big data technologies such as PySpark, AWS, and Databricks.Responsibilities include designing, building, and optimizing ETL/ELT pipelines, performing data profiling and validation, and collaborating with analytics teams to surface trustworthy KPIs...