Expert Azure Data Pipelines Consultant

5 days ago

Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

At ThreatXIntel, we are dedicated to protecting businesses and organizations from cyber threats. Our proactive approach to security involves continuously monitoring and testing digital environments to identify vulnerabilities.

We are seeking an experienced Azure Data Factory (ADF) Specialist to support our data integration and ETL needs. The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and destinations.

Key Responsibilities:

  1. Designing, building, and maintaining Azure Data Factory pipelines for ETL and ELT processes
  2. Integrating data from multiple sources (on-premise, cloud, structured, and unstructured)
  3. Optimizing pipelines for performance, scalability, and cost efficiency
  4. Implementing data transformations, mapping, and workflow orchestration
  5. Configuring triggers, parameters, and dynamic pipelines in ADF
  6. Collaborating with data engineers, analysts, and business stakeholders to meet data requirements
  7. Ensuring security, compliance, and monitoring of pipelines using Azure best practices
  8. Providing documentation and knowledge transfer to internal teams

Requirements:

  • Proven hands-on experience with Azure Data Factory (ADF)
  • Strong knowledge of ETL/ELT processes, data integration, and pipeline design
  • Familiarity with Azure services such as Data Lake, Synapse Analytics, SQL Database, and Key Vault
  • Experience in parameterization, linked services, datasets, and integration runtimes
  • Strong troubleshooting and optimization skills
  • Excellent communication and problem-solving abilities

  • Data Pipeline Specialist

    2 days ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **Role:** Data EngineerWe are seeking an experienced professional to design and implement scalable data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and SQL endpoints.Develop ETL/ELT solutions using PySpark, T-SQL, and Spark Notebooks within Fabric and Azure Synapse.Manage and optimize data storage and compute in OneLake...

  • Azure Data and AI Professional

    1 week ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a Subject Matter Expert (SME) in Azure Data & AI to drive technical depth, accuracy and instructional value of our training content.Lead definition and review of presentations, labs and real-world scenarios on Azure's modern data and AI stack, working closely with content creators to shape advanced certification-aligned learning...

  • Data Solutions Expert

    6 days ago

    Shimoga, Karnataka, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Job Title: Data Architect ConsultantAbout the Role:We are seeking a highly skilled Data Architect Consultant to join our team. As a key member of our data solutions group, you will be responsible for designing and implementing scalable data processing solutions within Azure Synapse Analytics.Key Responsibilities:Design, implement, and manage data pipelines...

  • Data Engineering Expert

    1 week ago

    Shimoga, Karnataka, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering ExpertWe are seeking a seasoned Data Engineering professional with expertise in designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks.Design and implement scalable data ingestion architectures using Databricks, Spark, and data lake technologies.Develop and maintain CI/CD...

  • Azure Cloud Data Solutions Architect

    7 days ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Job OverviewData engineers play a pivotal role in designing, building, and maintaining complex data systems for organizations. This position requires a strong foundation in computer science and experience with big data technologies.Bachelor's degree in Computer Science, Information Technology, or a related field is essential; a Master's degree is highly...

  • Data Factory Expert

    2 days ago

    Shimoga, Karnataka, India beBeeDataFactory Full time ₹ 80,00,000 - ₹ 1,53,70,000

    Job Title: Data Factory SpecialistWe are seeking a skilled Data Factory specialist to join our team and play a key role in designing, developing, and maintaining Extract, Transform, Load (ETL) pipelines.The ideal candidate will have expertise in Azure Data Factory, proficiency in T-SQL and SQL Server, and experience with cloud-based data solutions.Primary...

  • Azure Integration Solutions Expert

    6 days ago

    Shimoga, Karnataka, India beBeeIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleAzure Integration Developer About This RoleThis role involves designing and developing integrations using Azure Service Bus, Logic Apps, Power Automate, Power Apps, Azure Functions, and ADF.Responsibilities include developing APIs and microservices to integrate with third-party applications. Key ResponsibilitiesIntegration Architecture: Design and...

  • High-Performance Data Pipeline Specialist

    1 week ago

    Shimoga, Karnataka, India beBeePerformance Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerThis role is ideal for a skilled professional who can design, build, and maintain high-performance data pipelines. Key Responsibilities: Design and implement scalable batch processing systems using Python and big data technologies Optimize database performance, focusing on slow-running queries and latency improvements Use...

  • Senior Data Scientist

    13 hours ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Summary:Data Engineering ExpertWe are seeking a skilled Data Engineer to join our team. As a key member, you will design and develop scalable data analytics solutions, collaborate with cross-functional teams, and ensure data integrity and security.Design and implement robust data pipelines using Azure Data Factory, Databricks, Snowflake, and Azure SQL...

  • Principal Cloud Data Specialist

    7 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking a skilled Senior Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and optimizing scalable data pipelines and Lakehouse architectures on Microsoft Azure.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse...