Data Pipeline Engineer

3 days ago

Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 25,00,000

Job Description:

We are seeking a skilled Data Pipeline Specialist to design, build, and optimize scalable data pipelines using Azure Data Factory.

The ideal candidate will have hands-on experience with ADF pipelines, data integration, and transformations for smooth, secure, and efficient data flows.

  • Design and implement Azure Data Factory pipelines for ETL and ELT processes.
  • Integrate data from multiple sources, including on-premise, cloud, structured, and unstructured.
  • Optimize pipelines for performance, scalability, and cost efficiency.

Required Skills and Qualifications:

Technical Requirements:

  • Proven experience with Azure Data Factory (ADF).
  • Strong knowledge of ETL/ELT processes, data integration, and pipeline design.
  • Familiarity with Azure services such as Data Lake, Synapse Analytics, SQL Database, and Key Vault.

Soft Skills:

  • Excellent communication and problem-solving abilities.
  • Strong troubleshooting and optimization skills.

Preferred Skills:

  • Experience with Azure DevOps (CI/CD for ADF pipelines).
  • Knowledge of Azure Monitor / Log Analytics for pipeline monitoring.
  • Familiarity with JSON-based ADF configurations.

Benefits:

As a Data Pipeline Specialist, you will have the opportunity to work on challenging projects, collaborate with experienced professionals, and grow your career in a dynamic environment.

This role offers a chance to develop your technical skills, expand your expertise, and contribute to the success of our organization.

  • Senior Data Pipeline Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    About This RoleWe're seeking an experienced Data Pipeline Specialist to join our data engineering team.As a Data Pipeline Specialist, you will design and develop scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Main Responsibilities:Design, build, and maintain ETL pipelines using IBM DataStage (CP4D)...

  • Data Pipeline Specialist

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 30,00,000 - ₹ 40,00,000

    Key Data Pipeline SpecialistThe role entails designing, developing, and maintaining high-capacity data pipelines that efficiently handle structured and unstructured data.ResponsibilitiesDesign and Build Complex Pipelines: You will be responsible for designing and building complex production-level data pipelines utilizing AWS services such as S3, EC2, RDS,...

  • Data Pipeline Architect

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeETLDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: ETL DeveloperWe are seeking a skilled and motivated ETL professional to join our data engineering team.You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Main Responsibilities:Design, develop, and maintain ETL pipelines using IBM...

  • Data Pipeline Testing Expert

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeTestEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    About UsWe are a leading engineering and digital transformation consultancy, serving top Life Sciences, MedTech, and Healthcare clients across the US, Ireland, and Europe.Job Summary:We are seeking an experienced Senior Test Engineer to drive the testing strategy and execution for a project leveraging Databricks, Data Factory pipelines, and Power BI.Key...

  • Senior Data Pipeline Developer

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,20,000

    Data EngineerWe are seeking a highly skilled Data Engineer to join our dynamic data team. As a key member of the infrastructure team, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital marketing product development.You will collaborate with cross-functional teams...

  • Data Pipeline Architect

    1 week ago

    Coimbatore, Tamil Nadu, India beBeeDatabricks Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Overview:**We are seeking a seasoned Databricks Professional to join our organization on a contract basis. The ideal candidate will possess a strong background in designing and implementing data pipelines using Azure Data Factory, developing high-performance Databricks notebooks leveraging SQL and Python, and working with various file formats.**Key...

  • Data Engineer

    1 day ago

    Coimbatore, Tamil Nadu, India ShellKode Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role OverviewWe are seeking a skilled Data Engineer with 3+ years of hands-on experience in building and managing data pipelines, data models, and cloud-based analytics solutions onGoogle Cloud Platform (GCP). The ideal candidate will have strong expertise in GCP-native services such asBigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer, along with...

  • Senior Data Pipeline Specialist

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Database Engineer OpportunityWe are seeking a skilled ETL/Database Tester to join our team with 5+ years of experience in testing, monitoring, and improving data pipelines.Key Responsibilities:Design, implement, and execute comprehensive test plans for ETL processes and databases.Collaborate with cross-functional teams to identify and prioritize testing...

  • Data Engineer

    1 day ago

    Coimbatore, Tamil Nadu, India Augusta HiTech Software Full time US$ 1,50,000 - US$ 2,00,000 per year

    Industry: ITQualification: Any DegreeRequired Skills: SQL, PythonWorking Shift: 2PM to 11PM ISTCity: CoimbatoreCountry: IndiaJob Title: Senior Data EngineerLocation: [Insert Location or "Remote"]Job Type: [Full-time / Contract]Experience Level: 8+ YearsOverviewWe are seeking a highly experienced Data Engineer with a strong background in SQL and Python. The...

  • Unlock Your Potential as a Senior Data Pipeline Specialist

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Data Pipeline Specialist PositionAt our organization, we are seeking an experienced Senior Data Pipeline Specialist with a strong background in data engineering practices. The ideal candidate will have hands-on expertise in building and automating large-scale data pipelines, managing multi-environment deployments, and working with modern...