Senior Data Pipeline Specialist

4 days ago

Hyderabad Secunderabad Telangana, India beBeeData Full time ₹ 1,00,000 - ₹ 13,00,000
Job Opportunity

As a Data Engineer, you will be responsible for designing and developing robust data pipelines using Azure Data Factory (ADF) and Azure Databricks. Your expertise in SQL query writing, including window functions and stored procedures, will help us achieve our data analysis goals.

  • Design and Develop Data Pipelines: Use ADF to create efficient data pipelines that meet our business needs.
  • SQL Query Expertise: Write proficient SQL queries on Teradata and other cloud-based RDBMS for data mining and analysis.
  • Collaboration and Communication: Work closely with project stakeholders, architects, and business teams to translate requirements into technical solutions.
  • Big Data Handling: Gain hands-on experience with Azure Blob Storage and ADLS for efficient data handling and processing.
  • PySpark/Scala Experience: Utilize PySpark/Scala for data transformation and processing within Azure Databricks.
Requirements
  • Azure Data Factory Experience: Strong experience in ADF, including design, development, and maintenance of data pipelines.
  • SQL Knowledge: Proficiency in SQL (ANSI Standard), including writing proficient queries for data mining, window functions, and stored procedures.
  • Cloud-Based Tools: Hands-on experience with Azure Blob storage and ADLS, as well as knowledge of version control tools like GitHub.
  • Communication Skills: Good communication skills and strong analytical abilities for problem-solving.
Good To Have
  • Orchestration Tool Knowledge: Familiarity with orchestration tools like Airflow for scheduling and managing data workflows.
  • Domain Experience: Domain experience in Healthcare would be beneficial.

  • Senior Data Pipeline Specialist

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Job DescriptionWe are seeking a seasoned Data Architect to spearhead the design and implementation of our data pipelines. This is an exciting opportunity to leverage your expertise in data engineering and drive business growth through actionable insights.The ideal candidate will have a strong background in designing scalable and robust data solutions, with...

  • End-to-End Data Pipeline Solutions Leader

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Lead Data Integration SpecialistWe are seeking an experienced Lead Data Integration Specialist to drive the development and implementation of our end-to-end data pipeline solutions. This is a leadership role that requires strong technical expertise, excellent communication skills, and the ability to collaborate effectively with cross-functional teams.

  • Senior Cloud Data Specialist

    6 days ago

    Pune, Chennai, Hyderabad / Secunderabad, Telangana, India beBeeCloudDataSpecialist Full time ₹ 12,00,000 - ₹ 24,00,000

    Job OverviewWe are seeking an experienced Senior Cloud Data Specialist to join our team. The successful candidate will be responsible for designing and implementing data pipelines, ensuring data quality, scalability, and efficiency.Key Responsibilities:Data Integration & Pipeline DevelopmentThe ideal candidate will design and implement data pipelines to...

  • Senior Data Pipeline Developer

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, Gurgaon / Gurugram, India beBeePipeline Full time US$ 90,000 - US$ 1,20,000

    Senior Data Pipeline DeveloperJob Description:As a seasoned data pipeline developer, you will play a pivotal role in designing, developing, and maintaining scalable data pipelines and systems. You will be responsible for implementing data integration, transformation, and validation processes to ensure seamless data flow and quality.Key Deliverables...

  • Data Pipeline Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataPipeline Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking an accomplished Data Pipeline Specialist to join our team. The successful candidate will be responsible for creating and maintaining data pipelines that drive business growth.Main ResponsibilitiesCreate and implement new data pipelines to meet business needsEssential Skills and Qualifications4-6 years of experience in designing and...

  • Data Pipeline Engineer

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time

    We are currently seeking a highly skilled Data Pipeline Engineer to design, develop and maintain data pipelines using Azure Data Factory.ResponsibilitiesCreate efficient data workflows by designing and implementing Azure Data Factory (ADF) pipelines.Collaborate with cross-functional teams to understand data requirements and ensure seamless data...

  • Data Pipeline Tester

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataPipelineTester Full time

    Job TitleWe are seeking a highly skilled professional to fill the position of Data Pipeline Tester. This role involves testing data pipelines and ensuring that they function as expected.Key ResponsibilitiesDesign and execute test cases for data pipelinesIdentify and report defects in the data pipelineCollaborate with cross-functional teams to resolve defects...

  • Cloud Pipeline Specialist

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeePipeline Full time

    Cloud Pipeline Specialist", "Are you a seasoned cloud professional looking for a new challenge? We are seeking an experienced Cloud Pipeline Specialist to join our team. In this role, you will be responsible for designing, implementing, and maintaining CI/CD pipelines using Azure DevOps.Key Responsibilities:", "", "Design and implement CI/CD pipelines: Using...

  • Senior Data Analysis Specialist

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataAnalysis Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Senior Data Analysis SpecialistWe are seeking a highly skilled and experienced data analysis specialist to join our team. This role will require you to work independently or in a team to solve complex data problems using unstructured data.This position involves collaborating with other team members and disciplines to deliver project requirements...

  • Senior Data Pipeline Engineer

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataAnalysis Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a highly skilled ETL Data Analyst to join our team. As an ETL Data Analyst, you will be responsible for designing, developing, and implementing data pipelines that extract, transform, and load data from various sources into our database.Required Skills and Qualifications7+ years of experience in Quality Assurance with a strong...