Senior Data Pipeline Developer

5 days ago

Hyderabad, Telangana, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000
Data Engineering Leader

We are seeking a highly skilled data engineer to join our organization. The successful candidate will be responsible for designing, implementing and optimizing data pipelines using Azure Data Factory (ADF) and Power BI.

Key Responsibilities:

  • Develop and maintain data pipelines using ADF for data integration and ETL processes.
  • Design, implement and optimize Power BI reports and dashboards to deliver actionable business insights.
  • Collaborate with data analysts, business users and other teams to understand data requirements and deliver solutions using ADF and Power BI.
  • Extract, transform and load (ETL) data from various sources into cloud-based storage systems such as Azure Data Lake or Azure SQL Database.
  • Work with large datasets and optimize queries and pipelines for performance and scalability.
  • Ensure data quality, integrity and availability throughout the data lifecycle.
  • Automate repetitive data tasks, ensuring timely and accurate reporting.
  • Monitor and troubleshoot data pipelines, addressing any performance or data issues promptly.
  • Support data visualization and reporting tools, including Power BI, to enable business stakeholders to make data-driven decisions.

Requirements:

  • Bachelor's degree in computer science, information technology, engineering or a related field.
  • 8+ years of hands-on experience in data engineering, BI development or a similar role.
  • Proficiency with Azure Data Factory (ADF), including the creation of data pipelines and managing data flows.
  • Strong experience in Power BI, including report creation, dashboard development and data modeling.
  • Experience with SQL and database management (e.g., Azure SQL Database, SQL Server).
  • Knowledge of cloud platforms, especially Microsoft Azure.
  • Familiarity with data warehousing concepts and ETL processes.
  • Experience working with cloud-based data storage solutions (e.g., Azure Data Lake, Azure Blob Storage).
  • Strong programming skills in languages such as Python, SQL or other relevant languages.
  • Ability to troubleshoot and optimize data pipelines for performance and reliability.

Preferred Qualifications:

  • Familiarity with data modeling techniques and practices for Power BI.
  • Knowledge of Azure Databricks or other data processing frameworks.
  • Knowledge of Microsoft Fabric or other Cloud Platforms.

About Our Organization:

We are a passionate and innovative team in a fast-paced, growth-oriented environment. We offer competitive compensation and potential for growth within the company. Recognized for excellence in data and AI solutions with industry awards and accolades.

  • Data Pipeline Architect

    1 week ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a seasoned professional to fill the role of Senior Data Engineer. The successful candidate will design and develop end-to-end data integration solutions, optimize workflows, and collaborate with stakeholders to deliver scalable and high-performing data pipelines.Develop ETL/ELT workflows using Informatica...

  • Data Pipeline Developer

    1 week ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Data Pipeline DeveloperJob Summary:We are seeking a skilled data pipeline developer to design, build, and maintain scalable and reliable data pipelines across our Data & AI ecosystem.This role is crucial in enabling downstream analytics, machine learning, and business intelligence solutions by ensuring robust and automated data acquisition from various...

  • Senior Data Pipeline Developer

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Immerse yourself in a role that requires creativity, analytical skills, and technical expertise. As a Data Engineer, you will be responsible for crafting data pipelines that drive business decisions.Key aspects of this position include designing scalable ETL/ELT pipelines using Python, collaborating with cross-functional teams to understand data...

  • Senior Pipeline Development Lead

    2 weeks ago

    Hyderabad, Telangana, India beBeePipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Pipeline EngineerOverview: We are seeking a skilled and experienced pipeline engineer to lead the design and engineering of pipeline systems.This role involves the selection of routes, specification of materials, stress analysis, and hydraulics.The selected candidate will be responsible for preparing and reviewing pipeline technical...

  • Lead/Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Senior Data Pipelines Developer

    7 days ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    About our Data Engineering role: We are seeking an experienced professional to join our team in designing, developing and maintaining large-scale data pipelines.Key ResponsibilitiesCreate efficient ETL processes to integrate data from multiple sources into data warehouses/lakes.Work with Big Data ecosystems to process structured and unstructured data.Develop...

  • Data Engineer

    2 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Job DescriptionOur team is seeking a talented Data Engineer to play a key role in designing, building and maintaining scalable data pipelines using Python and PySpark. The ideal candidate will have hands-on experience with distributed data systems and a solid foundation in AWS.This is an exciting opportunity to work closely with senior engineers and product...

  • Chief Data Pipeline Architect

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Enterprise Data Architect RoleThe Senior Data Engineer will lead the design, optimization, and support of large-scale data platforms. This position is responsible for modernizing legacy systems, creating scalable pipelines, and enabling advanced analytics-ready data ecosystems.Main ResponsibilitiesDesign and build efficient data pipelines using cloud-native...

  • Senior Data Pipeline Specialist

    4 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    We are seeking an AWS Data Engineer to design, develop and maintain data pipelines and applications using Python and PySpark.Key Responsibilities:Design and implement robust ETL pipelines using PySpark focusing on performance, scalability and data qualityCreate technical solutions for business requirements using AWS cloud services and Python/PySparkDevelop...

  • Senior Data Pipeline Architect

    7 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Data Pipeline Engineer Job Description:">This role will be instrumental in designing, building and maintaining robust, scalable and reliable data pipelines using Confluent Kafka, ksqlDB, Kafka Connect and Apache Flink.The ideal candidate will have a strong understanding of data streaming concepts, experience with real-time data processing and a passion for...