Advanced Data Pipeline Solutions Lead

2 days ago


Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Description

We are seeking a highly skilled Data Engineer to lead the development of our data pipeline solutions. As a Senior Data Engineer, you will design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.

Responsibilities:

  • Develop scalable ingestion and transformation workflows across cloud platforms.
  • Build data lake and data warehouse solutions using AWS S3, Azure Data Lake, and AWS Glue.
  • Collaborate with data scientists, analysts, and application developers to support advanced analytics, reporting, and ML workflows.
  • Implement job orchestration, monitoring, and error handling for reliable pipeline execution.
Required Skills and Qualifications

Qualifications:

  • BTECH, BCA, MTECH, MCA, BSC, MSC

Required Skills:

  • AWS Glue, ADF, ADB, Immediate Joiner
Benefits

The successful candidate will have the opportunity to work on a range of challenging projects, collaborating with a talented team of professionals. In addition, they will have access to ongoing training and professional development opportunities.



  • Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Data engineers design, build and maintain systems that store, process and retrieve data. Their primary responsibility is to ensure data quality, security and integrity.Key ResponsibilitiesDesign and implement data pipelines using Azure Data FactoryDevelop and maintain complex SQL queries to extract insights from large datasetsCollaborate with...


  • Tirupati, Andhra Pradesh, India beBeeGenaideveloper Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job OpportunityThe role of a Data Scientist involves leveraging data pipelining tools, reporting tools including PowerBI and Microsoft Excel, as well as Confluence.Key Responsibilities:Develop and maintain complex data pipelines using Python programming language.Drive business outcomes through GenAI concepts and use cases.Collaborate with cross-functional...


  • Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlocking data opportunitiesData engineers play a pivotal role in shaping the future of an organization by designing, building, and managing scalable data pipelines and enterprise solutions.Design, develop, and manage ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks for batch and real-time data processing.Integrate data from various structured...


  • Tirupati, Andhra Pradesh, India beBeeAzureDataFactory Full time ₹ 30,00,000 - ₹ 40,00,000

    We are seeking a highly skilled Freelance Azure Data Factory Specialist to support our data integration and ETL needs.About the RoleThe ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines across multiple sources and destinations using Azure Data Factory (ADF).Key...


  • Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking an experienced Data Engineer with expertise in AWS to join our organization. As a Data Engineer, you will design and implement robust data pipelines using AWS, Python, and SQL to support business analytics and decision-making across multiple domains.The ideal candidate will have a strong command of SQL for creating, managing, and...


  • Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title:Azure Data EngineerJob Description:We are seeking a skilled data engineer to develop, optimize and maintain automated data pipelines supporting governance and analytics initiatives.This role involves designing, building and deploying ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform and curate metadata from multiple...


  • Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewAs a seasoned data pipeline specialist, we seek a highly skilled and motivated ETL developer to join our team.The ideal candidate will have extensive experience in designing, developing, and maintaining efficient data pipelines using IBM DataStage (Cloud Pak for Data) and AWS Glue/Lambda for ingestion from varied sources such as flat files, APIs,...


  • Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Freelance Data EngineerWe are seeking an experienced Freelance Data Engineer with expertise in Python and AWS services. The ideal candidate will design, develop, and optimize data pipelines using AWS Glue, PySpark, and Step Functions.


  • Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data ArchitectWe are seeking an experienced Cloud Data Architect to lead the design and implementation of our cloud-based data ecosystems. As a key member of our team, you will be responsible for developing and maintaining scalable, secure, and efficient data architectures that meet the evolving needs of our organization.Key Responsibilities:Design and...


  • Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Senior Data Scientist RoleThis position involves leveraging advanced analytical and technical expertise to drive impactful data-driven decisions.The role includes designing and implementing robust pipelines using cutting-edge technologies like LangChain and LangGraph.You will work with complex query chaining, prompt orchestration, and integrate AWS Open...