Senior Data Pipeline Specialist

3 days ago


Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

We are seeking an AWS Data Engineer to design, develop and maintain data pipelines and applications using Python and PySpark.

Key Responsibilities:
  • Design and implement robust ETL pipelines using PySpark focusing on performance, scalability and data quality
  • Create technical solutions for business requirements using AWS cloud services and Python/PySpark
  • Develop applications for data manipulation, transformation and analysis using Python and PySpark
  • Lead projects from planning to execution, testing and documentation
  • Mentor teams in a technical environment providing solution proposals

The ideal candidate will have 5+ years of experience in data integration and pipeline development with a strong background in AWS Cloud and Apache Spark. Experience with Snowflake and Palantir Foundry is beneficial.

Required Skills and Qualifications:

  • Strong understanding of AWS services including Glue, EC2, S3, EMR and Redshift
  • Experience with PySpark and Python programming
  • Knowledge of data integration and pipeline development

Benefits:

  • Opportunity to work with a highly skilled team
  • Chance to contribute to the development of innovative data solutions
  • Professional growth and development opportunities

Others:

  • Mentorship and guidance from experienced professionals
  • Collaborative and dynamic work environment


  • Hyderabad, Telangana, India beBeeDataPipeline Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking an accomplished Data Pipeline Specialist to join our team. The successful candidate will be responsible for creating and maintaining data pipelines that drive business growth.Main ResponsibilitiesCreate and implement new data pipelines to meet business needsEssential Skills and Qualifications4-6 years of experience in designing and...


  • Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a seasoned professional to fill the role of Senior Data Engineer. The successful candidate will design and develop end-to-end data integration solutions, optimize workflows, and collaborate with stakeholders to deliver scalable and high-performing data pipelines.Develop ETL/ELT workflows using Informatica...


  • Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a skilled data engineer to design, build, and optimize robust data pipelines for our platform.The ideal candidate will ingest, transform, and manage vast amounts of operational data from various devices, ensuring high data quality and availability for analytics and AI/ML applications.Key Responsibilities:Design scalable and...


  • Hyderabad, Telangana, India beBeeData Full time ₹ 1,55,52,000 - ₹ 2,59,20,000

    Senior Data EngineerWe seek an expert in designing and maintaining large-scale data pipelines on Azure using Databricks, ADF, and PySpark. This individual will ensure high-quality, secure, and reliable datasets for analytics and customer-facing applications.Key ResponsibilitiesDesign, build, and optimise large-scale data pipelines using Databricks, Delta...


  • Hyderabad, Telangana, India beBeeDataPipelineManager Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Team LeadData Pipeline ManagerWe are seeking a seasoned data pipeline manager with experience in designing and developing robust data pipelines using Azure Databricks, Data Factory, and Datalake.The role involves overseeing the development of complex ETL solutions, managing large volumes of data, and working closely with business teams to...


  • Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 6,00,000 - ₹ 10,00,000

    Job Description">We are seeking a highly skilled data professional to lead our efforts in designing and maintaining efficient, scalable data pipelines and analytics platforms. The ideal candidate will have hands-on experience in Azure Data Factory, Azure Databricks, PySpark, and .NET Framework. "The selected individual will be responsible for application...


  • Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...


  • Hyderabad, Telangana, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Operations SpecialistWe are seeking an experienced Senior Data Operations Specialist to support our data organization. This role involves maintaining data pipelines and corresponding platforms while collaborating with global teams on DataOps initiatives.Maintain day-to-day operations of data pipelines, ensuring data governance, reliability, and...


  • Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Data Engineer PositionWe are seeking a skilled data engineer to join our team. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our platform.Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Integration: Integrate...


  • Hyderabad, Telangana, India beBeeBusiness Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Business Intelligence ArchitectWe are seeking an experienced Business Intelligence Architect with a strong background in data engineering and a passion for designing, building, and optimizing scalable data pipelines.The ideal candidate will have hands-on experience in Snowflake, AWS Lambda, Glue, DBT, and SQL. They will be responsible for...