Big Data Pipeline Specialist

2 days ago


Rajahmundry, Andhra Pradesh, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

Job Opportunity: Data Pipeline Specialist

Our company seeks a skilled and experienced professional to build and maintain large-scale data pipelines using AWS services.

Key Responsibilities:
  • Design, develop, and implement production-level data pipelines that handle structured and unstructured data at terabyte scale.
  • Own the end-to-end ETL/ELT processes, ensuring reliability, scalability, and high availability of data workflows.
  • Collaborate with cross-functional teams, including AI/ML engineers, to support model training, retrieval-augmented generation, and analytics pipelines.
  • Continuously monitor and optimize data workflows for performance and cost efficiency.
Required Skills:
  • 1–2 years of experience in data engineering or a related field.
  • Proven expertise in building and running production pipelines at terabyte scale.
  • Proficiency in Python, SQL, and AWS cloud services.
  • Strong knowledge of big data best practices and ability to work in a fast-paced startup environment.
Benefits:
  • Opportunity to work on complex data projects and contribute to the growth of our company.
  • Chance to collaborate with talented professionals in the field of data engineering.


  • Rajahmundry, Andhra Pradesh, India beBeeDataPipelines Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Pipelines SpecialistAbout the RoleWe are seeking a highly skilled data pipelines specialist to join our team. You will work on designing and building scalable, efficient data pipelines using various technologies including IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design and develop data pipelines that...


  • Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Test EngineerAs a specialist in ETL and Power BI testing, you will be responsible for ensuring the accuracy, integrity, and performance of data pipelines deployed into cloud environments.The role involves developing and automating comprehensive test cases to validate data flows, transformations, and system behaviors using python scripting and Pytest...


  • Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data EngineerAbout the RoleWe are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies and experience working with large-scale data processing systems.The successful candidate will be responsible for designing, implementing, and maintaining scalable...


  • Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Big Data Cluster SpecialistWe are seeking an experienced Big Data specialist to manage and maintain our Cloudera cluster. The ideal candidate will have a strong background in administering large-scale data processing systems.Key Responsibilities:Building and managing distributed data processing environmentsMigrating data between platforms to ensure seamless...


  • Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistJob Description:We are seeking a highly skilled Data Engineering Specialist to join our team. As a key member of the data engineering team, you will be responsible for designing and implementing scalable data solutions that meet the needs of our business.The ideal candidate will have a strong background in data...


  • Rajahmundry, Andhra Pradesh, India beBeeDatabase Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data Database Management Specialist">Our team is looking for a skilled Big Data Database Management Specialist to lead the administration and management of our data platforms. As a key member of our IT department, you will be responsible for designing, implementing, and maintaining database systems that support our business operations.">The...


  • Rajahmundry, Andhra Pradesh, India beBeeDataAdministration Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data Administration SpecialistWe are seeking an experienced professional to fill the role of a Data Administration Specialist.The ideal candidate will have a strong background in data processing and administration, with experience in managing large datasets and ensuring data quality.Responsibilities:Manage Databricks clusters, notebooks,...


  • Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Data Engineering SpecialistThis is an exciting opportunity to join our dynamic data team as a Data Engineering Specialist. We are seeking an experienced professional to design, build, and maintain robust data pipelines and ETL/ELT processes.About the Role:We are looking for a highly skilled Data Engineer who can work collaboratively with our...


  • Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer RoleJob DescriptionWe are seeking a skilled Data Engineer to design, develop and maintain data pipelines and ETL processes on Databricks.The ideal candidate will lead the architecture and implementation of scalable, secure and high-performance data solutions.They will collaborate with business stakeholders, data scientists and analysts to...


  • Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title: Data Architecture SpecialistWe are seeking a highly skilled professional to design, construct and optimize large-scale data processing systems that enable advanced analytics and business intelligence.About the RoleDesign, develop and maintain scalable and robust data pipelines that collect, process and store large volumes of structured and...