Data Pipeline Specialist

4 days ago


Guntur, Andhra Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 17,50,000

Seeking a seasoned Ingestion Expert to spearhead data ingestion strategies. This role demands expertise in designing, developing, and optimizing data pipelines for integrating various sources into Databricks.

Key Responsibilities:
  • Design and implement robust data ingestion pipelines for integrating multiple sources into Databricks.
  • Develop and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion approaches.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Data Engineer Job OverviewWe are seeking a skilled Data Engineer to design and implement efficient data pipelines that transform large datasets into high-quality structured data.Key Responsibilities:Normalize heterogeneous data into structured outputs (CSV, SQL, JSON) for large-scale comparisons.Document workflows, maintain reusable extraction modules, and...


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Job TitleA Data Engineer will be responsible for building and maintaining data pipelines, designing enterprise-grade data architectures, and collaborating with cross-functional teams.Key Responsibilities:Design, build, and maintain robust data pipelines and ETL/ELT processesDevelop data ingestion frameworks to collect data from various sources (databases,...


  • Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Your Potential in Data EngineeringYour potential, unleashed. The global economy is evolving at an unprecedented rate, and it's a perfect time to unleash your skills in data engineering.You'll have the chance to combine our drive to propel with purpose with your passion for data engineering. You'll be part of a team that collaborates, innovates, grows,...


  • Guntur, Andhra Pradesh, India beBeeElasticsearch Full time ₹ 1,48,27,100 - ₹ 2,54,45,400

    Job Summary:About this role:Evaluate the performance of our Elasticsearch and Splunk clusters to identify developing problems, plan changes for upcoming high-load events, apply security fixes, test and perform incremental upgrades, and extend and improve our monitoring and alert infrastructure.Responsibilities Include:Maintaining other parts of the data...


  • Guntur, Andhra Pradesh, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Ingestion Specialist We're seeking a skilled Data Ingestion Specialist to design and develop data ingestion pipelines for integrating multiple sources into Databricks. This role requires expertise in CI/CD, Kubernetes, and data lake architectures. Key Responsibilities: Design, develop, and optimize data ingestion pipelines for integrating multiple...


  • Guntur, Andhra Pradesh, India beBeeETLPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    ETL DeveloperWe are seeking a highly skilled and motivated ETL Developer to join our data engineering team.You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake. Key Responsibilities:Design and Develop ETL PipelinesLeverage best practices for schema design, partitioning, and...


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 35,00,000

    We are seeking a seasoned data professional to spearhead large-scale data pipeline development using cutting-edge technologies like PySpark, AWS, and Databricks.The ideal candidate will possess extensive expertise in Python and SQL, with a proven track record of designing, building, and optimizing complex data pipelines.Key Responsibilities:Design and...


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 50,00,000

    About the Role:We are seeking a seasoned Senior Data Engineer to join our team. This is a critical role responsible for designing, building, and maintaining our data pipeline architecture.This engineer will collaborate closely with data scientists and analysts to facilitate data-related functionalities.They will lead the optimization and scalability of data...


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Data Engineer RoleWe're seeking a skilled professional to lead our data engineering department, designing and building production-level data pipelines that handle large volumes of structured and unstructured data.


  • Guntur, Andhra Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Ingestion SpecialistWe are seeking a skilled Engineer to fill a Data Ingestion position.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management.