Expert Data Pipelining Specialist

5 days ago

Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

Job Opportunity:

We are seeking a skilled Data Engineer to join our organization. The ideal candidate will have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

Key Responsibilities:
  • Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.
Required Skills:
  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.
Benefits:

This is a fantastic opportunity for professionals looking to take their careers to the next level. If you have a passion for data engineering and want to be part of a dynamic team, please apply.

  • Data Pipeline Specialist

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 80,00,000

    Junior Data Engineer PositionWe are seeking a highly motivated and skilled Junior Data Engineer to join our team. As a Junior Data Engineer, you will be responsible for building data pipelines and automation scripts, supporting the implementation of analytical algorithms under guidance, and contributing to documentation and testing processes.Key...

  • Azure Data Factory Pipeline Developer

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job TitleOur team is looking for a Freelance Azure Data Factory Specialist to help us with data integration and ETL processes. The ideal candidate will have hands-on experience in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and destinations.The role requires designing,...

  • Data Engineering Expert

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering ExpertWe are seeking a highly skilled Data Engineering Expert to design, build and maintain scalable data pipelines using Azure cloud services.

  • Data Pipeline Architect

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Key Business Intelligence DeveloperThis role focuses on leveraging data pipelines to drive business growth.You will play a pivotal part in creating scalable, secure, and efficient data architectures using industry-leading tools.The ideal candidate has experience in designing and implementing data models, ETL processes, and database management systems.A...

  • Data Pipeline Architect

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Lead Data Platform Engineer\At our company, we are seeking a highly skilled and experienced Lead Data Platform Engineer to join our team.\As a key member of our engineering team, you will be responsible for designing, building, and operating production-grade data pipelines. You will also lead the delivery of these projects, ensuring they are...

  • Advanced Data Pipeline Specialist

    2 hours ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer - Big DataWe are seeking a highly skilled data engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to fill this position.Main Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and Python for data...

  • Data Engineering Specialist

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeIngestion Full time US$ 1,00,000 - US$ 1,20,000

    Job Title: Data Engineering SpecialistWe require a skilled specialist with expertise in big data processing, cloud computing and data integration to work on data ingestion processes.This role involves the design, development, testing and deployment of data pipelines, automation tools and infrastructure management solutions for scalable and efficient data...

  • Cloud Data Ingestion Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Ingestion SpecialistWe are seeking a seasoned Cloud Data Ingestion Specialist to design and develop cutting-edge data ingestion pipelines for integrating multiple sources into Databricks.Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain Continuous Integration/Continuous...

  • Chief Data Pipeline Architect

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Data Engineer Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have hands-on experience in designing, building, and optimizing scalable data pipelines using Snowflake, AWS Lambda, Glue, DBT, and SQL.

  • Data Assurance Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Assurance SpecialistAbout the Role:We are seeking a highly skilled Data Assurance Specialist to join our team. In this role, you will be responsible for developing and executing tests using various tools, including SQL, Tricentis, Python (PySpark), and data quality frameworks.Key Responsibilities:Developing and Executing Tests: You will...