Data System Engineer

9 hours ago

Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000
Job Title

We are seeking a talented Data Specialist to join our team and take on the challenge of designing, implementing, and managing large-scale data systems.

Key Responsibilities:

  • Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.
Requirements
  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

  • Data Scientist/ML Engineer

    4 days ago

    Vijayawada, Andhra Pradesh, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...

  • Leading Data Systems Engineer

    9 hours ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Data Engineer RoleOur organization is seeking a seasoned Data Engineer to collaborate with our global engineering team on a multi-year project initiative.Key Responsibilities:Cultivate data engineering expertise within the project teamDevelop and maintain large-scale data systems utilizing Palantir Foundry, Workshop, PySpark, and TypescriptRequirements:5-8...

  • Senior Data Systems Developer

    2 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 17,00,000

    Data Engineer Job DescriptionAs a Data Engineer, you will play a crucial role in designing, building, and maintaining data systems. This includes collaborating with cross-functional teams to ensure the highest standards of data quality and performance.You will be responsible for extending your expertise in data engineering, data architecture, pipeline...

  • Spatial Data Engineer

    8 hours ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Spatial Data EngineerWe are seeking an experienced Spatial Data Engineer to join our team. This role is crucial in the production and management of geospatial data across various projects.The position encompasses tasks such as digitization, geocoding, and conducting surveys when necessary.Key Responsibilities:Geospatial Data Production: Engage in...

  • Principal Data Engineer

    9 hours ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering ProfessionalOverview:Develop, optimize and maintain scalable data pipelines to support business intelligence and analytics initiatives.Description:Key ResponsibilitiesPipeline Development: Design, build and deploy robust ETL/ELT pipelines in Azure Databricks (PySpark, SQL, Delta Lake) to ingest, transform and curate governance and...

  • Chief Data Engineer

    11 hours ago

    Vijayawada, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 17,50,000 - ₹ 23,45,000

    Job Overview:We are seeking an experienced Data Architect to lead our data engineering initiatives on Google Cloud Platform (GCP). As a key member of our team, you will be responsible for designing and implementing end-to-end data pipelines and integration solutions for structured and unstructured data sources and targets.The ideal candidate will have...

  • Cloud Data Engineering Specialist

    2 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Azure Data EngineerTransform business operations by leveraging cutting-edge data engineering techniques.Collaborate with cross-functional teams to drive innovation and growth through data-driven insights.Job Description:As a seasoned data engineer, you will play a pivotal role in designing, building, and maintaining large-scale data systems that...

  • Backend Engineer

    1 day ago

    Vijayawada, Andhra Pradesh, India beBeeDataSpecialist Full time US$ 90,000 - US$ 2,00,000

    Job Title:Backend Engineer - Data SpecialistJob DescriptionImagine a world where everyone has improved access to financial services, empowering people to start new businesses, pay for education and cover emergency medical bills. Our company is revolutionizing financial access for millions of underserved customers across Africa and India.We're leveraging...

  • eBPF Systems Engineer

    23 hours ago

    Vijayawada, Andhra Pradesh, India Alma Security Full time

    The ideal candidate will help build, maintain, and troubleshoot, the company's rapidly expanding infrastructure. They will work alongside other engineers to ensure highest levels of performance and ability, and manage any problems that arise.  ResponsibilitiesManage and monitor installed systems Test and maintain operation systems Monitor application...

  • Data Engineer

    27 minutes ago

    Vijayawada, Andhra Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 20,00,000

    Ingestion engineers are crucial for our organization's data strategy, responsible for crafting efficient data ingestion pipelines that integrate multiple sources into Databricks.Key Responsibilities:Data Ingestion Pipelines: Develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.CI/CD Pipeline Implementation: Implement...