Data Engineer

3 weeks ago

Anantapur, Andhra Pradesh, India Innodata Inc. Full time

We are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

Key Responsibilities

  • Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.

What we're looking for:

  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

  • Data engineer

    3 weeks ago

    Anantapur, Andhra Pradesh, India SourceFuse Full time

    Source Fuse Technologies hiring for Data Engineer with 3+ years for experience Job Summary:As a Data Engineer, you'll manage the invisible backbone of our analytics, building scalable data pipelines that fuel real-time insights for 630+ ships worldwide. Your work will turn raw data points into actionable intelligence, propelling machine learning models and...

  • Data Engineering Role

    1 week ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineer PositionWe are looking for a highly skilled Data Engineer to play a key role in the development of our data processing systems.

  • Data Engineer and Architect

    2 weeks ago

    Anantapur, Andhra Pradesh, India beBeeEngineering Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Job Title: Data Platform Engineering LeadOur organization is seeking a highly skilled Data Platform Engineering Lead to design and scale our core data foundation.You will be responsible for leading the design of clean, scalable models, driving data platform strategy, and enabling a high-velocity product development culture.Architect, develop, and maintain a...

  • Big data engineer

    3 weeks ago

    Anantapur, Andhra Pradesh, India Idyllic Services Full time

    Job Title: Big Data Engineer – ScalaLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid ???? Click the link below to learn more about the role and take the AI Interview to begin your application journey: Pe NRole OverviewWe are looking for a highly...

  • Data Engineer Opportunity

    1 week ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title">As a Data Engineering Specialist, you will be responsible for designing and implementing data engineering solutions using ETL processes, SQL, and BigQuery. You will work with complex data sets, develop innovative solutions, and ensure high-quality data integration and automation.">Key Responsibilities:">Diagnose and troubleshoot complex issues...

  • Data Engineer Position

    2 weeks ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Role:AWS Certified Data Engineer positionWe are seeking a highly skilled and experienced data professional to design, develop, and maintain data pipelines and ETL processes using AWS services.Key Responsibilities:Designing and developing scalable data pipelinesMaintaining data quality and integrityCollaborating with cross-functional teams to implement...

  • Data Engineering Director

    2 weeks ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 45,00,000 - ₹ 60,00,000

    Data Engineering LeaderYou will be responsible for the design and development of enterprise-grade data systems. You will work closely with engineering teams and business partners to drive project deliverables and timelines.Key Responsibilities:Contribute high-quality code across data pipelines, APIs, and platform components.Communicate project deliverables,...

  • Data Engineering Expertise

    2 weeks ago

    Anantapur, Andhra Pradesh, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,02,50,000

    As a highly skilled Lead Data Engineer, you will be responsible for designing, developing and optimizing data pipelines using Azure services.Main Responsibilities:Develop scalable ELT/ETL workflows with Databricks, Delta Lake, ADF and other Azure services.Collaborate with the team to ensure efficiency in work processes and contribute to their professional...

  • Azure Data Engineer Specialist

    2 weeks ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 14,37,914 - ₹ 25,11,876

    As a Data Engineering Leader, you will be responsible for designing and implementing large-scale data engineering solutions using Azure Databricks.Key Responsibilities:Design and implement data pipelines using Azure DatabricksDevelop and maintain ETL processes to integrate data from various sourcesCollaborate with cross-functional teams to ensure data...

  • Senior Data Engineer

    3 weeks ago

    Anantapur, Andhra Pradesh, India GSONE Technologies Full time

    We are seeking a Senior Data Engineer with 4–5 years of experience, located in Chennai or anywhere within Tamil Nadu, to join our remote-first team. You will be responsible for designing and implementing high-quality, secure, and scalable data pipelines and systems that power reporting, analytics, and operational use cases.This is a remote-first...