Data Engineer

2 weeks ago

Thoothukudi, India Innodata Inc. Full time

We are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.


Key Responsibilities

  • Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.


What we’re looking for:

  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

  • Data Platform Engineer

    3 weeks ago

    Thoothukudi, Tamil Nadu, India Tekgence Inc Full time

    Data Platform Engineer Work Location will be Hybrid in Mumbaicontract duration: 12+ monthsStrong Software Engineering SkillsSolid programming expertise, especially in Python, with strong fundamentals in computer science, data structures, algorithms, and system design.Proven problem-solving ability with a focus on writing clean, maintainable, and efficient...

  • Big Data Engineer

    4 weeks ago

    Thoothukudi, Tamil Nadu, India Idyllic Services Full time

    Job Title: Big Data Engineer – ScalaLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid Click the link below to learn more about the role and take the AI Interview to begin your application journey: https://sl1nk.com/XiPeNRole OverviewWe are looking...

  • Data engineer

    4 days ago

    Thoothukudi, India Everise Full time

    Company OverviewJoin us on our mission to elevate customer experiences for people around the world. As a member of the Everise family, you will be part of a global experience company that believes in being people-first, celebrating diversity and incubating innovation. Our dedication to our purpose and people is being recognized by our employees and the...

  • Staff Data Engineer

    3 weeks ago

    Thoothukudi, Tamil Nadu, India Commonwealth Bank Full time

    Organization:At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy...

  • Data Engineering Azure databricks

    1 day ago

    Thoothukudi, India EXL Full time

    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead...

  • Senior Manager, Data Governance Engineering

    1 week ago

    Thoothukudi, India EDB Full time

    EnterpriseDB is seeking an experienced and visionary Senior Manager of Data Governance Engineering to lead our global data governance strategy and engineering execution. This role will focus on building and maintaining the next-generation data ecosystem—spanning transactional, analytical, and AI workloads—while ensuring robust governance, traceability,...

  • Data Engineer L3

    3 weeks ago

    Thoothukudi, Tamil Nadu, India Costco IT Full time

    About Costco Wholesale Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.About Costco Wholesale...

  • Freelance Data Engineer – Python, SQL, AWS

    4 weeks ago

    Thoothukudi, Tamil Nadu, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses and organizations from cyber threats. The company provides services like cloud security, web and mobile security testing, and DevSecOps. ThreatXIntel takes a proactive approach to security by continuously monitoring and...

  • Analytic Engineer

    2 weeks ago

    Thoothukudi, Tamil Nadu, India APPIT Software Inc Full time

    Key Responsibilities:Design, build, and maintain scalable and reusable data models using tools like dbt (Data Build Tool).Collaborate with data engineers to ingest and transform data from various sources.Ensure data quality, consistency, and documentation across all datasets.Work closely with analysts and business teams to understand data needs and deliver...

  • Marketing Data Analyst

    3 weeks ago

    Thoothukudi, Tamil Nadu, India The House of Abhinandan Lodha Full time

    We are seeking a detail-oriented Marketing Data Analyst to join our team in Mumbai. The role requires strong analytical skills to interpret marketing data, derive insights, and support data-driven decision-making for business growth. The ideal candidate will collaborate with the marketing and product teams to measure performance, optimize campaigns, and...