Data Engineer

3 weeks ago

Erode, Tamil Nadu, India Innodata Inc. Full time

We are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

Key Responsibilities

  • Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.

What we're looking for:

  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

  • Data Engineer

    3 weeks ago

    Erode, Tamil Nadu, India Firstsource Full time

    Key Skills and Responsibilities: We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...

  • Data Engineering Expert

    2 weeks ago

    Erode, Tamil Nadu, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    As a skilled data engineer, you will be responsible for designing and developing robust data pipelines using industry-leading tools.Key Responsibilities:Design and develop robust data pipelines using industry-leading tools.Develop skills in data engineering using Python, EMR/Spark, and Kafka/Kinesis streaming.Collaborate with cross-functional teams to...

  • Data Engineer

    2 weeks ago

    Erode, Tamil Nadu, India AgileEngine Full time

    Senior Data Engineer (AI/ML | Python | GCP ) - WFHTHIS IS FULLY REMOTE WORKING OPPORTUNITY.WE NEED IMMEDIATE JOINERS or someone who can join in less than 1 month.If you are interested and fulfill the below mentioned criteria then please share below information.1. EMAIL ID2. YEARS OF RELEVANT EXPERIENCE.3. UPDATED RESUME.4. CCTC/ECTC5. Notice period *Key...

  • Data Engineering Specialist

    2 weeks ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Testing EngineerAre you a data enthusiast looking to take your testing skills to the next level? We are seeking an experienced Senior Data Testing Engineer to join our team.This role involves designing, developing, and executing automated and manual test cases for data validation and transformation processes. You will work closely with data...

  • Data Engineering Expert

    2 weeks ago

    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerJoin a dynamic team as a Senior Data Engineer and play a crucial role in designing, developing, and operating data warehouses and data platform functions.Job Description:Viasat has been shaping how consumers, businesses, governments, and militaries around the globe communicate for over three decades. As a member of our data...

  • Data Engineering Lead

    2 weeks ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are looking for a Data Engineering Lead to join our team.The ideal candidate will have experience in designing and implementing data pipelines, developing scalable data storage solutions, and collaborating with cross-functional teams.Responsibilities:Design and implement data pipelines using Python, Apache Beam, or Spark.Develop scalable data storage...

  • Data Engineer Lead

    2 weeks ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job TitleWe are seeking a highly skilled and experienced Cloud Data Engineer to join our team.This is an exciting opportunity for a talented professional to leverage their technical expertise and passion for data engineering to drive business growth and success.ResponsibilitiesAnalyze and understand existing data warehouse implementations to support...

  • Data Engineering Leader

    2 weeks ago

    Erode, Tamil Nadu, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a senior data engineering professional to join our team as a Data Engineering Manager.Job DescriptionThe successful candidate will provide technical direction for the design, development and maintenance of data systems. This includes overseeing the research, proof of concept, architecture, development, testing, deployment and ongoing...

  • Senior Data Engineer

    3 weeks ago

    Erode, Tamil Nadu, India Collabera Full time

    Senior Data EngineerArrangement: Fully RemoteShift: US Time Zone (Night Shift)Industry: Financial Institution (FI) - Credit UnionJob SummaryCollabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for...

  • Data Engineer

    2 weeks ago

    Erode, Tamil Nadu, India beBeeDevelopment Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title:Data Engineer - ETL Specialist Overview of the Role:Our organization is seeking an experienced data engineer to design, develop, and maintain scalable data pipelines and ETL processes. The ideal candidate will have 6+ years of experience in development and maintenance in a data engineering project.Collaborate with stakeholders to translate data...