Data Engineer

1 day ago

India Innodata Inc. Full time
We are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

Key Responsibilities

- Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.
- Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
- Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
- Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
- Develop, test, and maintain robust data pipelines using Python and SQL.
- Implement unit testing, validation, and quality checks for data workflows.
- Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
- Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
- Troubleshoot and resolve configuration or syntax issues in YAML and related files.
- Keep critical Databricks notebooks running reliably to ensure business continuity.
- Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
- Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
- Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.

What we're looking for:

- Strong skills in SQL, Databricks (Spark), and Python/R.
- Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
- Experience in implementing unit tests and quality checks in data workflows.
- Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
- Familiarity with YAML configuration management, debugging, and error resolution.
- Strong problem-solving and debugging skills in data engineering workflows.
- Experience with Snowflake or another cloud data warehouse.
- Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

  • Senior Data Engineer

    3 weeks ago

    India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Data Analyst

    1 day ago

    India Quant-data Full time

    We're Hiring: Data Analyst (Credit Analytics | Remote | Full-Time) Leverage financial and credit data to power AI-driven lending solutions We are seeking a skilled Data Analyst (Credit Analytics) with 4+ years of experience to join our AI-driven lending platform team . In this role, you will analyze financial, customer, and transaction datasets ,...

  • Data Engineer

    4 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & Palantir Foundry Fully Remote Long Term Contract Rate: $10-13 ph ($1,600 - $2,000 per month)We have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project...

  • Data Engineer

    3 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & Typescript Fully Remote Long Term Contract Rate: $20 - $25 per hour ($3,000 - $4,000 per month)We have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project...

  • Data Engineer

    4 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & Palantir FoundryFully Remote6 month full time contractRate: $13.00 - $15.00 per hourWe have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You...

  • Data Engineer

    4 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & TypescriptFully RemoteLong Term ContractRate: $14 - $17 per hourWe have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You should offer at least...

  • Data Engineer

    4 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & Palantir FoundryFully Remote 6 month full time contractRate: $13.00 - $15.00 per hourWe have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You...

  • Data Engineer

    4 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & TypescriptFully Remote Long Term Contract Rate: $14 - $17 per hour We have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You should offer at least...

  • Data Engineer

    3 days ago

    India Insight Global Full time

    100% Remote Data EngineerRequired Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business partners...

  • Data Engineer

    4 days ago

    India R Systems Full time

    Job Title: Data EngineerContract Period: 12 MonthsLocation: Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)Experience- Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)- Proven experience in Python, Spark, and...