Data Engineer

7 days ago

tamil nadu, India NielsenIQ Full time

Role Summary:Design, build, and optimize large-scale ETL and data-processing pipelines handling GB–TB volumes. Operate within the Databricks ecosystem and drive migration of selected workloads to high-performance engines such as Polars and DuckDB. Maintain strong engineering rigor across CI/CD, testing, and code-quality enforcement. Apply analytical thinking to solve data reliability, performance, and scalability problems. AI familiarity is advantageous.Core Responsibilities:Develop and maintain distributed data pipelines using Scala, Spark, Delta, and Databricks.Engineer robust ETL workflows tuned for high-volume ingestion, transformation, and publishing.Profile pipelines, remove bottlenecks, and optimize compute, storage, and job orchestration.Lead migration of suitable workloads to Polars, DuckDB, or equivalent high-performance engines.Implement CI/CD workflows with automated builds, tests, deployments, and environment gating.Enforce coding standards through code coverage targets, unit/integration tests, and SonarQube rules.Ensure pipeline observability: logging, data quality checks, lineage, and failure diagnostics.Apply analytical reasoning to triage complex data issues and deliver root-cause clarity.Contribute to AI-aligned initiatives when required: RAG design, fine-tuning workflows, agentic patterns.Collaborate with product, analytics, and platform teams to operationalize data solutionsRequired Skills and Experience:3+ years in data engineering with strong command of Scala and Spark.Proven background in ETL design, distributed processing, and high-volume data systems.Hands-on experience with Databricks (jobs, clusters, notebooks, Delta Lake).Proficiency in workflow optimization, performance tuning, and memory management.Experience with Polars, DuckDB, or similar columnar/accelerated engines.CI/CD discipline using Git-based pipelines; strong testing and code-quality practices.Familiarity with SonarQube, coverage metrics, and static analysis.Strong analytical and debugging capability across data, pipelines, and infra.Exposure to AI concepts: embeddings, vector stores, retrieval-augmented generation, fine-tuning, agentic architectures.Preferred:Experience with Azure cloud environments .Experience in metadata-driven or config-driven pipeline frameworks.

  • Data Activity Monitoring

    2 weeks ago

    tamil nadu, India NTT DATA, Inc. Full time

    Role: Data Activity Monitoring (DAM) Engineers – L1 & L2Location: Chennai, IndiaEducation: BE / B.Tech / MCA in Electronics, Electrical, or Computer SciencePosition 1: DAM Engineer – L1Experience: 2 yearsBudget: ₹5.85 LPAKey Responsibilities:Support day-to-day operations of Data Activity Monitoring tools.Monitor database and application activity to...

  • Data & Business Insights Associate

    1 day ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    **Data & Business Insights Associate**Summary**NTTDATA Services are seeking Data & Business Insights Associate with basic understanding of data and reporting. They will also work with data analysts and automation experts to create new visuals and features that support business intelligence initiatives.**Accountabilities**Understand, Gathering and Prepare the...

  • Senior Data Consultant

    3 weeks ago

    tamil nadu, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team. The candidate is expected to lead following work-streams: • Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...

  • Senior Data Consultant

    3 hours ago

    tamil nadu, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...

  • Data Engineer

    1 week ago

    tamil nadu, India YO HR Consultancy Full time

    Data Engineer/Senior Data Engineer Location: Chennai Experience: 2 - 8 Years Role Description The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets....

  • Data Engineer

    2 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities:Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    2 weeks ago

    tamil nadu, India Prana Tree Full time

    Job Title: Data Engineer                                                                                                                             Location: Chennai / Hyderabad / PuneWork Mode: Work from OfficeExperience: 4–8...

  • Data Engineer

    4 days ago

    tamil nadu, India JIT Global Infosystems Pvt. Ltd. Full time

    Company Description:JIT Global Infosystems Pvt. Ltd. delivers comprehensive Applications, Analytics, and Consulting services to clients worldwide. By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance. Our experienced global leadership team utilizes an innovative delivery model to cater to a...

  • Data Engineer

    4 days ago

    tamil nadu, India Wisemonk Full time

    Data Engineer/Data Lab ResearcherWe are seeking a highly skilled Data Engineer to join our team in a full-time role based in Chennai, India. You’ll play a key role in building and optimizing our data infrastructure to support a wide range of research initiatives across the company. Your work will ensure that data is clean, reliable, and accessible for...

  • Data Engineer

    1 week ago

    tamil nadu, India Prana Tree Full time

    Job Title: Data Engineer                                                                                                                              Location: Chennai / Hyderabad / Pune Work Mode: Work from Office Experience: 4–8...