Data Engineer
3 days ago
We are looking for an experienced Data Engineer with deep expertise in Elasticsearch to design, build, and maintain scalable data pipelines and infrastructure that power high-performance search and analytics systems.
This role focuses on enabling efficient data ingestion, transformation, indexing, and querying of large-scale structured and unstructured data into Elasticsearch clusters. The ideal candidate will bring strong hands-on experience with ETL/ELT pipeline development, Elasticsearch performance tuning, and data observability in production environments.
Key Responsibilities:
- Design, develop, and maintain robust ETL/ELT pipelines to ingest data into Elasticsearch from multiple data sources (structured, semi-structured, and unstructured).
- Automate and optimize data workflows for transformation and indexing.
- Ensure reliability, scalability, and data quality across all pipeline processes.
- Configure and manage Elasticsearch clusters for optimal performance, scalability, and fault tolerance.
- Optimize index settings, mappings, analyzers, and shard allocation strategies.
- Design efficient index structures and leverage aggregations, filters, and full-text search for fast, accurate queries.
- Implement monitoring and alerting systems using Elastic Stack (Kibana, Beats) and other observability tools.
- Develop automated health checks for APIs, endpoints, and infrastructure components.
- Define and manage key performance metrics and escalation procedures for system health.
- Work closely with application developers, data analysts, architects, and DevOps teams to ensure Elastic-based solutions are stable and scalable.
- Provide technical guidance on Elasticsearch best practices, query design, and performance tuning.
- Contribute to data governance by ensuring high standards in data quality, metadata management, and lineage tracking.
Required Skills
- Strong hands-on experience with Elasticsearch architecture, indexing, and query optimization.
- Proven ability to design and build ETL/ELT data pipelines for search and analytics.
- Expertise in data modeling for search-driven applications.
- Experience with data warehousing concepts and data governance principles.
- Familiarity with tools such as BigQuery, Kibana, or similar analytics dashboards.
- Strong scripting and automation skills using Python, Shell, or equivalent languages.
Preferred Skills
- Experience with 3DX or Teamcenter data structures.
- Exposure to AI/ML workflows and integrating Elasticsearch with machine learning models.
- Familiarity with Elasticsearch observability stack (e.g., Beats, Logstash, APM).
- Understanding of data lake or data lakehouse architectures.
Job Types: Full-time, Permanent
Pay: ₹469, ₹3,000,000.00 per year
Application Question(s):
- Mention your last working date
Experience:
- ETL: 4 years (Preferred)
- Elasticsearch: 4 years (Preferred)
- Python: 4 years (Preferred)
- Data modeling: 4 years (Preferred)
- Data warehouse: 4 years (Preferred)
- bigQuery: 5 years (Preferred)
- AI/ML: 4 years (Preferred)
Work Location: In person
-
Data Engineer
3 days ago
Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per yearData Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...
-
Data Engineer
3 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Lead Data Engineer
5 days ago
Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....
-
Data Engineer
3 days ago
Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...
-
Lead Data Engineer
1 day ago
Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per yearAbout the RoleWe are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to...
-
Python & SSIS Data Engineer
1 week ago
Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 10,00,000 - ₹ 42,00,000 per yearMANDATORY PREVIOUS WORK EXPERIENCE IN SSIS AND PYTHON. (Candidates without this experience in the past will NOT be considered for this role)JOB RESPONSIBILITIES5+ years previous work experience as a Data Engineer.Design and build data pipelines using SSIS, ADF, Talend, Informatica, Data Stage, or Ab Initio to move and transform data reliably.Manage and...
-
Data & Business Insights Associate
7 days ago
Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 12,00,000 per yearWorks under supervision with internal and external teams to understand customer requirements Collaborate with Automation Engineers, Machine Learning Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables. Ability to elaborate on the details of a project Appropriate mathematical knowledge Strong communication and critical thinking...
-
Senior Data scientist
1 week ago
Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...
-
Data Architect
3 days ago
Chennai, Tamil Nadu, India Unifi Data Management Services Full time ₹ 20,00,000 - ₹ 50,00,000 per yearRole Summary:The Data Architect is responsible for designing, governing, and implementing enterprise-wide data architecture strategies to enable trusted, scalable, and high-performing data platforms. This role ensures data consistency, security, and accessibility across multiple business domains aligning data initiatives with business goals and digital...
-
Senior Software Engineer
1 week ago
Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per yearSenior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...