Data Engineering Engineer

2 weeks ago

Chennai, Tamil Nadu, India Megan Soft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Position Description:

Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately

Key Responsibilities:

1) Collaborate with business and technology stakeholders to understand current and future data requirements

2) Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis 3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow

4) Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data

5) Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks

6) Ensure optimum performance and identify improvement opportunities

Skills Required:

Data Warehousing, Big Query,, Data Governance, Data/Analytics, Data/Analytics dashboards, Data Model, Elasticsearch

Skills Preferred:

3dx, AI/ML

Experience Required:

Engineer 2 Exp: 4+ years Data Engineering work experience

Experience Preferred:

have expertise on Elastic Search and Data Analytics and BI

Education Required:

Bachelor's Degree

Education Preferred:

Certification Program

Responsibilities As a Data Engineer (Elasticsearch Specialist), you will design, build, and optimize data pipelines that feed into Elasticsearch clusters, enabling high-performance search and analytics. You will be responsible for ingestion, transformation, indexing, and query optimization of large-scale data. This role requires a deep understanding of Elasticsearch architecture, data modeling, and performance tuning, along with strong data engineering and automation skills. Key Responsibilities:


• Data Ingestion & Pipelines: Design and implement robust ETL/ELT pipelines to ingest structured, semi-structured, and unstructured data into Elasticsearch.


• Elasticsearch: Manage and optimize Elasticsearch clusters for scalability, availability, and performance. Configure index settings, mappings, analyzers, and sharding strategies to improve query efficiency.


• Data Modeling & Indexing: Develop efficient index designs to support various use cases (search, analytics, monitoring). Ensure proper use of aggregations, filters, and full-text search for optimal performance.


• Proactive Monitoring: design, implement, and manage comprehensive monitoring and alerting systems for our platforms, with a specific focus on Elastic clusters. This includes defining key metrics, thresholds, and escalation procedures to proactively identify and address potential issues


• Health Check Management: develop and maintain a suite of automated health checks for critical endpoints, APIs, infrastructure components, and network paths, ensuring rapid detection of anomalies & service degradations


• Collaboration: work closely with development teams to ensure the reliability and scalability of applications that interact with Elastic, providing guidance on best practices and performance optimization

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Data Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....

  • Senior Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Senior Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks and pipelines using Python, Elasticsearch, SQL DB, and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable and...

  • Data Engineer Palantir

    3 days ago

    Chennai, Tamil Nadu, India Capgemini Engineering Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    About the RoleWe are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to...

  • Graduate Engineer Trainee, Proposal Engineering

    1 week ago

    Chennai, Tamil Nadu, India Sungov Engineering Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Founded in 1986, Sungov Engineering designs and manufactures engineered equipment and systems for filtration, separation, and heat transfer applications across Oil & Gas, Petrochemical, Power, and Environmental industries.Sungov is now looking to build an internal AI-based Proposal Engineering system using Large Language Models (LLMs) like ChatGPT's...

  • Security Engineer

    1 week ago

    Chennai, Tamil Nadu, India IC Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Security Engineer: ( Microsoft Subject Matter Expert) : Fulltime – Remote About the Role:Do you want to be on the frontline fighting for safe use within the digital frontier? Does describing your job to your family and friends as being a cyberwarrior or threat hunter sound awesome or awe inspiring? Then join us as part of our Security Operations Center...