Data Engineering Engineer

2 weeks ago

Chennai, Tamil Nadu, India Megan Soft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Position Description:

Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately

Key Responsibilities:

1) Collaborate with business and technology stakeholders to understand current and future data requirements

2) Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis 3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow

4) Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data

5) Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks

6) Ensure optimum performance and identify improvement opportunities

Skills Required:

Data Warehousing, Big Query,, Data Governance, Data/Analytics, Data/Analytics dashboards, Data Model, Elasticsearch

Skills Preferred:

3dx, AI/ML

Experience Required:

Engineer 2 Exp: 4+ years Data Engineering work experience

Experience Preferred:

have expertise on Elastic Search and Data Analytics and BI

Education Required:

Bachelor's Degree

Education Preferred:

Certification Program

Responsibilities As a Data Engineer (Elasticsearch Specialist), you will design, build, and optimize data pipelines that feed into Elasticsearch clusters, enabling high-performance search and analytics. You will be responsible for ingestion, transformation, indexing, and query optimization of large-scale data. This role requires a deep understanding of Elasticsearch architecture, data modeling, and performance tuning, along with strong data engineering and automation skills. Key Responsibilities:


• Data Ingestion & Pipelines: Design and implement robust ETL/ELT pipelines to ingest structured, semi-structured, and unstructured data into Elasticsearch.


• Elasticsearch: Manage and optimize Elasticsearch clusters for scalability, availability, and performance. Configure index settings, mappings, analyzers, and sharding strategies to improve query efficiency.


• Data Modeling & Indexing: Develop efficient index designs to support various use cases (search, analytics, monitoring). Ensure proper use of aggregations, filters, and full-text search for optimal performance.


• Proactive Monitoring: design, implement, and manage comprehensive monitoring and alerting systems for our platforms, with a specific focus on Elastic clusters. This includes defining key metrics, thresholds, and escalation procedures to proactively identify and address potential issues


• Health Check Management: develop and maintain a suite of automated health checks for critical endpoints, APIs, infrastructure components, and network paths, ensuring rapid detection of anomalies & service degradations


• Collaboration: work closely with development teams to ensure the reliability and scalability of applications that interact with Elastic, providing guidance on best practices and performance optimization

  • Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...

  • Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...

  • Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID:336025NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key...

  • Senior Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Senior Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks and pipelines using Python, Elasticsearch, SQL DB, and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable and...

  • Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Engineer - Azure Req ID: 336026 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job...

  • Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    About the RoleWe are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to...