Data Engineer

4 weeks ago


Chennai, Tamil Nadu, India METRIXIT SOLUTIONS PVT LTD Full time

Job Description :

Job title : Data Engineer - Engineer II

Exp : 5-15

Location : Chennai

Skill : Python, GCP, ETL-Big Data, PySpark, API, RDBMS, Oracle)

Primary Skills (Essential) :

- Python proficiency (including experience with data manipulation, libraries like pandas)

PySpark expertise (including hands-on experience with Spark transformations and Optimizations)

- Real-time data ingestion experience (e.g., using Kafka, Spark Streaming)

Batch data ingestion :

- Data aggregation and insights generation (using SQL or Spark)

- Rest API integration for data ingestion

- Kafka topic interaction (producing and consuming messages)

- Oracle RDBMS knowledge

- Data purging, and archiving experience

Secondary Skills (Desirable) :

- Familiarity with Generative AI implementation concepts (e.g., data preparation for model training, prompt engineering)

- Understanding of Data lake architecture and Data warehouse concepts

- Having prior experience in AMEX services like Event Engine, HiPED, Hydra deployment

- Having better knowledge on LUMI and Cornerstone data ingestion

Key Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain scalable, efficient, and high-performance data pipelines for ETL (Extract, Transform, Load) processes.

Data Modeling & Warehousing :

- Develop and optimize data models for business intelligence and analytical purposes.

- Manage and improve data warehousing solutions such as Snowflake, Redshift, or BigQuery.

Data Integration :

- Integrate data from various sources, including APIs, third-party tools, and databases, ensuring seamless access to data for analysis.

Collaboration :

- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver data solutions that meet business needs.

Data Quality & Governance :

- Ensure data quality, consistency, and integrity across all systems.

- Implement data governance policies to ensure accurate, accessible, and secure data.

Performance Tuning & Optimization :

- Identify and address performance bottlenecks within data systems, ensuring optimal performance and cost efficiency.

(ref:hirist.tech)
  • Data Engineer

    4 days ago


    Chennai, Tamil Nadu, India Quantrail Data Full time

    **Job Title:** Data Engineer Intern About Quantrail Data: We are building a fully managed, AI-powered analytics platform for small and medium businesses, focusing on cost efficiency, performance, and ease of use. Our goal is to simplify analytics infrastructure while delivering enterprise-grade solutions. Role Overview: We are seeking a highly motivated...

  • Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 6 monthsStipend: UnpaidEligibility: Open to 2025 graduatesConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to...

  • Data engineer

    5 days ago


    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data EngineerPosition: Data EngineerExperience: 2-4 yearsLocation: Madipakkam, Chennai - work from officeSkills & Requirements: Strong proficiency in Python with hands-on experience in Pandas and Num Py Expertise in Postgre SQL , including query optimization & performance analysis Solid understanding of statistical analysis and data...

  • Cloud Data Engineer

    22 hours ago


    Chennai, Tamil Nadu, India Quantrail Data Full time

    Job Overview:We're seeking an experienced Data Engineer Intern who can work with cutting-edge technologies like ClickHouse and analytical databases. As a key member of our engineering team, you'll have the opportunity to learn from experts, collaborate on real-world projects, and contribute to the development of our analytics platform.

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data EngineerPosition: Data EngineerExperience: 2-4 yearsLocation: Madipakkam, Chennai - work from officeSkills & Requirements: Strong proficiency in Python with hands-on experience in Pandas and NumPy Expertise in PostgreSQL, including query optimization & performance analysis Solid understanding of statistical analysis and data transformation...

  • Data Engineer Lead

    1 day ago


    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Job DescriptionAbout Eucloid Data SolutionsWe are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, deploying, and maintaining large-scale data systems.This role involves advising clients on various business problems and helping them achieve desired business...

  • Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data Engineer Position: Data Engineer Experience: 2-4 years Location: Madipakkam, Chennai - work from officeSkills & Requirements: Strong proficiency in Python with hands-on experience in Pandas and NumPy Expertise in PostgreSQL, including query optimization & performance analysis Solid understanding of statistical analysis and data...


  • Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Job descriptionWe are looking for a high-energy individual for the Data Engineer role at Eucloid. The candidate will advise clients on multiple business problems and help them achieve desirable business outcomes through projects. The candidate is expected to be a highly motivated individual with an ability to provide strategic C operational leadership for a...


  • Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Job description We are looking for a high-energy individual for the Data Engineer role at Eucloid. The candidate will advise clients on multiple business problems and help them achieve desirable business outcomes through projects. The candidate is expected to be a highly motivated individual with an ability to provide strategic C operational leadership for...


  • Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    Job Title: Data Engineer - Madipakkam, Chennai LocationAbout the Job: We are looking for an experienced Data Engineer to join our team at Clustrex Data Private Limited. The ideal candidate will have a strong background in data engineering, excellent problem-solving skills, and the ability to work collaboratively with a team.Key Responsibilities:1. Design,...


  • Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data EngineerPosition: Data EngineerExperience: 2-4 yearsLocation: Madipakkam, Chennai - work from officeSkills & Requirements:Strong proficiency in Python with hands-on experience in Pandas and NumPyExpertise in PostgreSQL, including query optimization & performance analysisSolid understanding of statistical analysis and data transformation...

  • Lead Data Architect

    18 hours ago


    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Role SummaryData Engineer Position at Eucloid Data SolutionsWe are seeking a seasoned Data Engineer to join our team. The successful candidate will have a deep understanding of data engineering principles and practices, with a proven track record of designing and delivering large-scale data systems.This role involves collaborating with cross-functional teams...


  • Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Job OverviewEucloid Data Solutions: A Leader in Data EngineeringWe are a cutting-edge company specializing in data engineering solutions. Our team is comprised of highly skilled professionals who strive to deliver innovative data-driven solutions to our clients.The ideal candidate will have a strong background in data engineering, with experience in...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 292803NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Chennai Tamil N xc4 x81du IN-TN India IN Flutter...

  • Data Architect

    1 day ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Multiple years of hands-on experience working as a data architect on Azure or AWS or Snowflake cloud ecosystems. Designing & implementing the organization's data architecture, including data models, data flows, and data storage solutions.Creating and maintaining data dictionaries and data maps to document data sources, data types, and data...


  • Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    Company Overview: Clustrex Data Private Limited is a leading data analytics company that helps businesses make informed decisions. We are seeking a highly skilled Data Engineer to join our team.Job Description: As a Data Engineer at Clustrex, you will be responsible for building and optimizing data pipelines for efficient data processing. You will work...


  • Chennai, Tamil Nadu, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a data engineering company founded in 2020, specializing in designing, building, and maintaining robust data pipelines. With a focus on data quality, security, and scalability, we deliver customized data solutions to drive business growth and success. Committed to quality, innovation, and reliability, we are your...


  • Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    About UsAt Clustrex Data Private Limited, we value expertise in data processing and analysis. Our team works together to deliver innovative data solutions.This position offers a unique opportunity to build and optimize data pipelines using Python, Pandas, and NumPy. Your expertise in Postgre SQL will enable you to analyze large datasets and optimize data...


  • Chennai, Tamil Nadu, India Lapis Data Analytics Full time

    Job DescriptionCompany DescriptionLapis Data Analytics is a data engineering company founded in 2020, specializing in designing, building, and maintaining robust data pipelines. With a focus on data quality, security, and scalability, we deliver customized data solutions to drive business growth and success. Committed to quality, innovation, and reliability,...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Zemoso Technologies Full time

    Location: Pune / Mumbai Chennai / Hyderabad / (Hybrid)Notice Period : upto 60daysKey Responsibilities:Python Proficiency:Demonstrate a strong command of Python programming language, actively contributing to thedevelopment and maintenance of data engineering solutions.Data Engineering Expertise:Set up and maintain efficient data pipelines, ensuring smooth...