Data Engineer

2 weeks ago

Chennai, Tamil Nadu, India METRIXIT SOLUTIONS PVT LTD Full time

Job Description :

Job title : Data Engineer - Engineer II

Exp : 5-15

Location : Chennai

Skill : Python, GCP, ETL-Big Data, PySpark, API, RDBMS, Oracle)

Primary Skills (Essential) :

- Python proficiency (including experience with data manipulation, libraries like pandas)

PySpark expertise (including hands-on experience with Spark transformations and Optimizations)

- Real-time data ingestion experience (e.g., using Kafka, Spark Streaming)

Batch data ingestion :

- Data aggregation and insights generation (using SQL or Spark)

- Rest API integration for data ingestion

- Kafka topic interaction (producing and consuming messages)

- Oracle RDBMS knowledge

- Data purging, and archiving experience

Secondary Skills (Desirable) :

- Familiarity with Generative AI implementation concepts (e.g., data preparation for model training, prompt engineering)

- Understanding of Data lake architecture and Data warehouse concepts

- Having prior experience in AMEX services like Event Engine, HiPED, Hydra deployment

- Having better knowledge on LUMI and Cornerstone data ingestion

Key Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain scalable, efficient, and high-performance data pipelines for ETL (Extract, Transform, Load) processes.

Data Modeling & Warehousing :

- Develop and optimize data models for business intelligence and analytical purposes.

- Manage and improve data warehousing solutions such as Snowflake, Redshift, or BigQuery.

Data Integration :

- Integrate data from various sources, including APIs, third-party tools, and databases, ensuring seamless access to data for analysis.

Collaboration :

- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver data solutions that meet business needs.

Data Quality & Governance :

- Ensure data quality, consistency, and integrity across all systems.

- Implement data governance policies to ensure accurate, accessible, and secure data.

Performance Tuning & Optimization :

- Identify and address performance bottlenecks within data systems, ensuring optimal performance and cost efficiency.

(ref:hirist.tech)

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    **Job Title:** Data Engineer Intern About Quantrail Data: We are building a fully managed, AI-powered analytics platform for small and medium businesses, focusing on cost efficiency, performance, and ease of use. Our goal is to simplify analytics infrastructure while delivering enterprise-grade solutions. Role Overview: We are seeking a highly motivated...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 280008NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Chennai Tamil N xc4 x81du IN-TN India IN Data Engineer...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 6 monthsStipend: UnpaidEligibility: Open to 2025 graduatesConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: 303790 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Job Duties: As a data...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID: 303790 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Job Duties: As a data engineer you will...

  • Data engineer

    2 days ago

    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data EngineerPosition: Data EngineerExperience: 2-4 yearsLocation: Madipakkam, Chennai - work from officeSkills & Requirements: Strong proficiency in Python with hands-on experience in Pandas and Num Py Expertise in Postgre SQL, including query optimization & performance analysis Solid understanding of statistical analysis and data...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data Engineer Position: Data Engineer Experience: 2-4 years Location: Madipakkam, Chennai - work from officeSkills & Requirements: Strong proficiency in Python with hands-on experience in Pandas and NumPy Expertise in PostgreSQL, including query optimization & performance analysis Solid understanding of statistical analysis and data...

  • Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India Clustrex Data Private Limited Full time

    We're Hiring: Data EngineerPosition:Data EngineerExperience:2-4 yearsLocation:Madipakkam, Chennai - work from officeSkills & Requirements: Strong proficiency inPythonwith hands-on experience inPandasandNumPy Expertise inPostgreSQL , including query optimization & performance analysis Solid understanding ofstatistical analysisand data transformation...

  • Senior Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Job descriptionWe are looking for a high-energy individual for the Data Engineer role at Eucloid. The candidate will advise clients on multiple business problems and help them achieve desirable business outcomes through projects. The candidate is expected to be a highly motivated individual with an ability to provide strategic C operational leadership for a...

  • Big Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the Role:">We are seeking a skilled CDH Developer to join our team in Chennai, Tamil Nadu, India. As a key member of our team, you will play a crucial role in designing and implementing cutting-edge data engineering solutions using ETL, Azure, AWS cloud services, Glue, Lambda, Athena, and Pyspark.