Data Engineer

1 week ago

Chennai, Tamil Nadu, India YO HR Consultancy Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Data Engineer/Senior Data Engineer

Location: Chennai

Experience: 2 - 8 Years

Role Description

The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets.

Qualifications

· Data Engineering and Data Modeling skills

· Experience with Extract Transform Load (ETL) pipelines

· Expertise in implementing data warehousing solutions

· Analytical skills for performing data analytics on large datasets

· Strong programming skills in languages like Python, Java, or Scala

· Experience with Big Data and cloud-based technologies like Hadoop, Spark, and AWS

· Understanding of data governance and security principles

· Bachelor's degree in Computer Science, Information Systems, or related field

· Strong communication skills and ability to work independently and collaboratively

Experience Required: 2+ years in Data Engineering or related field

Primary Capabilities:

SQL Expertise:

· Proficiency in writing complex SQL queries.

· Experience with database design and optimization.

· Ability to perform data manipulation and analysis.

Databricks Experience:

· Hands-on experience with Databricks platform.

· Familiarity with Databricks' integration with various data sources and sinks.

· Experience in building and optimizing big data pipelines using Databricks.

PySpark Proficiency:

· Strong skills in PySpark for large-scale data processing.

· Understanding of PySpark's architecture and its application in data processing and transformation tasks.

· Ability to write efficient, scalable, and reusable code in PySpark.

Python Programming:

· Strong programming skills in Python.

· Experience with Python libraries relevant to data engineering (e.g., Pandas, NumPy).

· Ability to write clean, maintainable, and efficient code in Python.

AWS Experience:

· Knowledge of AWS services relevant to data engineering (e.g., S3, Lambda, CodeCommit, etc.,).

· Knowledge in building and maintaining data infrastructures on AWS.

· Understanding of cloud computing concepts and how they apply to data engineering tasks.

Analytics Skills:

· Ability to derive insights from large datasets.

· Knowledge of data visualization tools and techniques.

· Proficiency in statistical analysis and using data to inform decisions.

Logical Thinking and Problem-Solving:

· Strong logical reasoning and analytical skills.

· Proven ability to troubleshoot and solve complex problems.

· Capacity to break down and simplify complex problems, developing practical, efficient solutions.

Other Desirable Qualifications:

· Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

· Good communication skills and the ability to work collaboratively in a team.

· Experience with version control tools like Git, CodeCommit.

· Familiarity with Agile methodologies and DevOps practices.

· Certification in relevant technologies (e.g., Databricks, AWS Certified Data Analytics) is a plus

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks and pipelines using Python, Elasticsearch, SQL DB, and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable and...

  • Senior Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Data Centre Remote Technical Support Engineer

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Centre...

  • Python & SSIS Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 10,00,000 - ₹ 42,00,000 per year

    MANDATORY PREVIOUS WORK EXPERIENCE IN SSIS AND PYTHON. (Candidates without this experience in the past will NOT be considered for this role)JOB RESPONSIBILITIES5+ years previous work experience as a Data Engineer.Design and build data pipelines using SSIS, ADF, Talend, Informatica, Data Stage, or Ab Initio to move and transform data reliably.Manage and...

  • Data & Business Insights Associate

    3 hours ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Works under supervision with internal and external teams to understand customer requirements Collaborate with Automation Engineers, Machine Learning Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables. Ability to elaborate on the details of a project Appropriate mathematical knowledge Strong communication and critical thinking...

  • Data & Business Insights Associate

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Works under supervision with internal and external teams to understand customer requirementsAbility to elaborate on the details of a project Collaborate with Automation Engineers, Machine Learning Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables.Must possess technical writing, decision making, and problem-solving skills.Must...

  • Senior Data scientist

    2 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Senior Software Engineer

    2 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...

  • Data Activity Monitoring

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA, Inc. Full time ₹ 60,000 - ₹ 1,20,000 per year

    Role: Data Activity Monitoring (DAM) Engineers – L1 & L2Location:Chennai, IndiaEducation:BE / B.Tech / MCAinElectronics, Electrical, or Computer SciencePosition 1: DAM Engineer – L1Experience:2 yearsBudget:₹5.85 LPAKey Responsibilities:Support day-to-day operations of Data Activity Monitoring tools .Monitor database and application activity to...

  • Security Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India IC Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Security Engineer: ( Microsoft Subject Matter Expert) : Fulltime – Remote About the Role:Do you want to be on the frontline fighting for safe use within the digital frontier? Does describing your job to your family and friends as being a cyberwarrior or threat hunter sound awesome or awe inspiring? Then join us as part of our Security Operations Center...