Data Engineering

3 weeks ago


Chennai Tamil Nadu India, Tamil Nadu EXL Full time

Responsibilities:

  • Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
  • Create the data integration and data diagram documentation.
  • Lead the data validation, UAT and regression test for new data asset creation.
  • Create and maintain data models, including schema design and optimization.
  • Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.

Qualifications and Skills:

  • Strong knowledge on Python and Pyspark
  • Expectation is to have ability to write Pyspark scripts for developing data workflows.
  • Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum
  • Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.
  • Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
  • Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
  • Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
  • Expectation is to have strong problem-solving and troubleshooting skills.
  • Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
  • Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
  • 3-7 years of experience in Data Engineer.
  • Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.
  • Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.
  • Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.



  • Chennai, Tamil Nadu, India, Tamil Nadu Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Data Scientist

    3 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Capgemini Engineering Full time

    Data Scientist / AnalystLocation: Chennai, IndiaExperience: 12+ yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping transform maritime operations through intelligent digital twin platforms that drive...

  • Data Scientist

    3 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Capgemini Engineering Full time

    Data Scientist / Analyst – Digital Twin of ShipsLocation: Chennai, IndiaWork Mode: Hybrid (3 days/week from office)Experience Required: 12–17 yearsQualifications: Bachelor’s or Master’s degree in engineeringChoosing this opportunity means joining a team at the forefront of maritime innovation, where data science meets sustainability. You’ll be...

  • Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Data Engineer

    7 days ago


    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu LTIMindtree Full time

    Ready to trade your to-do list for a to-do the impossible list?Join a team that's building the future of IIOT.We have arranged a Walk-In Drive on 20-Sep ( Saturday)Time : 9:00 AM to 2:30 PMJob Summary Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions4...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Cleantech Industry Resources Full time

    DATA ENGINEERWho We Are?Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering. The company deploys a leading team that spun out of the largest solar power producer in the world. This team operates within a sophisticated suite of...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Talent Corner HR Services Pvt Ltd Full time

    JOB OBJECTIVEWe are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines that enable to collect, store, process, and analyze large volumes of data. This role will play a crucial part in ensuring data availability, quality,...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu IntraEdge Full time

    Job Title: Data EngineerExperience: 3 to 7 YearsLocation: ChennaiWork Mode: Onsite / Hybrid (as applicable)Job Description:We are looking for a highly skilled and motivated Data Engineer with 3 to 7 years of experience to join our growing team in Chennai. The ideal candidate will have strong expertise in DBT, Snowflake, CI/CD pipelines, and SQL, with a good...