Senior Data Engineer

5 days ago

Chennai, Tamil Nadu, India YO IT CONSULTING Full time

Experience: 6 - 8 Years

Location: Chennai (WFO)

Role Description

The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets.

Qualifications:

  • Data Engineering and Data Modeling skills
  • Experience with Extract Transform Load (ETL) pipelines
  • Expertise in implementing data warehousing solutions
  • Analytical skills for performing data analytics on large datasets
  • Strong programming skills in languages like Python, Java, or Scala
  • Experience with Big Data and cloud-based technologies like Hadoop, Spark, and AWS
  • Understanding of data governance and security principles
  • Bachelor's degree in Computer Science, Information Systems, or related field
  • Strong communication skills and ability to work independently and collaboratively

Experience Required: 6+ years in Data Engineering or related field

Primary Capabilities:

SQL Expertise:

  • Proficiency in writing complex SQL queries.
  • Experience with database design and optimization.
  • Ability to perform data manipulation and analysis.

Databricks Experience:

  • Hands-on experience with Databricks platform.
  • Familiarity with Databricks' integration with various data sources and sinks.
  • Experience in building and optimizing big data pipelines using Databricks.

PySpark Proficiency:

  • Strong skills in PySpark for large-scale data processing.
  • Understanding of PySpark's architecture and its application in data processing and transformation tasks.
  • Ability to write efficient, scalable, and reusable code in PySpark.

Python Programming:

  • Strong programming skills in Python.
  • Experience with Python libraries relevant to data engineering (e.g., Pandas, NumPy).
  • Ability to write clean, maintainable, and efficient code in Python.

AWS Experience:

  • Knowledge of AWS services relevant to data engineering (e.g., S3, Lambda, CodeCommit, etc.,).
  • Knowledge in building and maintaining data infrastructures on AWS.
  • Understanding of cloud computing concepts and how they apply to data engineering tasks.

Analytics Skills:

  • Ability to derive insights from large datasets.
  • Knowledge of data visualization tools and techniques.
  • Proficiency in statistical analysis and using data to inform decisions.

Logical Thinking and Problem-Solving:

  • Strong logical reasoning and analytical skills.
  • Proven ability to troubleshoot and solve complex problems.
  • Capacity to break down and simplify complex problems, developing practical, efficient solutions.

Other Desirable Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Good communication skills and the ability to work collaboratively in a team.
  • Experience with version control tools like Git, CodeCommit.
  • Familiarity with Agile methodologies and DevOps practices.
  • Certification in relevant technologies (e.g., Databricks, AWS Certified Data Analytics) is a plus

  • Senior Data Consultant

    7 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...

  • Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time

    HiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...

  • Senior GenAI Engineers

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID: 341063NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Key Responsibilities Design &...

  • Lead Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India RapidBrains Full time

    Job Title:Senior Data Engineer – ODILocation:ChennaiJob Type:ContractExperience :5.5+ YearsWe are seeking a highly skilled Senior Data Engineer with hands-on experience in Oracle Data Integrator (ODI) and enterprise data integration technologies. The ideal candidate will design, build, and optimize scalable data pipelines supporting advanced analytics and...

  • Eucloid - Senior Data Engineer - Python/SQL/ETL

    9 hours ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Job Description : is looking for aSenior Data Engineerto join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of different...

  • Senior Data Engineer Data Engineering

    4 hours ago

    Chennai, Tamil Nadu, India Optisol Business Solutions Full time

    About the RoleAs a Senior Data Engineer (L2), you will:Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms. Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers.Work closely with solutioning and pre-sales teams for technical...

  • Senior Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Security...

  • Senior Associate DevOps Engineer

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Continue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive. Your career here...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Multi Recruit Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Senior Data EngineerLocation: Chennai (Onsite)Role DescriptionThe Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets.QualificationsData Engineering and...