Data Engineer

2 months ago


BangaloreChennai, India TekPillar Full time

Job Title : Data Engineer

Experience : 3-8 Years

Location : Chennai / Bangalore

Job Type : Full-time

Require Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, Python


Job Description :


We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience.


- Strong experience with AWS services: Glue, Lambda, Athena, S3, EMR, and Redshift.


- Proficiency in Python and PySpark for data processing and automation.


- Hands-on experience with Big Data frameworks such as Hadoop, Hive, and HDFS.


- Experience with SQL for querying and manipulating data.


- Knowledge of streaming technologies and tools like Kafka, Kinesis, or Spark Streaming is a plus.


- Familiarity with data lakes, data warehouses, and data cataloging in AWS.


- The ideal candidate will be responsible for building and maintaining scalable, reliable data pipelines and infrastructure.


- You will work with large datasets, design and implement ETL processes, and ensure the availability of clean and structured data for analytics and business needs.


- AWS (S3, Glue, Redshift, Lambda, etc.).


- Experience with Apache Airflow for orchestration of data workflows.


- Strong expertise in PySpark and Hadoop ecosystem tools (Hive, HDFS, MapReduce, etc.).


- Experience working with Big Data technologies and handling large datasets.


- Strong programming skills in Python.


- Hands-on experience with ETL tools and frameworks.


- Knowledge of relational databases (e.g., SQL, PostgreSQL, MySQL).


- Familiarity with distributed data processing frameworks and cloud-native technologies.

(ref:hirist.tech)
  • Senior Data Engineer

    2 months ago


    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago


    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...

  • Senior Data Engineer

    2 months ago


    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago


    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago


    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago


    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...

  • Solution Engineer

    2 weeks ago


    Bangalore, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...

  • Data engineer

    2 months ago


    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Data Engineer

    4 weeks ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    4 weeks ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 months ago


    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...


  • Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    1 month ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    3 weeks ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 months ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    2 months ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Are you a seasoned AI expert looking to make a significant impact at a leading global innovator in business and technology services?We are seeking a highly skilled Artificial Intelligence Engineer to join our team at NTT DATA. This role offers the opportunity to design, develop, and test software systems, modules, or applications for software enhancements...