Data Engineer

2 months ago

Chennai, India Risk Resources India Full time

ETL- Hadoop

Role and Responsibilities :

- Design Extract/Load/Transform (ETL) workflows to develop large scale data structures and pipelines to organize, collect and standardize data

- Uses knowledge of Hadoop architecture, HDFS commands and experience in designing, optimizing queries to build data pipelines

- Integrate data from a variety of sources, assuring that they adhere to data quality and accessibility standards

- Implemented endpoints to read data from BigQuery and Hive

- To provide user-defined functions for clients to read data from Hive and BigQuery directly without using any external connector jars

- Collaborate with data science team to transform data and integrate algorithms and models into automated processes using programming skills - Python or Hive

- Help in optimizing queries, and work to integrate the business requirements into existing campaign reporting data workflows

- Design and implement scalable, configurable and self-learning marketing campaign platform

Candidate Profile :

- Bachelor's degree in Engineering/Computer Science or related quantitative field

- Significant of advanced experience with data analysis, reporting and programming logic (Python, PySpark, Hive, SQL, shell scripting)

- Experience interacting with decision-making business audience

- Analyzes current information technology environment to identify and access critical capabilities and recommend solutions

- Experiments with available tools and advices on new tolls in order to determine optimal solutions given the requirements dictated by the model/use case

- Good software engineering fundamentals, strong problem solving and critical thinking ability.

(ref:hirist.tech)

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Chief Data Science Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...

  • Cybersecurity Engineer for NTT DATA

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Engineer (L1) - Titus Data Classification

    1 month ago

    Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Artificial Intelligence Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Are you a seasoned AI expert looking to make a significant impact at a leading global innovator in business and technology services?We are seeking a highly skilled Artificial Intelligence Engineer to join our team at NTT DATA. This role offers the opportunity to design, develop, and test software systems, modules, or applications for software enhancements...

  • Crayon Data | Senior Software Engineer | chennai

    4 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship...

  • Crayon Data | Senior Software Engineer | chennai

    4 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Crayon Data | Senior Software Engineer | chennai

    4 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship...

  • Senior Machine Learning Engineer

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...

  • Bastion Data Solutions | Cloud SRE Architect

    2 weeks ago

    Chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 weeks ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 weeks ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions.. Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management. QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 weeks ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    1 week ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...