Data Engineer

2 months ago

Chennai, India HNM Solutions Full time

Role : Data Engineer

Location : Chennai (Candidate will work from Client office)

Experience : 7 years( Relevant - 4.5 year Mandatory)

NOTE : Only immediate joiners

Candidate current location should be Chennai only....

Description :


We are seeking a Data Engineer who will build and maintain data pipelines across business areas such as subscriptions, video, clickstream, commerce, social and advertising .


If you are looking for a challenging environment and to work with a world-class team of data engineers in a well balanced environment and seasoned company, come join us.


RESPONSIBILITIES :


Responsibilities include, but are not limited to :


- Build, test, scale and maintain highly reliable data pipelines from a variety of batch data sources and real-time streams


- Contribute to the data infrastructure and platform used to build our data pipelines


- Serve as a core member of the data engineering team and be proficient in assisting the business with understanding data attributes


- Design and present recommendations to guide future business and research directions


- Build and maintain highly validated data-marts with ensured clarity and correctness of key business metrics for BI reporting purposes


- Collaborate with other Data Engineers, Data Scientists, and BI Engineers to architect and implement a shared technical vision


- Follow agile processes with a focus on delivering production-ready, testable deliverables in an iterable fashion


- Serve as a senior technical contact for the data solutions engineering team


- Perform code reviews and in-depth technical reviews of system design architectures for junior engineers


- Participate in the entire software development lifecycle, from concept to Qualifications :



- BS, MS, Ph.D., or equivalent industry experience in Computer Science, Software Engineering, or other related Science/Technology/Engineering/Math fields.

- 3+ years experience of near Real Time (Streaming) & Batch Data Pipeline development in a large scale organization

- 7.5+ years of relevant experience in software development in total.

- Experience in writing reusable/efficient code to automate analysis and data processes

- 2+ of business/marketing analytics experience, preferably in a consumer-based organisation.

- Experience successfully working on an independent project with very minimal supervision

- Experience in processing structured and unstructured data into a form suitable for analysis and reporting with integration with a variety of data metric providers ranging from web analytics, consumer analytics, and advertising

- Strong Experience with data modelling, batch data pipeline design and implementation

- Strong Experience in software development and engineering principles

- Experience implementing scalable, distributed, and highly available systems using AWS services such Kinesis, DynamoDB, S3

- Exceptional communication skills, particularly in communicating and visualizing quantitative findings in a compelling and actionable manner for business stakeholders

- Experience in mentoring and supporting junior members of the team

- High Proficiency in Python/PySpark, Scala or Java

- High Proficiency in SQL

- Experience with Databricks/Spark

- Experience with orchestration tools such as Airflow (we use Astronomer)

- Comfortable with CI/CD (we use GitHub Actions) Pipelines

- Experience with Git version control, and other software adjacent tools

- Terraform used as Infra as service tool

Skills :

- Pyspark, Scala, Databricks, SQL, GitHub.

Cloud and Database :

- AWS- Kinesis, DynamoDb and S3

(ref:hirist.tech)

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...

  • Data Engineer

    2 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Director of Data Engineering

    4 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals....

  • Director of Data Engineering

    4 weeks ago

    chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Data Engineering Leader

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...

  • Data Engineer

    2 weeks ago

    Chennai, India NTT DATA Services Full time

    Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking for...

  • Data Engineering Leader

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a seasoned data engineering leader to drive the technical strategy and oversee complex data projects.Key Responsibilities:Lead and manage the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Data Engineering Director

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a visionary leader to drive the technical strategy and manage our growing Data Engineering team.Key Responsibilities:Lead and mentor the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Director of Data Engineering

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This...

  • Director of Data Engineering

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Senior Data Engineer

    3 weeks ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 week ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...