Data Engineer

4 weeks ago

Chennai, India SDNA Global Full time

Job Description :


Roles and Responsibilities :

We are seeking an experienced Data Engineer to join our team. The ideal candidate will have 5 to 8 years of experience in data engineering and a strong background in building data pipelines, data warehousing, and data management solutions. In this role, you will work closely with data scientists, analysts, and other stakeholders to design, build, and maintain scalable and robust data infrastructure.

Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - S3, Glue, RedShift, Lambda

- Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments.

- Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS.

- Design, develop, and maintain logical and physical data models, ensuring data integrity, consistency, accuracy and optimize the performance.

- Create and enforce data modeling standards, best practices, and governance policies.

- Excellent in Advanced SQL end to end development and Optimization of existing processes

- Ability to understand and write complex Pyspark/Python code according to business requirement.

- Table Partition mechanism, Types of Partitions, column store index

- Maintenance and optimization of existing processes

- Experience in leading, overseeing tasks and providing guidance to the team.

- Requirement gathering and feasibility analysis, design, develop from scratch and deliver

- Experience in designing data warehouse/data mart.

- Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements

- Experience in deploying data pipelines using automated CI/CD approach.

- Experience in writing production ready code in Python and test, participate in code reviews to maintain and improve code quality, stability, and supportability.

- Ability to write modularized reusable code components.

- Proficient in identifying data issues and anomalies during analysis.

- Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements

EXPERTISE AND QUALIFICATIONS :

Experience : 5 to 8 years of relevant experience in Data Engineering

Location : Chennai - Work from Office

Must have Skills :

- Pyspark/Python

- Data Migration

- Data Warehousing

- Data Modeling

- AWS

- SQL

(ref:hirist.tech)

  • Director of Data Engineering

    17 hours ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionaryDirector of Data Engineeringto lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    3 days ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    2 days ago

    chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This...

  • Director of Data Engineering

    3 days ago

    chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    3 days ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Data Architect

    3 days ago

    chennai, India Wavicle Data Solutions Full time

    Multiple years of hands-on experience working as a data architect on Azure or AWS or Snowflake cloud ecosystems. Designing & implementing the organization's data architecture, including data models, data flows, and data storage solutions.Creating and maintaining data dictionaries and data maps to document data sources, data types, and data...

  • Associate Specialist

    3 months ago

    Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Autocad Draughtsman/woman

    4 months ago

    Chennai, India Planners and Engineer Full time

    Requirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...

  • Engineering Manager

    20 hours ago

    chennai, India Crayon Data Full time

    Engineering Manager (10 to 12 yrs)Chennai, Tamil Nadu, IndiaWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Engineering Manager

    1 month ago

    Chennai, India Crayon Data Full time

    Engineering Manager (10 to 12 yrs)Chennai, Tamil Nadu, IndiaWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Machine Learning Engineer

    2 weeks ago

    Chennai, India Crayon Data Full time

    Role: MLops Engineer Experience level: 5-7years Location: Chennai (Hybrid) Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Machine Learning Engineer

    3 weeks ago

    Chennai, India Crayon Data Full time

    Role: MLops EngineerExperience level: 5-7yearsLocation: Chennai (Hybrid)Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Machine Learning Engineer

    3 weeks ago

    Chennai, India Crayon Data Full time

    Role: MLops EngineerExperience level: 5-7yearsLocation: Chennai (Hybrid)Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Machine Learning Engineer

    3 weeks ago

    Chennai, India Crayon Data Full time

    Role: MLops Engineer Experience level: 5-7years Location: Chennai (Hybrid) Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Machine Learning Engineer

    3 days ago

    chennai, India Crayon Data Full time

    Role: MLops EngineerExperience level: 5-7yearsLocation: Chennai (Hybrid)Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Engineering Manager

    2 weeks ago

    Chennai, India Crayon Data Full time

    Engineering Manager (10 to 12 yrs) Chennai, Tamil Nadu, India Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Engineering Manager

    1 month ago

    Chennai, India Crayon Data Full time

    Engineering Manager (10 to 12 yrs) Chennai, Tamil Nadu, India Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Engineering Manager

    1 month ago

    Chennai, India Crayon Data Full time

    Engineering Manager (10 to 12 yrs)Chennai, Tamil Nadu, IndiaWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Engineering Manager

    1 month ago

    Chennai, India Crayon Data Full time

    Engineering Manager (10 to 12 yrs)Chennai, Tamil Nadu, IndiaWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Engineering Manager

    3 days ago

    chennai, India Crayon Data Full time

    Engineering Manager (10 to 12 yrs)Chennai, Tamil Nadu, IndiaWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...