Manager Data Engineer

1 week ago

Chennai, India LatentView Analytics Full time

Role: Manager – Data Engineering

Experience: 9 to 15 years

Location: Chennai


Job Description:

  • Architect and design solutions to meet functional and non-functional requirements.
  • Lead the design, implementation, and optimization of our Databricks platform.
  • Work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.
  • Develop and maintain a comprehensive understanding of our data pipeline and data architecture.
  • Collaborate with other teams to ensure that our Databricks platform is integrated with other enterprise systems and technologies.
  • Develop and maintain documentation for our Databricks platform, including architecture diagrams, deployment guides, and operational procedures.
  • Provide guidance and support to our data engineering team on Databricks-related issues.


Job Responsibilities:

  • 9-15 years experienced resources in Databricks, Python, Big Data, Apache Spark, SQL and Spark SQL
  • Strong hands on in Pyspark and Apache Spark.
  • Experience in Building Data Governance Solutions like Unity Catalog …etc
  • Build Very Strong Orchestration Layer in Databricks/ADF…. Workflows.
  • Build CICD for Databricks in Azure Devops.
  • Process near Real time Data thru Auto Loader, DLT Pipelines.
  • Implement Security Layer in Delta Lake.
  • Implement Massive Parallel Processing Layers in Spark SQL and PySpark.
  • Implement Cost effective Infrastructure in Databricks.
  • Ability to Build Solutions as Cloud Agnostic.

Required Skills:

  • Databricks
  • Spark
  • Azure

We are an equal opportunity employer and value diversity at our company. We do not

discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression,

sexual orientation, age, marital status, veteran status, or disability status.

  • Data Engineer

    1 month ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...

  • Engineer (L1) - Titus Data Classification

    1 month ago

    Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Chief Data Science Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...

  • Cybersecurity Engineer for NTT DATA

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Engineering Manager

    2 months ago

    Chennai, India Crayon Data Full time

    Role: Engineering Manager(UI) Experience level: 10+ years Location: Hybrid Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Engineering manager

    4 weeks ago

    Chennai, India Crayon Data Full time

    Role: Engineering Manager(UI) Experience level: 10+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Engineering manager

    2 months ago

    Chennai, India Crayon Data Full time

    Role: Engineering Manager(UI) Experience level: 10+ years Location: Hybrid Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai,...

  • Engineering Manager

    1 month ago

    Chennai, India Crayon Data Full time

    Role: Engineering Manager(UI)Experience level: 10+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Engineering Manager

    4 weeks ago

    Chennai, India Crayon Data Full time

    Role: Engineering Manager(UI) Experience level: 10+ years Location: Hybrid Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Engineering manager

    1 month ago

    Chennai, India Crayon Data Full time

    Role: Engineering Manager(UI)Experience level: 10+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Engineering Manager

    4 weeks ago

    Chennai, India Crayon Data Full time

    Role: Engineering Manager(UI)Experience level: 10+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Engineering Manager

    1 month ago

    Chennai, India Crayon Data Full time

    Role: Engineering Manager(UI)Experience level: 10+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Cybersecurity Engineering Manager

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job OverviewNTT DATA is a leading global technology services company. We are seeking a highly skilled Security Managed Services Engineer to join our team.We provide innovative solutions for clients worldwide, and this role will be responsible for ensuring the security of their infrastructure and systems.