Manager data engineer
1 day ago
Experience: 9 to 15 years
Location: Chennai
Job Description:
Architect and design solutions to meet functional and non-functional requirements.
Lead the design, implementation, and optimization of our Databricks platform.
Work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.
Develop and maintain a comprehensive understanding of our data pipeline and data architecture.
Collaborate with other teams to ensure that our Databricks platform is integrated with other enterprise systems and technologies.
Develop and maintain documentation for our Databricks platform, including architecture diagrams, deployment guides, and operational procedures.
Provide guidance and support to our data engineering team on Databricks-related issues.
Job Responsibilities:
9-15 years experienced resources in Databricks, Python, Big Data, Apache Spark, SQL and Spark SQL
Strong hands on in Pyspark and Apache Spark.
Experience in Building Data Governance Solutions like Unity Catalog …etc
Build Very Strong Orchestration Layer in Databricks/ADF…. Workflows.
Build CICD for Databricks in Azure Devops.
Process near Real time Data thru Auto Loader, DLT Pipelines.
Implement Security Layer in Delta Lake.
Implement Massive Parallel Processing Layers in Spark SQL and Py Spark.
Implement Cost effective Infrastructure in Databricks.
Ability to Build Solutions as Cloud Agnostic.
Required Skills:
Databricks
Spark
Azure
We are an equal opportunity employer and value diversity at our company. We do not
discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression,
sexual orientation, age, marital status, veteran status, or disability status.
-
Data Engineer
4 weeks ago
Chennai, India NTT DATA Full timeJob Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...
-
Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India NTT DATA Full timeJob SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...
-
Cybersecurity Engineer
4 weeks ago
Chennai, Tamil Nadu, India NTT DATA Full timeJob DescriptionMake a difference with NTT DATANTT DATA is a leading provider of digital and AI infrastructure, committed to helping clients innovate and transform for long-term success.Your day at NTT DATAThe Security Managed Services Engineer is responsible for providing proactive support to clients to ensure their Firewall infrastructure remains...
-
Data Engineer
4 weeks ago
Chennai, India NTT DATA Services Full timeReq ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking for...
-
Senior Data Engineer
1 month ago
chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
4 weeks ago
Chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
1 month ago
Chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
1 month ago
Chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
1 month ago
chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
1 month ago
Chennai, India Wavicle Data Solutions Full timeWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...
-
Senior Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Wavicle Data Solutions Full timeWe are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...
-
Engineer (L1) - Titus Data Classification
4 weeks ago
Chennai, India NTT DATA Full timeJob Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...
-
Chief Data Science Engineer
2 weeks ago
Chennai, Tamil Nadu, India NTT DATA Full timeJob SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...
-
Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India NTT DATA Services Full timeRole SummaryWe are seeking a highly skilled Cloud Data Management Engineer to join our team at NTT DATA Services. This role will focus on designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms. The ideal candidate will have extensive experience in AWS DevOps Engineering, including EC2, S3, ECS, Lambda, and...
-
Cybersecurity Engineer for NTT DATA
2 weeks ago
Chennai, Tamil Nadu, India NTT DATA Full timeCompany OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...
-
Engineering Manager
1 month ago
Chennai, India Crayon Data Full timeRole: Engineering Manager(UI) Experience level: 10+ years Location: Hybrid Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...
-
Engineering manager
1 month ago
Chennai, India Crayon Data Full timeRole: Engineering Manager(UI) Experience level: 10+ years Location: Hybrid Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai,...
-
Engineering Manager
4 weeks ago
Chennai, India Crayon Data Full timeRole: Engineering Manager(UI)Experience level: 10+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...
-
Engineering Manager
3 weeks ago
Chennai, India Crayon Data Full timeRole: Engineering Manager(UI) Experience level: 10+ years Location: Hybrid Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...
-
Engineering manager
3 weeks ago
Chennai, India Crayon Data Full timeRole: Engineering Manager(UI) Experience level: 10+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...