Manager - Data Engineering
3 days ago
Designation: Manager – Data Engineering
Level: L4
Experience: 9 to 15 years
Location: Chennai
Job Description:
We are seeking a highly skilled and motivated Manager with strong experience in the Databricks Domain to join our growing team.
Responsibilities:
- Architect and design solutions to meet functional and non-functional requirements.
- Lead the design, implementation, and optimization of our Databricks platform.
- Work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.
- Develop and maintain a comprehensive understanding of our data pipeline and data architecture.
- Collaborate with other teams to ensure that our Databricks platform is integrated with other enterprise systems and technologies.
- Develop and maintain documentation for our Databricks platform, including architecture diagrams, deployment guides, and operational procedures.
- Provide guidance and support to our data engineering team on Databricks-related issues.
Skills:
- 9-15 years experienced resources in Databricks, Python, Big Data, Apache Spark, SQL and Spark SQL
- Strong hands on in Pyspark and Apache Spark.
- Experience in Building Data Governance Solutions like Unity Catalog, etc
- Build Very Strong Orchestration Layer in Databricks/ADF…. Workflows.
- Build CICD for Databricks in Azure Devops.
- Process near Real time Data thru Auto Loader, DLT Pipelines.
- Implement Security Layer in Delta Lake.
- Implement Massive Parallel Processing Layers in Spark SQL and PySpark.
Implement Cost effective Infrastructure in Databricks.
Ability to Build Solutions as Cloud Agnostic.
Job Snapshot
Updated Date
Job ID
J_4143
Location
Chennai, Tamil Nadu, India
Experience
9 - 15 Years
Employee Type
Permanent
-
Data Engineer
4 days ago
Chennai, India NTT DATA Full timeReq ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities: ...
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 1,04,000 - ₹ 1,30,878 per yearHiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...
-
Data Engineer
4 days ago
Chennai, India CX Data Labs Full timeHi Role - Azure Data engineer Location - Chennai, Gurugram (5days Onsite) Full time Immediate joiner Only (15days Notice period only) Technical Skills: o Proficiency in SQL for complex queries, database design, and optimization. o Strong experience with PySpark for data transformation and processing. o Hands-on experience with Databricks for building and...
-
Data Architect
6 days ago
Chennai, India Capgemini Engineering Full timeData Architect / Data Engineer Location: Chennai Experience: 4–6 years Your Role As a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...
-
Data architect
2 days ago
Chennai, India Capgemini Engineering Full timeData Architect / Data Engineer Location: Chennai Experience: 4–6 years Your Role As a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build...
-
Data Architect
7 days ago
Chennai, India Capgemini Engineering Full timeData Architect / Data Engineer Location: Chennai Experience: 4–6 years Your Role As a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to...
-
Data Architect
7 days ago
Chennai, India Capgemini Engineering Full timeData Architect / Data EngineerLocation: ChennaiExperience: 4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...
-
Data architect
3 days ago
Chennai, India Capgemini Engineering Full timeData Architect / Data EngineerLocation: ChennaiExperience: 4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...
-
Data Architect
6 days ago
Chennai, India Capgemini Engineering Full timeData Architect / Data Engineer Location: Chennai Experience: 4–6 years Your Role As a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...
-
Data Architect
7 days ago
Chennai, India Capgemini Engineering Full timeData Architect / Data EngineerLocation: ChennaiExperience: 4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...
