Azure Databricks

4 weeks ago

Chennai, Tamil Nadu, India Cognizant Full time

Technical Lead

Qualification:

Bachelors in science , engineering or equivalent

Responsibility:

Project Planning and Setup:

  • Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review.
  • Provide inputs to testing strategy, configuration, deployment, hardware/software requirement etc.
  • Review plan and provide feedback on gaps, timeline and execution feasibility etc as required in the project.
  • Participate in KT sessions conducted by customer/ other business teams and provide feedback on requirements.

Requirement Understanding and Analysis:

  • Analyze functional/non functional requirements and seek clarifications for better understanding of requirements.
  • Based on understanding of system upstream & downstream, provide feedback and inputs on gaps in requirements and technical feasibility of requirements.

Design:

  • Prepare the LLD/ detailed design documents based on HLD and briefing from Module Lead.
  • Seek inputs from the developers on specific modules as applicable.
  • Consolidate all modules and provide to Module Lead/ Architects/ Designers for review.
  • Suggest changes in design on technical grounds.
  • Develop components inventory for the code to be developed tying it to the nonfunctional requirements.
  • Perform sampling of data to understand the character/ quality of the data (project dependent in the absence of data analyst or designer).
  • Identify tools and technologies to be used in the project as well as reusable objects that could be customized for the project.

Coding:

  • Follow coding standards and best practices to develop code and check code quality.
  • Share developed code with supervisor for review.
  • Rework on the code based on inputs if required.
  • Perform complex integration.
  • Guide the developers in identifying, preparing and conducting unit test cases and fixing defects based on results.
  • Consolidate the test results and share with supervisor.
  • Provide periodic status update to supervisor and highlight / recommend any changes in design based on challenges faced.
  • Anticipate unreported defects and raise the same to supervisor.
  • Conduct technical troubleshooting.
  • Conduct reviews for codes created by team.

Testing Management:

  • Develop unit test case for each module.
  • Conduct/ guide conducting of unit and integration testing and fix defects.
  • Review/ approve code to be moved to testing environment.
  • Provide support to the QA team and coordinate for various phases of testing.
  • Address queries raised by QA within defined timelines.
  • Investigate critical defects and establish need for fixing.
  • Raise issues to leads/QA.
  • Report defect status as per project standard process within agreed timelines.
  • Share revised code with supervisor for review.
  • Assist team lead and project manager on estimates around defect fixes.

Configuration Management:

  • Maintain versions of the code or consolidate version maintained by the Developers.
  • Provide support as required to the Administrators during configuration, code backups, deployment etc.

Deployment:

  • Assess and create deployment/ roll back plan.
  • Validate if all the components have been migrated and the right version is checked in.
  • Maintain deployment tracker.
  • Perform sanity checks post deployment to ensure smooth production.
  • Share activity status with supervisor and highlight concerns if any.

Project Execution Monitoring & closure (Support to Project Management activities):

  • Monitor work of the developers and share work achieved with them.
  • Provide guidance through SDLC.
  • Provide status of progress to leads.
  • In case of change requests, provide inputs on the plan.

Service Support and Maintenance:

Specific to production and maintenance support:

  • Provide support for 1 week and hand over to production team.
  • Identify if the incoming request is a service request/ defect during the warranty or an incident.
  • If it is code defect in the warranty, highlight to Lead and initiate defect fix process.
  • Post warranty, support in transition to maintenance team.

Knowledge Management:

  • Post release participate in project review call and discuss points on what went well and what didn't.
  • Create and update knowledge articles (case studies, lessons learnt) in the knowledge management repository.
  • Guide developers in creating such documents.
  • Publish white papers/ blogs/ articles (if required).

People Management:

  • Conduct training through academy or internally within the team.
  • Conduct technical, face to face interviews for internal transfer or external hiring.
  • Provide feedback on Developers form technical /domain standpoint to the module lead.

Must Have Skills

  • Databricks SQL
  • Databricks Workflows
  • PySpark
  • Informatica PowerCenter

Good To Have Skills

  • Spark in Scala
  • Databricks Workspace Admin
  • Databricks CLI
  • Databricks Unity Catalog
  • Delta Live Pipelines
  • Structured Streaming
  • Kafka
  • Azure Monitor
  • Azure Data Lake Store
  • Azure Key Vault
  • Azure DevOps
  • Azure Event Hub
  • Python

  • Azure Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India CIEL HR Services Full time

    Work experience-Above 6 yearsNotice period-Immediate to 15 daysWork Mode-HybridMust have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks)Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremoniesExpertise in Azure Data Bricks, ADF, ADL,...

  • Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India Astonishic LLC Full time

    Title : Data Engineer - Databricks Specialist Location : Chennai, Tamil Nadu Experience : 2-6 years Employment Type : OnsiteNumber of Positions : 10Job Description :- Design, build, and maintain scalable and robust data pipelines using Databricks.- Develop and optimize data processing using Apache Spark and related technologies.- Collaborate with...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Astonishic LLC Full time

    Title : Data Engineer - Databricks Specialist Location : Chennai, Tamil Nadu Experience : 2-6 years Employment Type : OnsiteNumber of Positions : 10Job Description :- Design, build, and maintain scalable and robust data pipelines using Databricks.- Develop and optimize data processing using Apache Spark and related technologies.- Collaborate with...

  • Technical Curriculum Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    CSQ125R121As a Technical Curriculum Developer at Databricks, you will apply your experience in the Data and AI space to develop and maintain learning materials following curriculum development best practices. Under the direction of Senior Technical Curriculum Developers, you will develop content focused on the Databricks Data Intelligence Platform -...

  • Senior Security Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    RDQ324R4TheIncident Responseteam's mission is to respond to security threats, incidents and investigations to protect our customers, employees and enterprise data in an efficient and standardised manner. We're a tight-knit team of security incident responders and incident handlers doing "Security for Databricks on Databricks", using our own platform to...

  • Senior Security Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    RDQ324R4 The Incident Response team's mission is to respond to security threats, incidents and investigations to protect our customers, employees and enterprise data in an efficient and standardised manner. We're a tight-knit team of security incident responders and incident handlers doing "Security for Databricks on Databricks", using our own platform to...

  • Big Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    CSQ225R66As aResident Solutions Architectin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Urgent Opening for Azure Databricks with _Chennai/Indore

    2 weeks ago

    Chennai, Tamil Nadu, India Hexaware Technologies Full time

    Hi,Greetings of the dayUrgent Opening for Azure Databricks with Hexaware TechnologiesInterviewF2F on 27th April 24 in Chennai and IndoreRequest you to go through the Job Description thoroughly and if interested, please fill the below mentioned details to process your candidature.1. Total Experience-2. Relevant Experience(Azure...

  • Manager (Big Data)

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    CSQ325R53As aBig Data Managerin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Architect - Big Data

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...

  • Architect , Big Data

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    CSQ225R24 As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...

  • Technical Services Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    CSQ325R3 Mission :At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Data Intelligence platform. As a Technical Services Engineer you will play a critical role in advising Customers in their onboarding journe y. You will directly work with customers to help them onboard and deploy...

  • Lead Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India DigiMoksha Solutions Full time

    Job Description :Role Overview : As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data...

  • Solutions Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    FEQ225R102As aSolutions Architect(Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be atechnical advisorinternally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Solutions Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Azure Databricks with Unity catalog

    2 weeks ago

    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job Title: Data Engineering SpecialistExperience: 5.5 to 10 yearsLocations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, MumbaiTarget Notice Period: Immediate JoinerKey Skills: Databricks, Data Lake, Pyspark with Unity catalogDatabricks Module Lead Job Description:The role involves working on Unity Catalog migration for adidas domains....

  • Azure Databricks with Unity catalog

    2 weeks ago

    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job Title:Specialist-Data EngineeringExperience Range:5.5 to 10 yearsHiring Locations:Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, MumbaiTarget Notice Period:Immediate JoinerKey Skills to Look for: Databricks, Data Lake, Pyspark with Unity catalogDatabricks -Module Lead -Job DescriptionThe individual will be working in Unity Catalog migration for...

  • Databricks Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Hexaware Technologies Full time

    :Primary Skills: Databricks with Pyspark, PythonSecondaryskills; ADF7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.4+ years of work experience in Databricks, Pyspark and Python project development workExpertise in Bigdata Eco systems like HDFS and SparkStrong hands-on experience...

  • Azure Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Job descriptionRole: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Databricks, Python, SQL. Must have cloud knowledge of anyone (Azure, AWS, GCP) Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable high-quality code. Design, develop and maintain scalable data pipelines using...