Azure Databricks

7 days ago

Chennai Tamil Nadu, India Cognizant Full time

**Skill: Azure Databricks**

**Experience**: 9 to 12 years

**Location: AIA-Gurgaon**

**Job Summary**

As a Sr. Developer you will leverage your expertise in Databricks PySpark and AWS to drive innovative solutions in a hybrid work model. With 6 to 10 years of experience you will collaborate with cross-functional teams to enhance data processing capabilities and contribute to the companys mission of delivering impactful technology solutions.

**Responsibilities**

- Develop and implement data processing solutions using Databricks and PySpark to optimize data workflows and improve efficiency.
- Collaborate with data engineers and analysts to design scalable data architectures on AWS ensuring seamless integration and performance.
- Analyze complex data sets to identify trends and insights that drive strategic decision-making and business growth.
- Provide technical guidance and support to team members fostering a collaborative and innovative work environment.
- Ensure data quality and integrity by implementing robust data validation and cleansing processes.
- Optimize existing data pipelines and workflows to enhance performance and reduce processing time.
- Conduct code reviews and provide constructive feedback to maintain high coding standards and best practices.
- Stay updated with the latest industry trends and technologies to continuously improve data processing capabilities.
- Participate in agile development processes contributing to sprint planning retrospectives and daily stand-ups.
- Troubleshoot and resolve technical issues related to data processing and AWS infrastructure.
- Document technical specifications and processes to ensure knowledge sharing and continuity.
- Engage with stakeholders to understand business requirements and translate them into technical solutions.
- Contribute to the companys purpose by developing data-driven solutions that have a positive impact on society.

**Qualifications**

- Possess strong experience in Databricks and PySpark with a proven track record of successful project implementations.
- Demonstrate expertise in AWS services particularly in data processing and storage solutions.
- Exhibit excellent problem-solving skills and the ability to analyze complex data sets.
- Have a solid understanding of data architecture and design principles.
- Show proficiency in agile development methodologies and practices.
- Display strong communication skills to effectively collaborate with cross-functional teams.

**Certifications Required**

AWS Certified Solutions Architect Databricks Certified Associate Developer for Apache Spark

  • Azure Databricks Engineer

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...

  • Azure Databricks Engineer

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Azure Databrick

    1 week ago

    Chennai, India LatentView Analytics Pvt. Ltd Full time

    Role : Azure Databricks Experience:5 to 9 yrs Location: Chennai Position : Full time Good to have : - 5+ years of relevant experience in azure Data brick. - Strong proficiency in Microsoft SQL Server development, including i)ability to query and investigate data and to write views, stored procedures and other objects using SQL. ii)understanding and...

  • Azure Databricks

    7 days ago

    Bengaluru, Chennai, Hyderabad, India Eniac Systems Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesJob Title: DeveloperWork Location: NOIDA, UP / HYDERABAD, TG / CHENNAI, TN / PUNE, MH / BANGALORE, KA / INDORE / KOLKATA, WBSkills Required: Azure Data FactoryExperience: yearsSkillCategoryTest1_MNDigital : Azure DatabricksYes14-7 yearsShould build Databricks Notebook developed in spark SQL/ pyspark• Should be able to create unity...

  • Azure Databricks Engineer

    3 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-Have- Azure Devops- Azure Data...

  • Azure Databricks Engineer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...

  • Azure Databricks Engineer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...

  • Databrick

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Azure databricks engineer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Role** Databricks Engineer (Individual Contributor)Required Technical Skill Set** Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd, Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Azure Databricks Engineer

    1 week ago

    Chennai, India Tata Consultancy Services Full time

    Role** Databricks Engineer (Individual Contributor)Required Technical Skill Set** Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...