Pyspark + Databricks

5 days ago

Chennai India Cognizant Full time

Job Description Skill: Pyspark + Databricks Experience: 6 to 9 Years Location : AIA - Gurgaon Job Summary We are seeking a highly skilled Technical Lead with 12 to 16 years of experience to join our dynamic team. The ideal candidate will have expertise in Databricks Workflows Unity Catalog and Databricks with a preference for experience in Research and Development. This hybrid role offers the opportunity to work on cutting-edge projects during day shifts with no travel required. Responsibilities - Lead the design and implementation of scalable data solutions using Databricks Workflows to enhance data processing capabilities. - Oversee the integration of Databricks Unity Catalog to ensure seamless data governance and security across platforms. - Provide technical expertise in Databricks to optimize performance and drive innovation in data analytics. - Collaborate with cross-functional teams to deliver high-quality solutions that meet business requirements and objectives. - Develop and maintain comprehensive documentation for data workflows and processes to facilitate knowledge sharing. - Mentor and guide junior team members to foster a culture of continuous learning and improvement. - Conduct regular code reviews to ensure adherence to best practices and coding standards. - Analyze complex data sets to identify trends and insights that support strategic decision-making. - Implement robust testing frameworks to ensure the reliability and accuracy of data solutions. - Coordinate with stakeholders to gather requirements and translate them into technical specifications. - Drive the adoption of new technologies and methodologies to enhance the teams capabilities and efficiency. - Ensure compliance with industry standards and regulations to protect data integrity and privacy. - Monitor system performance and troubleshoot issues to maintain optimal operation of data platforms. Qualifications - Possess extensive experience in Databricks Workflows and Unity Catalog demonstrating a deep understanding of their functionalities. - Have a strong background in data engineering and analytics with a proven track record of delivering successful projects. - Exhibit excellent problem-solving skills and the ability to work effectively in a hybrid work model. - Demonstrate proficiency in programming languages such as Python or Scala relevant to Databricks environments. - Show a keen interest in Research and Development with the ability to apply domain knowledge to data solutions.

  • Databricks + Pyspark

    2 weeks ago

    Bhubaneswar, India Cognizant Full time

    Job Description Job Summary Location: AIA Group - Bhubaneswar We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive...

  • databricks/pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India NRM Analytix Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Responsibilities:* Design, develop & maintain PySpark solutions using Databricks platform* Optimize performance through efficient data processing techniques* Collaborate with cross-functional teams on project deliveryAccessible workspace

  • Azure Databricks + Pyspark

    19 hours ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Azure DatabricksLocation - Hyderabad / Experience - 9 to 12 YearsJob Summary8plus years of technical and development experience3 plus years of Experience with Azure Data Factory Azure Synapse and DatabricksExperience with ETL SQL PySparkExperience managing cloud applications (Managing network security is a plus)Experience with git repositories and release...

  • Pyspark + Databricks

    1 day ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Skill: Pyspark + Databricks** ** Experience**: 6 to 9 Years ** Location : AIA - Gurgaon** **Job Summary** **Responsibilities** - Lead the design and implementation of scalable data solutions using Databricks Workflows to enhance data processing capabilities. - Oversee the integration of Databricks Unity Catalog to ensure seamless data governance and...

  • Databricks

    54 minutes ago

    Chennai, India Cognizant Full time

    Job Description Azure Databricks Primary Skill - Databricks + Pyspark Location - Coimbatore Job Description Experience with Azure Data Bricks, Data Factory Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics Experience in Python/Pyspark/Scala/Hive Programming. Experience with Azure Databricks/ADB...

  • DataBrick

    3 weeks ago

    Chennai, India Virtusa Full time

    Job Description We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data...

  • Pyspark Azure Databricks Data Engineer

    1 week ago

    India Crisil Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job SummaryCrisil Risk Technology group is seeking a strong Python/Pyspark Developer. He/she will be responsible for designing, developing and maintaining scalable data pipeline and ETL process using Azure cloud platform and Azure Databricks.SCOPEA key focus of this role is to build and manage advanced data pipelines, perform large-scale data processing, and...

  • Databricks

    24 hours ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Job descriptionAzure Databricks + PysparkLocation - CoimbatoreExpereince - 6 to 8 YearsExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD...

  • ▷ (Urgent Search) Azure Databricks

    3 weeks ago

    Chennai, India Viraaj HR Solutions Private Limited Full time

    Job Description Industry & Sector: HR & IT Staffing firm focused on placing cloud data engineering and analytics talent into enterprise clients across finance, retail, and technology sectors. This recruitment drive targets senior cloud data engineers with hands-on experience in Azure Databricks and modern data platform architectures. Position: Azure...

  • Databricks Developer-atgtjp00097212

    2 weeks ago

    India Ashra Technologies Private Limited Full time

    Greetings from Ashra Technologies We are hiring Job Role Databricks Developer Experience 8 years Locations Pune Mumbai Chennai Bangalore Key skills Databricks PySpark SQL Experience in credit rating Structured Finance Domain is a must Min 8 years of relevant exp is required We are seeking a highly skilled Senior Data Engineer with deep expertise in...