Pyspark + Databricks
24 hours ago
**Skill: Pyspark + Databricks**
** Experience**: 6 to 9 Years
** Location : AIA - Gurgaon**
**Job Summary**
**Responsibilities**
- Lead the design and implementation of scalable data solutions using Databricks Workflows to enhance data processing capabilities.
- Oversee the integration of Databricks Unity Catalog to ensure seamless data governance and security across platforms.
- Provide technical expertise in Databricks to optimize performance and drive innovation in data analytics.
- Collaborate with cross-functional teams to deliver high-quality solutions that meet business requirements and objectives.
- Develop and maintain comprehensive documentation for data workflows and processes to facilitate knowledge sharing.
- Mentor and guide junior team members to foster a culture of continuous learning and improvement.
- Conduct regular code reviews to ensure adherence to best practices and coding standards.
- Analyze complex data sets to identify trends and insights that support strategic decision-making.
- Implement robust testing frameworks to ensure the reliability and accuracy of data solutions.
- Coordinate with stakeholders to gather requirements and translate them into technical specifications.
- Drive the adoption of new technologies and methodologies to enhance the teams capabilities and efficiency.
- Ensure compliance with industry standards and regulations to protect data integrity and privacy.
- Monitor system performance and troubleshoot issues to maintain optimal operation of data platforms.
**Qualifications**
- Possess extensive experience in Databricks Workflows and Unity Catalog demonstrating a deep understanding of their functionalities.
- Have a strong background in data engineering and analytics with a proven track record of delivering successful projects.
- Exhibit excellent problem-solving skills and the ability to work effectively in a hybrid work model.
- Demonstrate proficiency in programming languages such as Python or Scala relevant to Databricks environments.
-
databricks/pyspark
2 weeks ago
Chennai, Tamil Nadu, India NRM Analytix Full time ₹ 4,00,000 - ₹ 12,00,000 per yearResponsibilities:* Design, develop & maintain PySpark solutions using Databricks platform* Optimize performance through efficient data processing techniques* Collaborate with cross-functional teams on project deliveryAccessible workspace
-
Azure Databricks + Pyspark
18 hours ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per yearAzure DatabricksLocation - Hyderabad / Experience - 9 to 12 YearsJob Summary8plus years of technical and development experience3 plus years of Experience with Azure Data Factory Azure Synapse and DatabricksExperience with ETL SQL PySparkExperience managing cloud applications (Managing network security is a plus)Experience with git repositories and release...
-
Pyspark + Databricks
5 days ago
Chennai, India Cognizant Full timeJob Description Skill: Pyspark + Databricks Experience: 6 to 9 Years Location : AIA - Gurgaon Job Summary We are seeking a highly skilled Technical Lead with 12 to 16 years of experience to join our dynamic team. The ideal candidate will have expertise in Databricks Workflows Unity Catalog and Databricks with a preference for experience in Research and...
-
Etl Databricks with Aws
6 days ago
Chennai, Tamil Nadu, India Virtusa Full timeDevelop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines for batch and streaming data using Delta...
-
Databrick
4 days ago
Chennai, Tamil Nadu, India Virtusa Full timeKey Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...
-
Azure Databricks
24 hours ago
Chennai, Tamil Nadu, India Cognizant Full time**Skill: Azure Databricks** **Experience**: 9 to 12 years **Location: AIA-Gurgaon** **Job Summary** As a Sr. Developer you will leverage your expertise in Databricks PySpark and AWS to drive innovative solutions in a hybrid work model. With 6 to 10 years of experience you will collaborate with cross-functional teams to enhance data processing...
-
Databricks
23 hours ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per yearJob descriptionAzure Databricks + PysparkLocation - CoimbatoreExpereince - 6 to 8 YearsExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD...
-
Databricks Engineer
2 weeks ago
tamil nadu, India Tata Consultancy Services Full timeTCS present an excellent opportunity for Databricks EngineerJob Location: Chennai (ONLY)Experience required : 6-10 yrsVirtual Interview Date: 25-Oct-25 (Saturday)Must-HaveData Engineer having , Databricks & AWS development experienceDevelopment experience in Python, Pyspark Hands-on experience in writing complex SQLs and performance optimization of very...
-
DataBrick
3 weeks ago
Chennai, India Virtusa Full timeJob Description We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data...
-
Pyspark / Reltio
1 week ago
Chennai, Tamil Nadu, India Virtusa Full timeKey Responsibilities: Develop and maintain data pipelines using PySpark in distributed computing environments (e.g., AWS EMR, Databricks). Integrate and synchronize data between enterprise systems and the Reltio MDM platform. Design and implement data transformation, cleansing, and enrichment processes. Collaborate with data architects, business analysts,...