Databricks + Pyspark
1 day ago
Job Description Job Summary Location: AIA Group - Bhubaneswar We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive innovation and efficiency. The position is based on a day shift schedule with no travel requirements. Responsibilities - Develop and implement robust data solutions using Delta Live Pipelines to enhance data processing capabilities. - Collaborate with cross-functional teams to design and optimize Databricks SQL queries for improved performance. - Utilize Python to automate data workflows and streamline processes ensuring high-quality data management. - Oversee the deployment and maintenance of Databricks Workflows to support seamless data integration. - Leverage PySpark to process large datasets efficiently contributing to data-driven decision-making. - Ensure data accuracy and integrity by implementing best practices in data engineering and management. - Provide technical guidance and support to junior developers fostering a collaborative team environment. - Conduct regular code reviews to maintain high standards of code quality and performance. - Identify and resolve technical issues promptly to minimize disruptions in data operations. - Stay updated with the latest industry trends and technologies to continuously improve data solutions. - Document processes and solutions to facilitate knowledge sharing and team collaboration. - Engage in continuous learning to enhance skills and contribute to innovative solutions. - Drive the implementation of data solutions that align with the companys strategic goals and societal impact. Qualifications - Possess a strong background in Delta Live Pipelines and Databricks SQL with proven experience in data engineering. - Demonstrate proficiency in Python and PySpark with a focus on developing scalable data solutions. - Experience in designing and optimizing Databricks Workflows for efficient data integration. - Strong problem-solving skills and the ability to troubleshoot complex data issues effectively. - Excellent communication skills to collaborate with team members and stakeholders. - A proactive approach to learning and adapting to new technologies and methodologies. - A bachelors degree in Computer Science Information Technology or a related field is preferred. Certifications Required Databricks Certified Data Engineer Associate Python Certification
-
Databricks + Pyspark
1 week ago
Bhubaneswar, Orissa, India Cognizant Technology Solutions Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob SummaryWe are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive innovation and efficiency. The position is based on a...
-
Databricks + Pyspark
4 days ago
Bhubaneswar, Orissa, India Cognizant Full time**Job Summary** **Responsibilities** - Develop and implement robust data solutions using Delta Live Pipelines to enhance data processing capabilities. - Collaborate with cross-functional teams to design and optimize Databricks SQL queries for improved performance. - Utilize Python to automate data workflows and streamline processes ensuring high-quality...
-
Azure Databricks + Pyspark
1 week ago
Bhubaneswar, Orissa, India Cognizant Full time**Job Summary** **Responsibilities** - Analyze complex data sets to identify trends and patterns that can inform business decisions. - Develop and maintain data pipelines using Azure Data Factory to ensure seamless data integration. - Utilize PySpark and Python to perform data transformations and analytics. - Implement and manage workflows using BMC...
-
DataBrick
1 week ago
Chennai, India Virtusa Full timeJob Description We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data...
-
Data Architect/Senior Data Engineer
2 weeks ago
Thiruvananthapuram, Thiruvananthapuram / Trivandrum, India Quest Global Full timeJob Description Job Requirements Job Title: AWS Data Engineer Company: Quest Global Job Category: Multi Industry - MedTech Quest Global is seeking a highly skilled AWS Data Engineer with 6+ years of experience in AWS, Databricks, Pyspark and S3. As an AWS Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines,...
-
▷ (Urgent Search) Azure Databricks
7 days ago
Chennai, India Viraaj HR Solutions Private Limited Full timeJob Description Industry & Sector: HR & IT Staffing firm focused on placing cloud data engineering and analytics talent into enterprise clients across finance, retail, and technology sectors. This recruitment drive targets senior cloud data engineers with hands-on experience in Azure Databricks and modern data platform architectures. Position: Azure...
-
Databricks Architect
2 weeks ago
Hyderabad, India Jio Full timeJob Description Skills: Data Engineering, Azure Databricks, Data Modeling, architecture, pyspark, scala, SQL, About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion,...
-
Databricks Developer
3 weeks ago
Pune, India Vista Applied Solutions Group Inc Full timeJob Description Job Summary: Client is looking for Databricks Developer and this is hybrid position from Pune. Responsibilities: - Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices. - Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief...
-
Databricks along with Python
3 days ago
Bengaluru, India Tata Consultancy Services Full timeJob Description Role: Databricks along with Python Experience range: 5-10 years Location: Hyderabad/Bangalore/Chennai Job description: Must Have : - Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark - Proficient with Databricks & Python -...
-
Senior Data Engineer- Databricks
1 week ago
India InfoCepts Full time ₹ 15,00,000 - ₹ 25,00,000 per yearPosition: Senior Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain...