Azure Databricks Engineer
1 month ago
Azure Databricks Engineer
About the Role :
- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.
- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data processing.
Responsibilities :
- Design, develop, and implement efficient and scalable data processing pipelines using Apache Spark on Azure Databricks.
- Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions.
- Leverage Azure Data Factory to orchestrate data movement and integration between various Azure data services (Data Lake, Synapse, SQL Database, etc. ).
- Utilize SQL and Python/PySpark for data manipulation, transformation, and analysis.
- Implement unit and integration tests to ensure the quality and reliability of data pipelines.
- Configure and manage Azure Databricks clusters for optimal performance and resource utilization.
- Integrate data pipelines with Azure DevOps for continuous integration and continuous delivery (CI/CD).
- Monitor and troubleshoot data pipelines to identify and resolve issues proactively.
- Stay up-to-date with the latest advancements in Azure Databricks, Apache Spark, and related technologies.
- Participate in code reviews and knowledge sharing sessions with the 5-10 years of experience in data engineering with a focus on big data processing.
- In-depth knowledge of Azure data services, including Azure Databricks, Data Factory, Data Lake, and Synapse.
- Proven experience in developing and deploying large-scale data processing pipelines using Apache Spark.
- Proficiency in SQL and Python/PySpark for data manipulation and analysis.
- Experience with CI/CD methodologies and Azure DevOps is a plus.
- Familiarity with data governance tools like Azure Purview or Collibra Unity Catalog (a plus).
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
-
Azure Databricks Engineer
4 weeks ago
Bengaluru, India Tredence Inc. Full timeRole: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...
-
Azure Databricks Engineer
4 weeks ago
Bengaluru, India Tredence Inc. Full timeRole: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...
-
Azure Databricks Engineer
4 weeks ago
Bengaluru, India Tredence Inc. Full timeRole: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...
-
Azure Databricks Engineer
2 weeks ago
Bengaluru, India Notus Full timeJob Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...
-
Data Engineer
2 months ago
Bengaluru, India Career Soft Solutions Full timeJob Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...
-
Azure Databricks Engineer
2 weeks ago
Bengaluru, India Advitha Tech Solutions Full timeJob Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...
-
Senior Azure Data Engineer
4 weeks ago
Bengaluru, India Techno Wise Full timeResponsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...
-
Senior Technical Solutions Engineer- Platform
2 weeks ago
Bengaluru, India Databricks Full timeCSQ424R4MissionAs a Platform Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realize value...
-
Technical Solutions Engineer- Platform
2 weeks ago
Bengaluru, India Databricks Full timeCSQ424R4MissionAs a Platform Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realize value...
-
Architect - Azure Databricks
4 weeks ago
Bengaluru, India Marlabs LLC Full timeMarlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Location -...
-
Architect - Azure Databricks
4 weeks ago
Bengaluru, India Marlabs LLC Full timeMarlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Location -...
-
Azure Databricks Pyspark Developer
1 week ago
Bengaluru, India Tredence Inc. Full timeMUST HAVE • Minimum of 4 to 8 years of Azure DE experience. • In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc. • Experience in collaborating with business stakeholders to identify and meet data requirements • Experience in using Azure services and tools to ingest, egress, and transform data...
-
Architect - Azure Databricks
4 weeks ago
Bengaluru, India Marlabs LLC Full timeMarlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – www.marlabs.com.Work...
-
Architect - Azure Databricks
4 weeks ago
Bengaluru, India Marlabs LLC Full timeMarlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – www.marlabs.com.Work...
-
Azure Databricks
2 months ago
Bengaluru, India CIEL HR Services Full timeWork experience-Above 6 years Notice period-Immediate to 15 days Work Mode-Hybrid Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremonies Expertise in Azure Data Bricks, ADF,...
-
Azure Databricks Pyspark Developer
1 month ago
Bengaluru, India Tredence Inc. Full timeMUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...
-
Azure Databricks Pyspark Developer
1 month ago
Bengaluru, India Tredence Inc. Full timeMUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...
-
Senior Data Engineer
4 weeks ago
Bengaluru, India Growel Softech Pvt. Ltd. Full timeJob Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...
-
Data Scientist
4 weeks ago
Bengaluru, India VIDPRO CONSULTANCY SERVICES Full timeAbout the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...
-
Senior Software Engineer
4 weeks ago
Bengaluru, India Marlabs LLC Full timeMarlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Location -...