Azure Databricks Data Engineer
3 weeks ago
**Key Responsibilities:**
As an ETL Automation Specialist at JRD Systems, you will be responsible for creating test automation using an existing data automation framework to validate business rules for audience creation across multiple social media channels.
The ideal candidate will have experience in Azure Databricks, building automation tests using Python/PySpark, SQL/Python skills, and the ability to write complex queries inside Azure Databricks.
You will also be responsible for automating recurring ETL processes using the PyTest framework, validating the flow of data from disparate sources ingested into various data stores, and creating and executing manual test cases based on details mentioned as part of functional requirements.
In this role, you will have the opportunity to work with a talented team of professionals who are passionate about delivering high-quality solutions.
**Requirements:**
- Experience in Azure Databricks
- Prior experience with building automation tests using Python/PySpark
- SQL/Python skills and the ability to write complex queries inside Azure Databricks
- 2+ years working in Azure Databricks, Data Factory, Data Lake
- Good understanding of file formats including JSON, Parquet, Avro, and others
- Ability to learn new technologies quickly
- Excellent problem-solving skills
- Basic understanding of software development principles
- Knowledge of Jira
**What We Offer:**
A competitive salary and benefits package, opportunities for career growth and development, and a dynamic and supportive work environment.
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India FreeBirds Technology Pvt Ltd Full time**Job Title:** Data Engineer - Azure Databricks SpecialistAbout the Role:We are seeking an experienced Data Engineer to join our team as a Databricks Specialist. The successful candidate will be responsible for designing and implementing data pipelines on Azure Databricks.Key Responsibilities:Design and develop data pipelines using Azure...
-
Azure Databricks Data Engineer Position
3 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeAzure Databricks Data Engineer RoleTata Consultancy Services is seeking a skilled Data Engineer to join our team and work on Azure Databricks development. The ideal candidate will have experience with Python, PySpark, and ETL notebook development.Key Responsibilities:Develop and maintain ETL notebooks using PySparkDesign and implement data models using...
-
Bengaluru, Karnataka, India L&T Technology Services Full timeAbout the RoleWe are seeking a highly skilled Data Engineer with expertise in Databricks and Azure cloud to join our team at L&T Technology Services. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks and Azure services.With 5+ years of experience in...
-
Databricks Backline Technical Solutions Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeRole OverviewAt Databricks, we empower data teams to drive innovation by building and running the world's best data and AI infrastructure platform. We are seeking a highly skilled Backline Technical Solutions Engineer to join our team.Key ResponsibilitiesTroubleshoot and resolve complex customer issues related to the Databricks Platform by analyzing core...
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India upGrad Full timeWe are seeking a skilled Data Engineer with expertise in Azure Databricks and Snowflake to design and develop scalable data solutions.This role involves leveraging Kafka Streaming to build real-time data pipelines and ensuring the smooth operation of data infrastructure.To succeed, you will have hands-on experience with DBT, SQL, and Azure Databricks and be...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Altimetrik Full timeJob Title: Senior Data Engineer - Azure Databricks ExpertJob Description:As a Senior Data Engineer at Altimetrik, you will work on designing, developing, and maintaining large-scale data processing systems using Azure Databricks. Your primary responsibility will be to ensure the smooth functioning of our data analytics solutions, providing high-quality data...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeUnlock the Full Potential of Data Science and AnalyticsAt Databricks, we're committed to empowering businesses to make data-driven decisions. As a Solutions Engineer, you'll play a pivotal role in helping our customers unlock the full potential of data science and analytics. You'll work closely with our team to deliver customized solutions that drive...
-
Lead Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Databricks Full timeFEQ425R196As a Senior Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will lead the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to...
-
Senior Cloud Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Recmatrix Consulting Full timeJob Title: Senior Cloud Data Engineer - Azure DatabricksOverview: The role of a Lead Data Architect - Big Data and Cloud Solutions at Recmatrix Consulting involves designing and managing data processing systems. A strong background in both cloud-based and on-premises big data technologies is essential, ensuring seamless integration, optimization, and...
-
Databricks Staff Software Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeWe are passionate about empowering data teams to solve complex problems. Our mission is to build and run the world's best data and AI infrastructure platform, enabling customers to make data-driven decisions that improve their business.As a Staff Software Engineer at Databricks, you will work on building and scaling our services and infrastructure across...
-
Data Architect
3 weeks ago
Bengaluru, Karnataka, India Databricks Full timeData Engineering Lead PositionWe are seeking a skilled Data Engineering Lead to join our team at Databricks, where our core values of proactiveness and customer-centric mindset drive us to create a unified platform for data science and analytics. As a Data Engineering Lead, you will be instrumental in helping our customers solve complex data challenges using...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Mazenet solution Full timeCompany OverviewMazenet solution is a leading IT service provider with a strong presence in the market. Our company is headquartered in Chennai and offers innovative solutions in various IT domains.Job OverviewWe are seeking an experienced Cloud Data Platform Engineer to join our dynamic team. This is a mid-level, full-time position with the flexibility to...
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...
-
Senior Data Infrastructure Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeP-1348Databricks is revolutionizing the way data teams work. As a Senior Software Engineer on the Data Platform team, you will help build the Data Intelligence Platform that will automate decision-making across the entire company. You will collaborate with Databricks Product Teams, Data Science, and Applied AI to develop a variety of tools, including...
-
Azure Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Covenant Consultants Full timeJob OverviewCovenant Consultants is a leading data analytics company based in the US, offering hybrid work opportunities with general shifts.We are seeking an experienced Data Engineer to join our team, with a strong background in Azure Cloud and Databricks.
-
Azure Databricks Engineer
3 weeks ago
Bengaluru, Karnataka, India Mazenet solution Full timeAbout Mazenet SolutionMazenet solution is a renowned IT service provider with a strong presence in the market. Our company, headquartered in Chennai, offers innovative solutions in various IT domains. With a workforce of 201-500 employees, we are dedicated to delivering high-quality services and fostering a positive workplace for our employees.Job OverviewWe...
-
Software Development Engineer | Databricks
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAt Databricks, we're building a platform that enables data teams to solve the world's most complex problems. We're passionate about empowering our customers to achieve breakthroughs in fields like transportation, medicine, and more. As a Senior Software Engineer, you'll contribute to the development of scalable, high-performance services and client libraries...
-
Data Architect
1 month ago
Bengaluru, Karnataka, India Databricks Full timeUnlock the Power of Data ScienceDatabricks is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data architectures that enable our customers to make informed decisions. You will work closely with our customers to understand their data needs and develop solutions that meet...
-
Senior Data Engineer
1 month ago
Bengaluru, Karnataka, India Databricks Full timeAbout the RoleWe are seeking a highly skilled Senior Software Engineer to join our Data Platform team at Databricks. As a key member of our team, you will play a critical role in building and operating our Data Intelligence Platform, which enables data-driven decision-making across the company.Key Responsibilities:Design and implement a scalable metrics...
-
Data Engineering Innovator
5 days ago
Bengaluru, Karnataka, India Diagonal Consulting Full time**Overview of Diagonal Consulting**We are a data analytics company that aims to create lasting outcomes for our customers. Our team is passionate about designing and executing innovative data strategies that enhance business efficiency.About the JobThis is a full-time hybrid role for a Practice Lead - Databricks at Diagonal consulting. As a key member of our...