Azure Databricks Engineer
2 months ago
The Azure Databricks Data Engineer will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks. You will be responsible for developing and managing data pipelines, ensuring data quality, and enabling advanced analytics capabilities by building standardized Data Models. Your role will involve close collaboration with data scientists, analysts, and other stakeholders to deliver data-driven solutions that support the strategic goals of Bosch.
Responsibilities
Collaborate with internal Bosch team in the design, construction, installation, tests, and maintenance of highly scalable data management systems using Azure Databricks.
Develop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks utilities.
Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.
Ensure optimal performance of data processing and extraction, transformation, and loading (ETL) processes.
Collaborate with data architects to implement effective data models and schemas within the Databricks environment.
Monitor data reliability, efficiency, and quality, and implement improvements as needed.
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
Develop and maintain documentation related to data pipeline architecture, development processes, and data governance.
Stay current with industry trends and developments in cloud computing, big data, and Azure Databricks.
The following attributes are a plus:
Experience with machine learning frameworks and libraries.
Knowledge of additional big data tools and platforms.
Familiarity with data visualization tools and techniques. Qualifications:
Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or proved experience in a similar field.
Proven experience as a Data Engineer with a focus on Azure Databricks and related Azure services.
Strong programming skills in languages such as Python, Scala, or Java.
Experience with Apache Spark and its integration with Databricks.
Proficiency in SQL and experience with data modeling and data warehousing concepts.
Familiarity with DevOps practices and CI/CD pipelines.
Excellent analytical and problem-solving abilities.
Effective communication skills in English and Portuguese and the ability to work collaboratively in a team environment.
Qualifications
Bachelor of Engineering / Computer science
Additional Information
7-9
-
Databricks Backline Technical Solutions Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeRole OverviewAt Databricks, we empower data teams to drive innovation by building and running the world's best data and AI infrastructure platform. We are seeking a highly skilled Backline Technical Solutions Engineer to join our team.Key ResponsibilitiesTroubleshoot and resolve complex customer issues related to the Databricks Platform by analyzing core...
-
Azure Databricks Engineer
3 months ago
Bengaluru, India Mazenet solution Full timeCompany OverviewMazenet solution is a prominent player in the IT service industry with a workforce of 201-500 employees. Our company, headquartered in Chennai, provides innovative solutions in various IT domains. With a strong presence in the market, Mazenet solution is dedicated to delivering high-quality services and fostering a positive workplace for our...
-
Azure databricks engineer
5 days ago
Bengaluru, India KrtrimaIQ Cognitive Solutions Full timeJob Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our...
-
Azure Databricks
1 month ago
Bengaluru, India Ahvi Infotech Full timeAbout the job Azure DatabricksPosition: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadEssential experience:Experience in building ETL / data warehouse transformation processes Direct...
-
Azure Databricks Engineer
1 week ago
Bengaluru, India krtrimaIQ Cognitive Solutions Full timeJob Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our clients....
-
Databricks Staff Software Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeWe are passionate about empowering data teams to solve complex problems. Our mission is to build and run the world's best data and AI infrastructure platform, enabling customers to make data-driven decisions that improve their business.As a Staff Software Engineer at Databricks, you will work on building and scaling our services and infrastructure across...
-
Azure Databricks
2 weeks ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time**About the job Azure Databricks**: **Position**: Lead - Azure Databricks **Overall IT experience**:8 to 13 years **Primary Skills**:Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse **Secondary Skills**:U-SQL, Spark, Scala, Python **Work Location**:Bengaluru, Hyderabad **Notice Period**:0 to 30 Days **Essential experience**: Experience...
-
Azure Databricks
1 month ago
Bengaluru, India PradeepIT Consulting Services Pvt Ltd Full timePosition: Lead - Azure Databricks Overall IT experience: 8 to 13 years Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, Python Work Location: Bengaluru, Hyderabad Notice Period: 0 to 30 Days Essential experience: Experience in building ETL / data warehouse transformation processes...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India FreeBirds Technology Pvt Ltd Full time**Job Title:** Data Engineer - Azure Databricks SpecialistAbout the Role:We are seeking an experienced Data Engineer to join our team as a Databricks Specialist. The successful candidate will be responsible for designing and implementing data pipelines on Azure Databricks.Key Responsibilities:Design and develop data pipelines using Azure...
-
Azure Databricks Data Engineer Position
4 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeAzure Databricks Data Engineer RoleTata Consultancy Services is seeking a skilled Data Engineer to join our team and work on Azure Databricks development. The ideal candidate will have experience with Python, PySpark, and ETL notebook development.Key Responsibilities:Develop and maintain ETL notebooks using PySparkDesign and implement data models using...
-
Software Development Engineer | Databricks
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAt Databricks, we're building a platform that enables data teams to solve the world's most complex problems. We're passionate about empowering our customers to achieve breakthroughs in fields like transportation, medicine, and more. As a Senior Software Engineer, you'll contribute to the development of scalable, high-performance services and client libraries...
-
Bengaluru, Karnataka, India L&T Technology Services Full timeAbout the RoleWe are seeking a highly skilled Data Engineer with expertise in Databricks and Azure cloud to join our team at L&T Technology Services. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks and Azure services.With 5+ years of experience in...
-
Azure Databricks Along with Python
1 month ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeInviting Applications for Azure Databricks along with Python Job Title: Azure Databricks along with Python Experience Required: 4 to 10 Years Location: Bangalore - Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark - Proficient with...
-
Azure Databricks Developer
4 weeks ago
Bengaluru, Karnataka, India Mazenet solution Full timeCompany OverviewMazenet solution is a prominent IT service provider with a global presence and a strong team of experts. Our company is headquartered in Chennai, India, and offers innovative solutions in various IT domains.Job OverviewWe are seeking a highly skilled Azure Databricks Developer to join our dynamic team. This is a mid-level, full-time position...
-
Azure Databricks Lead
3 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the roleAs a Lead for Azure Databricks, you will be responsible for building ETL / data warehouse transformation processes and data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).Key Responsibilities:Developing complex U-SQL, Spark (Scala or Python) solutionsEvaluating the performance and applicability of multiple tools...
-
Staff Software Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAbout the Role:We are seeking a highly skilled Software Architect to join our team at Databricks in Bengaluru, India. As a key member of our engineering team, you will design and develop critical components of our products, including Databricks' resource admission control and usage governance infrastructure.Key Responsibilities:Design and manage Money...
-
Azure Databricks Data Engineer
3 weeks ago
Bengaluru, Karnataka, India JRD Systems Full time**Key Responsibilities:**As an ETL Automation Specialist at JRD Systems, you will be responsible for creating test automation using an existing data automation framework to validate business rules for audience creation across multiple social media channels.The ideal candidate will have experience in Azure Databricks, building automation tests using...
-
Azure Databricks Lead/Architect
3 weeks ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...
-
Azure Databricks Lead/Architect
2 weeks ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure...
-
Senior Distributed Computing Engineer
1 month ago
Bengaluru, Karnataka, India Databricks Full timeAt Databricks, we empower data teams to tackle complex challenges and drive innovation. As a Backline Technical Solutions Engineer, you will play a critical role in ensuring our customers' success with the Databricks platform.Key Responsibilities:Troubleshoot and resolve complex customer issues related to the Databricks Platform by analyzing core component...