Azure Databricks Engineer

2 months ago


Bengaluru, India Bosch Full time
Job Description

The Azure Databricks Data Engineer will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks. You will be responsible for developing and managing data pipelines, ensuring data quality, and enabling advanced analytics capabilities by building standardized Data Models. Your role will involve close collaboration with data scientists, analysts, and other stakeholders to deliver data-driven solutions that support the strategic goals of Bosch.

Responsibilities

Collaborate with internal Bosch team in the design, construction, installation, tests, and maintenance of highly scalable data management systems using Azure Databricks.

Develop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks utilities.

Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.

Ensure optimal performance of data processing and extraction, transformation, and loading (ETL) processes.

Collaborate with data architects to implement effective data models and schemas within the Databricks environment.

Monitor data reliability, efficiency, and quality, and implement improvements as needed.

Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.

Develop and maintain documentation related to data pipeline architecture, development processes, and data governance.

Stay current with industry trends and developments in cloud computing, big data, and Azure Databricks.

The following attributes are a plus:

Experience with machine learning frameworks and libraries.

Knowledge of additional big data tools and platforms.

Familiarity with data visualization tools and techniques. Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or proved experience in a similar field.

Proven experience as a Data Engineer with a focus on Azure Databricks and related Azure services.

Strong programming skills in languages such as Python, Scala, or Java.

Experience with Apache Spark and its integration with Databricks.

Proficiency in SQL and experience with data modeling and data warehousing concepts.

Familiarity with DevOps practices and CI/CD pipelines.

Excellent analytical and problem-solving abilities.

Effective communication skills in English and Portuguese and the ability to work collaboratively in a team environment.

Qualifications

Bachelor of Engineering / Computer science

Additional Information

7-9



  • Bengaluru, Karnataka, India Databricks Full time

    Role OverviewAt Databricks, we empower data teams to drive innovation by building and running the world's best data and AI infrastructure platform. We are seeking a highly skilled Backline Technical Solutions Engineer to join our team.Key ResponsibilitiesTroubleshoot and resolve complex customer issues related to the Databricks Platform by analyzing core...


  • Bengaluru, India Mazenet solution Full time

    Company OverviewMazenet solution is a prominent player in the IT service industry with a workforce of 201-500 employees. Our company, headquartered in Chennai, provides innovative solutions in various IT domains. With a strong presence in the market, Mazenet solution is dedicated to delivering high-quality services and fostering a positive workplace for our...


  • Bengaluru, India KrtrimaIQ Cognitive Solutions Full time

    Job Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our...

  • Azure Databricks

    1 month ago


    Bengaluru, India Ahvi Infotech Full time

    About the job Azure DatabricksPosition: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadEssential experience:Experience in building ETL / data warehouse transformation processes Direct...


  • Bengaluru, India krtrimaIQ Cognitive Solutions Full time

    Job Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our clients....


  • Bengaluru, Karnataka, India Databricks Full time

    We are passionate about empowering data teams to solve complex problems. Our mission is to build and run the world's best data and AI infrastructure platform, enabling customers to make data-driven decisions that improve their business.As a Staff Software Engineer at Databricks, you will work on building and scaling our services and infrastructure across...

  • Azure Databricks

    2 weeks ago


    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job Azure Databricks**: **Position**: Lead - Azure Databricks **Overall IT experience**:8 to 13 years **Primary Skills**:Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse **Secondary Skills**:U-SQL, Spark, Scala, Python **Work Location**:Bengaluru, Hyderabad **Notice Period**:0 to 30 Days **Essential experience**: Experience...

  • Azure Databricks

    1 month ago


    Bengaluru, India PradeepIT Consulting Services Pvt Ltd Full time

    Position: Lead - Azure Databricks Overall IT experience: 8 to 13 years Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, Python Work Location: Bengaluru, Hyderabad Notice Period: 0 to 30 Days Essential experience: Experience in building ETL / data warehouse transformation processes...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India FreeBirds Technology Pvt Ltd Full time

    **Job Title:** Data Engineer - Azure Databricks SpecialistAbout the Role:We are seeking an experienced Data Engineer to join our team as a Databricks Specialist. The successful candidate will be responsible for designing and implementing data pipelines on Azure Databricks.Key Responsibilities:Design and develop data pipelines using Azure...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Azure Databricks Data Engineer RoleTata Consultancy Services is seeking a skilled Data Engineer to join our team and work on Azure Databricks development. The ideal candidate will have experience with Python, PySpark, and ETL notebook development.Key Responsibilities:Develop and maintain ETL notebooks using PySparkDesign and implement data models using...


  • Bengaluru, Karnataka, India Databricks Full time

    At Databricks, we're building a platform that enables data teams to solve the world's most complex problems. We're passionate about empowering our customers to achieve breakthroughs in fields like transportation, medicine, and more. As a Senior Software Engineer, you'll contribute to the development of scalable, high-performance services and client libraries...


  • Bengaluru, Karnataka, India L&T Technology Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer with expertise in Databricks and Azure cloud to join our team at L&T Technology Services. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks and Azure services.With 5+ years of experience in...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Inviting Applications for Azure Databricks along with Python Job Title: Azure Databricks along with Python Experience Required: 4 to 10 Years Location: Bangalore - Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark - Proficient with...


  • Bengaluru, Karnataka, India Mazenet solution Full time

    Company OverviewMazenet solution is a prominent IT service provider with a global presence and a strong team of experts. Our company is headquartered in Chennai, India, and offers innovative solutions in various IT domains.Job OverviewWe are seeking a highly skilled Azure Databricks Developer to join our dynamic team. This is a mid-level, full-time position...

  • Azure Databricks Lead

    3 weeks ago


    Bengaluru, Karnataka, India Ahvi Infotech Full time

    About the roleAs a Lead for Azure Databricks, you will be responsible for building ETL / data warehouse transformation processes and data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).Key Responsibilities:Developing complex U-SQL, Spark (Scala or Python) solutionsEvaluating the performance and applicability of multiple tools...


  • Bengaluru, Karnataka, India Databricks Full time

    About the Role:We are seeking a highly skilled Software Architect to join our team at Databricks in Bengaluru, India. As a key member of our engineering team, you will design and develop critical components of our products, including Databricks' resource admission control and usage governance infrastructure.Key Responsibilities:Design and manage Money...


  • Bengaluru, Karnataka, India JRD Systems Full time

    **Key Responsibilities:**As an ETL Automation Specialist at JRD Systems, you will be responsible for creating test automation using an existing data automation framework to validate business rules for audience creation across multiple social media channels.The ideal candidate will have experience in Azure Databricks, building automation tests using...


  • Bengaluru, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...


  • Bengaluru, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure...


  • Bengaluru, Karnataka, India Databricks Full time

    At Databricks, we empower data teams to tackle complex challenges and drive innovation. As a Backline Technical Solutions Engineer, you will play a critical role in ensuring our customers' success with the Databricks platform.Key Responsibilities:Troubleshoot and resolve complex customer issues related to the Databricks Platform by analyzing core component...