DataBricks Engineer

1 week ago

Pune, India Persistent Systems Full time
About Position

PSL is looking for Data engineer who will be responsible for creating and maintaining data pipeline architecture, assembling complex data sets, optimizing data delivery, building infrastructure, supporting analytics tools, and collaborating with stakeholders to improve data-related processes and functionality.

Role : Data EngineerLocation : Pune/MumbaiExperience : 5-9 yearsJob Type : FTE

What You'll Do

A Data Engineer you will be responsible for creating and maintaining data pipeline architecture, assembling complex data sets, optimizing data delivery, building infrastructure, supporting analytics tools, and collaborating with stakeholders to improve data-related processes and functionality.Key Responsibilities:Create and maintain optimal data pipeline architecture to support data orchestration. Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build the infrastructure required for optimal extraction, transformation, and ingestion of data from a wide variety of data sources using SQL, ETL and Spark/Databricks technologies.Support analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics. Work with stakeholders including the Executive, Product, Data and Technology teams to assist with data-related technical issues and support their data infrastructure needs. Create data tools for analytics and data scientist team members that assist them in executing and optimizing data projects. Work with data and analytics experts to strive for greater functionality in our data systems.Key Skills:Microsoft Certified Preferred (DP-203, DP-300, DP-500, DP-900, MB-260, etc.) SQLPythonEducation and Experience: 1-3 years of relevant experience required BA/BS in relevant discipline required

Expertise You'll Bring

6+ years of experience in data engineering or a related field Strong hands-on experience with DataBricks, including development of code, pipelines, and data transformations.Proficient in at least one programming language (e.g., Python, Scala, Java).In-depth knowledge of Apache Spark and its integration within DataBricks Experience with cloud services (AWS, Azure, or GCP) and their data-related products.Familiarity with CI/CD practices, version control (Git), and automated testing. Excellent problem-solving skills and the ability to work independently or as part of a team.

Benefits

Competitive salary and benefits packageCulture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certificationsOpportunity to work with cutting-edge technologiesEmployee engagement initiatives such as project parties, flexible work hours, and Long Service awardsAnnual health check-upsInsurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Our company fosters a values-driven and people-centric work environment that enables our employees to:

Accelerate growth, both professionally and personallyImpact the world in powerful, positive ways, using the latest technologiesEnjoy collaborative innovation, with diversity and work-life wellbeing at the coreUnlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

  • Databricks Engineer

    3 weeks ago

    pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...

  • Databricks Engineer

    3 weeks ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    3 weeks ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks Engineer Position: Databricks Engineer Experience Required: 3 to 8 years overall experience in Data engineering on Databricks Location: Pune and Noida Job Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...

  • Databricks Engineer

    4 weeks ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    1 month ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    1 month ago

    pune, India Celebal Technologies Full time

    Job Description: Databricks Engineer Position: Databricks Engineer Experience Required: 3 to 8 years overall experience in Data engineering on Databricks Location: Pune and Noida Job Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...

  • Databricks Engineer

    1 month ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Celebal Technologies Full time

    Job Description: Databricks Engineer Position: Databricks Engineer Experience Required: 3 to 8 years overall experience in Data engineering on Databricks Location: Pune and Noida Job Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...

  • Databricks Engineer

    1 month ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition:Databricks EngineerExperience Required:3 to 8 years overall experience in Data engineering on DatabricksLocation:Pune and NoidaJob Summary:The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets using...

  • Databricks Engineer

    1 month ago

    Pune, India Prometheus Consulting Full time

    Role : Databricks Engineer.Experience Required : 6 To 10 years.Location : Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQLAbout the Role :Are you a passionate Databricks engineer looking to join a top MNC and revolutionize the way data is processed and analyzed? We are searching for a talented individual to design,...

  • Databricks Admin

    2 months ago

    Pune, Maharashtra, India Arting Digital Private Limited Full time

    Job Title: - Databricks Admin Experience: - 4+yr Location: - Remote Budget: - 12-15 lpa Education: - Any Primary skills: - Databricks Administrator,Apache Spark, Databricks architectur, cloud platforms, such as AWS, Azure, or Google Cloud **Requirements**: - Proven experience as a Databricks Administrator or in a similar role. - Strong knowledge...

  • Databricks Admin

    3 days ago

    Pune, Maharashtra, India Arting Digital Private Limited Full time

    Job Title: - Databricks Admin Experience: - 4+yr Location: - Remote Budget: - 12-15 lpa Education: - Any Primary skills: - Databricks Administrator,Apache Spark, Databricks architectur, cloud platforms, such as AWS, Azure, or Google Cloud **Requirements**: - Proven experience as a Databricks Administrator or in a similar role. - Strong knowledge...

  • Databricks ML Ops Engineer

    2 weeks ago

    Pune, India KPI Partners Full time

    Databricks Platform with Unity Catalog AdministratorResponsibilities:Manage and administer the Databricks platform, including the Unity Catalog, to support data engineering and data science workflows.Collaborate with data engineers and data scientists to understand their requirements and configure the Databricks platform accordingly.Create and manage...

  • Data Engineer

    2 months ago

    Pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining...

  • Data Engineer

    2 months ago

    pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and...

  • Data Engineer

    2 months ago

    Pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and...

  • Data Engineer

    2 months ago

    Pune, Maharashtra, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining...

  • Data Engineer

    3 weeks ago

    pune, India EDGESOFT Full time

    Job Description : The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Data Engineer

    4 weeks ago

    Pune, India EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Data Engineer

    3 weeks ago

    Pune, India EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...