Databricks Developer

6 days ago

Pune, Maharashtra, India Luxoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year
  • Project description
  • You will be working in a global team that manages and performs a global technical control.

    You'll be joining Assets Management team which is looking after asset management data foundation and operates a set of in-house developed tooling.

    As an IT engineer you'll play an important role in ensuring the development methodology is followed, and lead technical design discussions with the architects. Our culture centers around partnership with our businesses, transparency, accountability and empowerment, and passion for the future.
  • Responsibilities
  • Design, build, and manage data pipelines using Azure Data Integration Services (Azure DataBricks, ADF, Azure Functions.)
  • Collaborate closely with the security team to develop robust data solutions that support our security initiatives.
  • Implement, monitor, and optimize data processes, ensuring adherence to security and data governance best practices.
  • Troubleshoot and resolve data-related issues, ensuring data quality and accessibility.
  • Develop strategies for data acquisitions and integration of the new data into our existing architecture.
  • Document procedures and workflows associated with data pipelines, contributing to best practices.
  • Share knowledge about latest Azure Data Integration Services trends and techniques.
  • Implement and manage CI/CD pipelines to automate data and UI testcases and integrate testing with development pipelines.
  • Implement and manage CI/CD pipelines to automate development and integrate test pipelines.
  • Conduct regular reviews of the system, identify possible security risks, and implement preventive measures.
  • Skills
  • Must have
  • Excellent command of English
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
  • 5+ years of experience in data integration and pipeline development using Azure Data Integration Services including Azure Data Factory and
  • Azure Databricks.
  • Hands-on with
  • Python and Spark (Pyspark)
  • Delta tables
  • Unity Catalog
  • Parquet
  • Strong understanding of security principles in the context of data integration and DevSecOps
  • Proven experience with SQL and other data query languages.
  • Ability to write, debug, and optimize data transformations and datasets.
  • Extensive experience in designing and implementing ETL solutions using Azure Databricks, Azure Data Factory or similar technologies.
  • Familiar with automated testing frameworks using Squash
  • Nice to have
  • Data Architecture & Engineering: Design and implement efficient and scalable data warehousing solutions using Azure Databricks and Microsoft Fabric.
  • Business Intelligence & Data Visualization: Create insightful Power BI dashboards to help drive business decisions.

  • Azure Databricks Developer

    4 days ago

    Pune, Maharashtra, India Birlasoft Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Databricks Developer Birlasoft is hiring an Azure Databricks Developer to join our team. We are looking for candidates with 8 to 15 years of experience who possess strong communication skills and hands-on experience in the following areas: - Azure Databricks - Azure services - Data pipelines - Design and development - ETL/ELT...

  • Databricks

    6 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Our Client is where you will find unrivaled opportunities to succeed and realize your full potential.We are seeking highly skilled Databricks Data Engineers to join...

  • Databricks Developer

    4 weeks ago

    Pune, Maharashtra, India, Maharashtra Vista Applied Solutions Group Inc Full time

    Job Summary:Client is looking for Databricks Developer and this is hybrid position from Pune.Responsibilities:Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief...

  • Databricks Engineer

    4 days ago

    Pune, Maharashtra, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Databricks Engineer

    6 hours ago

    Pune, Maharashtra, India Bitwise Solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Role: DataBricks EngineerNotice Period: Immediate joiners onlyLocation: PuneWork Mode: HybridPosition Overview:We need a skilled Databricks Data Engineer with strong analytical and troubleshooting abilities. The ideal candidate should have hands-on experience in building scalable data pipelines using PySpark on cloud platforms like Azure/AWS along with a...

  • Databricks Engineer

    6 hours ago

    Pune, Maharashtra, India Virtusa Full time ₹ 10,00,000 - ₹ 30,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Databricks Administrator

    2 weeks ago

    Pune, Maharashtra, India ITC Infotech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Role & responsibilitiesDatabricks AdministratorLocation : Pune (3 days WFO, but will change based on the business need)Shift timings : Night shift (6.30PM IST to 2.30AM IST / it will get shift by 1hr in day light saving)Position : 2Notice period : Immediate joiner or less than 30daysExperience: (Overall 5 to 7 yrs)Must Have Skills:Must Have Skills: 2 to 4...

  • Databricks Engineer

    4 days ago

    Pune, Maharashtra, India Peoplefy Infosolutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Must have skills:Hands-on experience with Databricks platform, including Delta Lake/ Lakehouse architecturePerson should be familiar with Python / Pyspark code (not needed a developer)Knowledge of data structures, data modeling, ETL/ELT, and data warehousing.SQL basic in data querying and troubleshooting / manipulation.Key asks for the role:We need a...

  • Databricks Engineer

    4 days ago

    Pune, Maharashtra, India InfoCepts Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks Engineer

    4 days ago

    Pune, Maharashtra, India Persistent Systems Full time ₹ 12,00,000 - ₹ 20,00,000 per year

    About Position:We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks.Role: Databricks EngineerLocation: Pune & MumbaiExperience: 8 to 12 YearsJob Type: Full Time EmploymentWhat You'll Do:3+ years of experience in data engineering or analytics roles.Strong hands-on experience with Databricks and Apache...