Databricks Developer

5 days ago

Pune, Maharashtra, India Luxoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year
  • Project description
  • You will be working in a global team that manages and performs a global technical control.

    You'll be joining Assets Management team which is looking after asset management data foundation and operates a set of in-house developed tooling.

    As an IT engineer you'll play an important role in ensuring the development methodology is followed, and lead technical design discussions with the architects. Our culture centers around partnership with our businesses, transparency, accountability and empowerment, and passion for the future.
  • Responsibilities
  • Design, build, and manage data pipelines using Azure Data Integration Services (Azure DataBricks, ADF, Azure Functions.)
  • Collaborate closely with the security team to develop robust data solutions that support our security initiatives.
  • Implement, monitor, and optimize data processes, ensuring adherence to security and data governance best practices.
  • Troubleshoot and resolve data-related issues, ensuring data quality and accessibility.
  • Develop strategies for data acquisitions and integration of the new data into our existing architecture.
  • Document procedures and workflows associated with data pipelines, contributing to best practices.
  • Share knowledge about latest Azure Data Integration Services trends and techniques.
  • Implement and manage CI/CD pipelines to automate data and UI testcases and integrate testing with development pipelines.
  • Implement and manage CI/CD pipelines to automate development and integrate test pipelines.
  • Conduct regular reviews of the system, identify possible security risks, and implement preventive measures.
  • Skills
  • Must have
  • Excellent command of English
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
  • 5+ years of experience in data integration and pipeline development using Azure Data Integration Services including Azure Data Factory and
  • Azure Databricks.
  • Hands-on with
  • Python and Spark (Pyspark)
  • Delta tables
  • Unity Catalog
  • Parquet
  • Strong understanding of security principles in the context of data integration and DevSecOps
  • Proven experience with SQL and other data query languages.
  • Ability to write, debug, and optimize data transformations and datasets.
  • Extensive experience in designing and implementing ETL solutions using Azure Databricks, Azure Data Factory or similar technologies.
  • Familiar with automated testing frameworks using Squash
  • Nice to have
  • Data Architecture & Engineering: Design and implement efficient and scalable data warehousing solutions using Azure Databricks and Microsoft Fabric.
  • Business Intelligence & Data Visualization: Create insightful Power BI dashboards to help drive business decisions.

  • Databricks Developer

    6 days ago

    Pune, Maharashtra, India Tata Technologies Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Dear Candidate,We at TATA Technologies looking for an experienced candidate for Databricks. Please check the below JD for more detailsJob Title : Databricks DeveloperTotal Exp:3-6 YearsLocation: PuneNotice Period: Immediate-30 DaysRole & responsibilitiesDesign and implement Databricks-based data architectures to meet business requirements.Develop and...

  • Databricks Engineer

    3 days ago

    Pune, Maharashtra, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • AI and Databricks

    2 weeks ago

    Pune, Maharashtra, India Quantum Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: AI and Databricks EngineerLocation: Pune/Nagpur :: WFODuration: FulltimeJob Description:Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.Hands-on experience with Databricks (Spark, Delta Lake, MLflow, Databricks Notebooks, Unity Catalog).Expertise in Python for building...

  • Databricks Administrator

    2 weeks ago

    Pune, Maharashtra, India ITC Infotech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Role & responsibilitiesDatabricks AdministratorLocation : Pune (3 days WFO, but will change based on the business need)Shift timings : Night shift (6.30PM IST to 2.30AM IST / it will get shift by 1hr in day light saving)Position : 2Notice period : Immediate joiner or less than 30daysExperience: (Overall 5 to 7 yrs)Must Have Skills:Must Have Skills: 2 to 4...

  • Databricks Engineer

    1 day ago

    Pune, Maharashtra, India Peoplefy Infosolutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Must have skills:Hands-on experience with Databricks platform, including Delta Lake/ Lakehouse architecturePerson should be familiar with Python / Pyspark code (not needed a developer)Knowledge of data structures, data modeling, ETL/ELT, and data warehousing.SQL basic in data querying and troubleshooting / manipulation.Key asks for the role:We need a...

  • Databricks Engineer

    3 days ago

    Pune, Maharashtra, India InfoCepts Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks Lead Developer

    3 days ago

    Pune, Maharashtra, India BRISKWIN IT SOLUTIONS Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Work Mode: 5 Days Work From OfficeShift: 12:30 PM – 9:30 PM ISTNotice Period: Immediate to 60 DaysExperience : 6-15yrsPrimary: Azure, Databricks, ADF, PySpark/PythonSecondary: Data WarehousingWhat You'll Bring10+ years of IT experience in Data Warehousing & ETL5+ years of hands-on Databricks experienceStrong foundation in cloud data engineering using...

  • Databricks Engineer

    3 days ago

    Pune, Maharashtra, India Persistent Systems Full time ₹ 12,00,000 - ₹ 20,00,000 per year

    About Position:We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks.Role: Databricks EngineerLocation: Pune & MumbaiExperience: 8 to 12 YearsJob Type: Full Time EmploymentWhat You'll Do:3+ years of experience in data engineering or analytics roles.Strong hands-on experience with Databricks and Apache...

  • Databricks Solution Architect

    3 days ago

    Pune, Maharashtra, India InspireXT Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionAbout InspireXT :InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks alliance...

  • Azure Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Savi Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Opening: Azure Databricks EngineerLocation: Pune, Maharashtra (Onsite)Experience Range: 5-6 YearsApply at: -Required Skills:Azure Data Factory (ADF)PySparkAzure Databricks (ADB)SQLJob Description:We're looking for an experienced Azure Databricks Engineer with a background in financial crime analytics and hands-on expertise in:Databricks engineering &...