Databricks Developer

5 days ago

Pune, Maharashtra, India Luxoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year
  • Project description
  • You will be working in a global team that manages and performs a global technical control.

    You'll be joining Assets Management team which is looking after asset management data foundation and operates a set of in-house developed tooling.

    As an IT engineer you'll play an important role in ensuring the development methodology is followed, and lead technical design discussions with the architects. Our culture centers around partnership with our businesses, transparency, accountability and empowerment, and passion for the future.
  • Responsibilities
  • Design, build, and manage data pipelines using Azure Data Integration Services (Azure DataBricks, ADF, Azure Functions.)
  • Collaborate closely with the security team to develop robust data solutions that support our security initiatives.
  • Implement, monitor, and optimize data processes, ensuring adherence to security and data governance best practices.
  • Troubleshoot and resolve data-related issues, ensuring data quality and accessibility.
  • Develop strategies for data acquisitions and integration of the new data into our existing architecture.
  • Document procedures and workflows associated with data pipelines, contributing to best practices.
  • Share knowledge about latest Azure Data Integration Services trends and techniques.
  • Implement and manage CI/CD pipelines to automate data and UI testcases and integrate testing with development pipelines.
  • Implement and manage CI/CD pipelines to automate development and integrate test pipelines.
  • Conduct regular reviews of the system, identify possible security risks, and implement preventive measures.
  • Skills
  • Must have
  • Excellent command of English
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
  • 5+ years of experience in data integration and pipeline development using Azure Data Integration Services including Azure Data Factory and
  • Azure Databricks.
  • Hands-on with
  • Python and Spark (Pyspark)
  • Delta tables
  • Unity Catalog
  • Parquet
  • Strong understanding of security principles in the context of data integration and DevSecOps
  • Proven experience with SQL and other data query languages.
  • Ability to write, debug, and optimize data transformations and datasets.
  • Extensive experience in designing and implementing ETL solutions using Azure Databricks, Azure Data Factory or similar technologies.
  • Familiar with automated testing frameworks using Squash
  • Nice to have
  • Data Architecture & Engineering: Design and implement efficient and scalable data warehousing solutions using Azure Databricks and Microsoft Fabric.
  • Business Intelligence & Data Visualization: Create insightful Power BI dashboards to help drive business decisions.

  • Databricks Developer

    2 days ago

    Pune, Maharashtra, India, Maharashtra Vista Applied Solutions Group Inc Full time

    Job Summary:Client is looking for Databricks Developer and this is hybrid position from Pune.Responsibilities:Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief...

  • Databricks Engineer

    3 days ago

    Pune, Maharashtra, India Peoplefy Infosolutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Must have skills:Hands-on experience with Databricks platform, including Delta Lake/ Lakehouse architecturePerson should be familiar with Python / Pyspark code (not needed a developer)Knowledge of data structures, data modeling, ETL/ELT, and data warehousing.SQL basic in data querying and troubleshooting / manipulation.Key asks for the role:We need a...

  • Databricks Engineer

    3 days ago

    Pune, Maharashtra, India InfoCepts Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks Engineer

    3 days ago

    Pune, Maharashtra, India Persistent Systems Full time ₹ 12,00,000 - ₹ 20,00,000 per year

    About Position:We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks.Role: Databricks EngineerLocation: Pune & MumbaiExperience: 8 to 12 YearsJob Type: Full Time EmploymentWhat You'll Do:3+ years of experience in data engineering or analytics roles.Strong hands-on experience with Databricks and Apache...

  • Databricks Solution Architect

    2 weeks ago

    Pune, Maharashtra, India InspireXT Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    About InspireXTInspireXT is on a mission to build the most trusted supply chains in the world. Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks alliance and building...

  • Databricks Solution Architect

    2 weeks ago

    Pune, Maharashtra, India InspireXT Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description :About InspireXT : InspireXT is on a mission to build the most trusted supply chains in the world. Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail. We are investing significantly in our...

  • Databricks Solution Architect

    3 days ago

    Pune, Maharashtra, India InspireXT Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionAbout InspireXT :InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail.We are investing significantly in our Databricks alliance...

  • Data Engineer- Databricks

    3 days ago

    Pune, Maharashtra, India InfoCepts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks Engineer

    3 days ago

    Pune, Maharashtra, India Dhruv Global It Solutions Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Responsibilities:* Develop ETL processes using Python, PySpark, SQL & Scala.* Optimize database performance through data modeling & query optimization.* Design & implement data pipelines on Databricks platform.Office cab/shuttle

  • Microsoft Azure Databricks

    2 weeks ago

    Pune, Maharashtra, India Venpa Staffing Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    Summary:As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the solutions align with business objectives. You will also engage in testing and...