Data Bricks Developer

1 week ago

Pune, Maharashtra, India Tata Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Responsibilities:

  • Design, develop, and maintain data processing pipelines using Databricks on the Azure platform.
  • Collaborate with data engineers, data scientists, and other stakeholders to optimize workflows and ensure data quality.
  • Implement ETL processes to extract, transform, and load data from various sources.
  • Work with Spark SQL and Databricks notebooks to analyze and transform data.
  • Ensure efficient data flow across diverse systems.
  • Provide technical guidance to teams and anchor proof-of-concept projects.
  • Responsible to assemble large, complex sets of data that meet non-functional and functional business requirements.
  • Responsible to identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure, Databricks and SQL technologies
  • Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
  • Understanding of Cognos DB and Synapse.

Requirements:

  • Bachelors degree in computer science, Engineering, or related field.
  • 3 to 5 years of hands-on experience as a Databricks
  • Strong proficiency in Apache Spark and Databricks.
  • Strong knowledge on PySpark
  • Experience with Scala and/or Python programming languages.
  • Solid understanding of data warehousing concepts and ETL processes.
  • Familiarity with cloud platforms - Azure
  • Version control tools knowledge (e.g., Git).

  • Azure Data bricks

    2 weeks ago

    Pune, Maharashtra, India Cognizant Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks Unity Catalog Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. Experience in Data Management Hedge Fund Accounting and Account Management is a plus. This...

  • Cloud Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Expertise in designing and developing scalable data pipelines using Apache Airflow, Apache Spark, Azure Data Factory, and Databricks is essential for this role. The ideal candidate will have experience working with structured and unstructured data from diverse sources, including Azure Cosmos DB, Azure Data Lake, and Azure Synapse Analytics.This position...

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India Emergys Full time

    Experience: 5 to 7 years Location: Pune, Kothrud Job Description: Must Have : Proficiency in at least one of the following programming languages: Java/Scala/Python Good understanding of SQL Experience of development and deployment of at least one end-to-end data storage/processing pipeline Strong Experience in Spark development with batch and streaming ...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Emergys Full time

    Experience: 5 to 7 yearsLocation: Pune, KothrudJob Description:Must Have:Proficiency in at least one of the following programming languages: Java/Scala/PythonGood understanding of SQLExperience of development and deployment of at least one end-to-end data storage/processing pipelineStrong Experience in Spark development with batch and streaming Intermediate...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India TESTQ TECHNOLOGIES LTD Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Minimum QualificationBachelor's degree in Computer Science, Information Technology, or a related field. Master's degree is preferred.Minimum Experience5+ years of experience in Data Engineering.Extensive Knowledge of SQL, Azure Data Factory, Data Bricks, MS Synapse, Python, or other relevant Tools (Informatica, Data Services, etc.)Knowledge of developing...

  • Advanced Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time

    Senior Data Engineering ProfessionalWe are seeking a highly skilled and experienced data engineering professional to join our team. The ideal candidate will have a strong background in designing and implementing scalable data pipelines using Azure Data Bricks, as well as experience with ETL processes and data visualization tools.Key Responsibilities:Design...

  • Quick joiners-Microsoft Azure Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Quick joiners for Digital : Microsoft Azure Data Engineer.Experience: 5-8yearsLocation: PuneMust have: Fabric/ADF & SQL, Azure Data Fabric, PySpark, data bricks.

  • Quick joiners-Microsoft Azure Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Quick joiners for Digital : Microsoft Azure Data Engineer. Experience: 5-8years Location: Pune Must have: Fabric/ADF & SQL, Azure Data Fabric, PySpark, data bricks.

  • Azure Data Engineer

    3 weeks ago

    Pune, Maharashtra, India GC Technologies Pvt Ltd Full time

    Data Engineer Location: Pune -WFONP :15days Experience : 5+yrs Budget: Max 12 LPAPayroll: Prontoex Consulting Services Pvt Ltd End Clinet: Comsense Technologies Private Limited , 7th Floor Property bearing No.465/E1, Park Plaza, Indi Qube, CTS-1085, Ganeshkhind Rd, Shivajinagar, Pune, Maharashtra 411005 JD : Minimum Qualification Bachelor's degree in...

  • Azure Data QA Engineer

    1 week ago

    Pune, Maharashtra, India Weekday AI Full time

    This role is for one of Weekday's clientsMin Experience: 4 yearsLocation: Pune, BangaloreJobType: full-timeRequirementsWe are looking for a highly skilled Azure Data QA Engineer to join our team on a contractual basis (1 year). This role is based in Pune or Bangalore (Hybrid working), and we are seeking candidates who can join immediately or within a short...