Azure Databricks Engineer

2 months ago


Pune, India Coders Brain Pvt Ltd Full time

Primary Skills : Databricks with Pyspark/Spark/ Python and SQL


Secondary skills : ADF


Job Overview :


- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.

- 4+ years of work experience with very large data warehousing environment

- 4+ years of work experience in Databricks, Pyspark and Python project development work

- Expertise in Bigdata Eco systems like HDFS and Spark

- Strong hands-on experience on Python or Scala.

- Hands on experience on Azure Data Factory.

- Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.

- Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.

- SQL SERVER development work experience with relational databases and knowledge is a must

- Development of Stored Procedures for transformations in ETL pipeline

- Should have work experience in Agile projects

- Write and maintain documentation of the ETL processes via process flow diagrams.

- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse

- Good experience on customer interaction is required.

- Possesses good interpersonal and communication skills.

(ref:hirist.tech)
  • Azure Databrick

    4 weeks ago


    Pune, India Braincranx IT solutions Full time

    **Job description** - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL,...

  • Azure Databricks

    1 month ago


    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required5 - 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia

  • Azure Databricks

    1 month ago


    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India


  • Pune, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services and products provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400...

  • Azure Data Engineer

    2 months ago


    Hyderabad,Pune, India Recruitment Agency Full time

    We are looking for Azure Data Engineer/ Azure Databricks.Experience : 6+ years Notice period : Immediate Requirements : - Strong proficiency in Python programming language with a focus on data processing and analytics.- In-depth experience with Azure Databricks, including cluster management, job execution, and notebook workflows.- Knowledge of big data...

  • Azure Databricks

    1 month ago


    Pune, India CGI Group, Inc. Full time

    **Position Description**: Working on Azure Technologies -> Azure Databricks(primary req), Azure Datafactory, PowerBI, ADLS - Good to have knowledge on Datastage & Microstrategy because it is the main tool that is used in the team. Although the focus will be on Azure technologies - Relevant Exp in Azure atleast 2 years. **Your future duties and...

  • Data Engineer

    2 months ago


    Pune,Hyderabad, India HuQuo Full time

    Must-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...

  • Azure Databricks

    2 months ago


    pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Data Engineer

    4 weeks ago


    Pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining...

  • Data Engineer

    4 weeks ago


    Pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and...

  • Data Engineer

    3 weeks ago


    pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and...


  • Pune, India manogna it services private limited Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Azure Databricks

    1 month ago


    Pune, India Braincranx IT solutions Full time

    **Job description** Sr. Data Engineer (Spark / Pyspark & Azure Data Bricks) Skills - Data Engineering experience along with 2yrs Experience on Spark / Pyspark & Azure Data Bricks. Roles and Responsibilities Minimum 4+ years of Data Engineering experience. Experience as Data Engineer in PySpark/ Spark with Azure Dataricks Stream Analytics Experience with...

  • Databricks Engineer

    2 weeks ago


    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    2 weeks ago


    pune, India Celebal Technologies Full time

    Job Description: Databricks Engineer Position: Databricks Engineer Experience Required: 3 to 8 years overall experience in Data engineering on Databricks Location: Pune and Noida Job Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...

  • Databricks Engineer

    2 weeks ago


    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    2 weeks ago


    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition:Databricks EngineerExperience Required:3 to 8 years overall experience in Data engineering on DatabricksLocation:Pune and NoidaJob Summary:The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets using...


  • Pune/Bangalore/Hyderabad, India Advitha Tech Solutions Full time

    Job Description : - Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Data Engineer

    4 weeks ago


    Pune/Hyderabad/Remote, India HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data...


  • Hyderabad/Pune/Bangalore, India manogna it services private limited Full time

    Job Description : - Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience...