Azure Databricks Engineer

3 weeks ago


PuneHyderabad, IN RapidBraiins Full time

No. of openings - 10+

Primary Skill : SQL, Azure Databricks

Secondary Skills : PySpark, Azure Data Factory

Responsibilities :

As an Azure Data Engineer, your day-to-day work activities will be as follows :

- Design & develop the ETL

- Good experience in writing SQL, Python and PySpark programming

- Create the Pipelines (simple and complex) using ADF.

- Work with other Azure stack modules like Azure Data Lakes, SQL DW

- Must be extremely well versed with handling large volume of data.

- Understand the business requirements for Data flow process needs.

- Understand requirements, functional and technical specification documents.

- Development of mapping document and transformation business rules as per scope and requirements/Source to target.

- Responsible for continuous formal and informal communication on project status

- Good understanding of JIRA stories process for SQL development activities

Requirements :

Educational qualifications : Bachelor's/Master's

Candidates are required to have these mandatory skills :

- Overall, 6+ years of developer skills with SQL, Python with Spark (PySpark)

- Experience in Azure Data Factory, Data Sets, Data Frame, Azure Blob & Storage Explorer

- Implement data ingestion pipelines from multiple data sources using ADF, ADB (Azure data bricks)

- Experience in creating Data Factory Pipelines, custom Azure development, deployment, troubleshoot data load / extraction using ADF.

- Extensive experience on SQL, python, PySpark in Azure Databricks

- Able to write Python code in PySpark frame by using Dataframes

- Have good understanding on Agile/Scrum methodologies.

Location : Pune/Hyderabad

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Databricks Engineer

    2 weeks ago


    Pune/Hyderabad/Indore/Ahmedabad/Gurgaon/Gurugram, IN Arting Digital Full time

    Job Title : Databricks Engineer Experience : 7+yrLocation : Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode : OnsiteQualification : B.TECH, M.tech, MCASkills : Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements :- Bachelor's degree in computer science or related field. - 7+ years of IT experience,...


  • Pune/Bangalore/Hyderabad, IN Advitha Tech Solutions Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...


  • Pune/Bangalore/Hyderabad, IN Advitha Tech Solutions Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Data Engineer

    3 weeks ago


    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...

  • Data Engineer

    2 months ago


    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...


  • Hyderabad/Pune/Bangalore, IN manogna it services private limited Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...


  • Hyderabad/Pune/Bangalore, IN manogna it services private limited Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Database Administrator

    2 months ago


    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring database administrators for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India.Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business...


  • Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring database administrators for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India.Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business...

  • Senior Data Engineer

    2 months ago


    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...


  • Hyderabad/Pune, IN Coders Brain Pvt Ltd Full time

    Primary Skills : Databricks with Pyspark/Spark/ Python and SQLSecondary skills : ADFJob Overview :- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.- 4+ years of work experience with very large data warehousing environment- 4+ years of work experience in Databricks, Pyspark and...

  • Azure Data Engineer

    3 weeks ago


    Pune/Bangalore/Chennai, IN Growel Softech Pvt. Ltd. Full time

    Job Title : Azure Data EngineerLocations : Pune, Bangalore, ChennaiExperience Required : 4 - 10 yearsJob Description :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering with hands-on experience in designing and implementing data solutions using Microsoft Azure....


  • Vishakhapatnam/Vizag/Bangalore/Hyderabad, IN Datafoundry Full time

    About Datafoundry AI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and...


  • Mumbai/Pune/Bangalore, IN RapidBraiins Full time

    Overview:- We are seeking a talented Azure Synapse Developer to join our dynamic team.- The ideal candidate will have a strong background in data engineering and analytics, with a focus on Microsoft Azure Synapse Analytics.- As an Azure Synapse Developer, you will play a critical role in designing, developing, and maintaining our data pipelines and analytics...


  • Mumbai/Pune/Bangalore, IN RapidBraiins Full time

    Overview:- We are seeking a talented Azure Synapse Developer to join our dynamic team.- The ideal candidate will have a strong background in data engineering and analytics, with a focus on Microsoft Azure Synapse Analytics.- As an Azure Synapse Developer, you will play a critical role in designing, developing, and maintaining our data pipelines and analytics...

  • Azure Data Architect

    1 month ago


    Bangalore/Chennai/Hyderabad/Mumbai/Pune/Noida, IN ACZ Global Private Limited Full time

    Azure Data ArchitectMandatory Skills : Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description :We are seeking a highly skilled and experienced Azure Data Architect to join our team. As an Azure Data Architect, you will play a key role in designing and implementing data solutions on the Microsoft Azure platform. The ideal...

  • Data Engineer

    2 months ago


    Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full time

    Responsibilities:- Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake.- Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API configurations, and backend architecture.- Extract, transform, and load (ETL) data...

  • Data Engineer

    3 weeks ago


    Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full time

    Responsibilities:- Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake.- Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API configurations, and backend architecture.- Extract, transform, and load (ETL) data...