Azure Databricks Engineer

1 month ago


HyderabadPune, IN Coders Brain Pvt Ltd Full time

Primary Skills : Databricks with Pyspark/Spark/ Python and SQL


Secondary skills : ADF


Job Overview :


- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.

- 4+ years of work experience with very large data warehousing environment

- 4+ years of work experience in Databricks, Pyspark and Python project development work

- Expertise in Bigdata Eco systems like HDFS and Spark

- Strong hands-on experience on Python or Scala.

- Hands on experience on Azure Data Factory.

- Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.

- Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.

- SQL SERVER development work experience with relational databases and knowledge is a must

- Development of Stored Procedures for transformations in ETL pipeline

- Should have work experience in Agile projects

- Write and maintain documentation of the ETL processes via process flow diagrams.

- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse

- Good experience on customer interaction is required.

- Possesses good interpersonal and communication skills.

(ref:hirist.tech)
  • Data Engineer

    17 hours ago


    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Data Engineer

    2 days ago


    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...


  • Pune/Bangalore/Hyderabad, IN Advitha Tech Solutions Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...


  • Pune/Bangalore/Hyderabad, IN Advitha Tech Solutions Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Data Engineer

    1 month ago


    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...

  • Data Engineer

    17 hours ago


    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...


  • Hyderabad/Pune/Bangalore, IN manogna it services private limited Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...


  • Hyderabad/Pune/Bangalore, IN manogna it services private limited Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...


  • Pune/Hyderabad, IN RapidBraiins Full time

    No. of openings - 10+Primary Skill : SQL, Azure DatabricksSecondary Skills : PySpark, Azure Data FactoryResponsibilities : As an Azure Data Engineer, your day-to-day work activities will be as follows : - Design & develop the ETL- Good experience in writing SQL, Python and PySpark programming- Create the Pipelines (simple and complex) using ADF.- Work with...


  • Pune/Hyderabad, IN RapidBraiins Full time

    No. of openings - 10+Primary Skill : SQL, Azure DatabricksSecondary Skills : PySpark, Azure Data FactoryResponsibilities : As an Azure Data Engineer, your day-to-day work activities will be as follows : - Design & develop the ETL- Good experience in writing SQL, Python and PySpark programming- Create the Pipelines (simple and complex) using ADF.- Work with...

  • Database Administrator

    17 hours ago


    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring database administrators for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India.Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business...


  • Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring database administrators for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India.Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business...

  • Senior Data Engineer

    1 month ago


    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...


  • Mumbai/Pune/Bangalore, IN RapidBraiins Full time

    Overview:- We are seeking a talented Azure Synapse Developer to join our dynamic team.- The ideal candidate will have a strong background in data engineering and analytics, with a focus on Microsoft Azure Synapse Analytics.- As an Azure Synapse Developer, you will play a critical role in designing, developing, and maintaining our data pipelines and analytics...


  • Mumbai/Pune/Bangalore, IN RapidBraiins Full time

    Overview:- We are seeking a talented Azure Synapse Developer to join our dynamic team.- The ideal candidate will have a strong background in data engineering and analytics, with a focus on Microsoft Azure Synapse Analytics.- As an Azure Synapse Developer, you will play a critical role in designing, developing, and maintaining our data pipelines and analytics...

  • Azure Data Architect

    3 weeks ago


    Bangalore/Chennai/Hyderabad/Mumbai/Pune/Noida, IN ACZ Global Private Limited Full time

    Azure Data ArchitectMandatory Skills : Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description :We are seeking a highly skilled and experienced Azure Data Architect to join our team. As an Azure Data Architect, you will play a key role in designing and implementing data solutions on the Microsoft Azure platform. The ideal...

  • Data Engineer

    1 month ago


    Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full time

    Responsibilities:- Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake.- Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API configurations, and backend architecture.- Extract, transform, and load (ETL) data...

  • Data Engineer

    17 hours ago


    Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full time

    Responsibilities:- Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake.- Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API configurations, and backend architecture.- Extract, transform, and load (ETL) data...

  • Databricks Engineer

    5 days ago


    Bangalore/Hyderabad/Pune, IN Prometheus Consulting Full time

    Role : Databricks Engineer.Experience Required : 6 To 10 years.Location : Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQLAbout the Role :Are you a passionate Databricks engineer looking to join a top MNC and revolutionize the way data is processed and analyzed? We are searching for a talented individual to design,...

  • Databricks Engineer

    17 hours ago


    Bangalore/Hyderabad/Pune, IN Prometheus Consulting Full time

    Role : Databricks Engineer.Experience Required : 6 To 10 years.Location : Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQLAbout the Role :Are you a passionate Databricks engineer looking to join a top MNC and revolutionize the way data is processed and analyzed? We are searching for a talented individual to design,...