Azure Databricks Engineer

3 weeks ago


Anywhere in IndiaMultiple Locations, IN Talent-Max Consultant Full time

Experience: 4-7 Years

Location : Bhilai, Indore, Bangalore

Job Description :

We are seeking a skilled DataBricks Engineer to join our team. In this role, you will be responsible for engineering reliable data pipelines for sourcing, processing, distributing, and storing data in various ways using cloud data platform infrastructure. Your primary focus will be on developing data engineering techniques to automate manual processes and solve complex business problems. Additionally, you will ensure the highest level of data quality and validation checks within enterprise data lakes.

Roles and Responsibilities :

- Design and engineer reliable data pipelines for sourcing, processing, distributing, and storing data using cloud data platform infrastructure.

- Develop data engineering techniques to automate manual processes and address challenging business problems.

- Implement and maintain data quality and validation checks within enterprise data lakes.

- Collaborate with cross-functional teams to understand data requirements and deliver calable solutions.

Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- 4+ years of experience working with Big Data Technologies such as Apache Spark, Kafka, and Data Lakes.

- 2+ years of experience with Databricks capabilities related to data engineering (Legacy Migration, Delta Lake, Pipeline modernization).

- Proficiency in writing code in either Python or Scala, with strong skills in SQL (stored procs & triggers, dynamic SQL, query optimization).

- Hands-on experience with at least one of the leading public cloud data platforms (Azure / AWS / GCP).

- Familiarity with data validation and quality frameworks, as well as data lineage frameworks.

- Preferred: Databricks Certified Data Engineer Associate/Professional Certification.

(ref:hirist.tech)
  • Vsquare Systems

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Vsquare Systems Pvt. Ltd. Full time

    Data Engineer (Azure Databricks)Job Title : Data Engineer (Azure Databricks). Location : Bangalore / Hybrid. Job Type : Full-time. Job Description : .- Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations,...

  • Lead MLOps Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations, IN Teksands.ai Full time

    Job Description :We are looking for Lead ML Ops Engineers with experience on Azure services like Databricks, ML, Dev Ops and who can support Development, Deployment, Model Management and Monitoring for different clients.Desired Skills and Qualifications :- 8+ of experience in understanding AI/ML projects and exposure to supporting the Model execution on...

  • Azure Data Lead

    1 week ago


    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...


  • Anywhere in India/Multiple Locations, IN Optivalue tek consulting Full time

    Key Responsibilities :- Work on client projects to deliver AWS, PySpark, Databricks based Data engineering & Analytics solutions. - Build and operate very large data warehouses or data lakes. - ETL optimization, designing, coding, & tuning big data processes using Apache Spark. - Build data pipelines & applications to stream and process datasets at low...

  • MLOps Engineer

    5 hours ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • ETL Developer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN HIC Global Solutions Full time

    ETL Developer Job Description :- Consultant/Sr Consultant - ETL Development - Azure (ADF and DataBricks)Job Location : Gurugram, HaryanaA successful candidate will have the following characteristics:- Responsible for design, development, and implementation of solutions to exchange data using the required ETL tool, Azure Data Factory and DataBricks.- At least...

  • Azure Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Live Connections Full time

    Azure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment.Key Responsibilities :- PySpark...

  • Azure Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...

  • Lead Data Engineer

    4 days ago


    Anywhere in India/Multiple Locations, IN Vista Full time

    About you :- Passionate about both Data Engineering and Machine Learning Engineering, you can likewise wear one or the other hat according to what you need to accomplish- Passionate about GenAI an excited to join a Team working on state of the art GenAI topics- Ideate and build data products that drive value for internal and external customers- Write quality...

  • Colan Infotech

    2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Colan Infotech Pvt Ltd Full time

    Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL.Job Description :Roles And Responsibilities :- Must have cloud knowledge in Azure- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python,...

  • Lead Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description :- Primary skills as Azure ADF, Databricks- Secondary skills as Snowflake and other data engineering technologies.- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing...


  • Anywhere in India/Multiple Locations/Hyderabad/Bangalore/Pune/Mumbai/Chennai, IN BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

    Position/Role : Azure data bricks with Pyspark/Spark/Python and SQLExperience : 6-12 yrsLocation : Hyderabad/Bangalore/Pune/Mumbai/Chennai (Hybrid)Job Overview :Primary Skills : Databricks with Pyspark/Spark/ Python and SQLSecondary skills : ADF Job Description :7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/...

  • Data Engineer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full time

    Notice Period : Immediate Joiner to 30 daysMandatory Skills : Azure Data Bricks, Azure Data Factory (ADF), PySpark, Data Flows, Azure DevOpsJob Description :We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have strong expertise in building and optimizing data pipelines and data sets using Azure Data Bricks,...


  • Anywhere in India/Multiple Locations, IN Dimiour Full time

    Responsibilities:- Design and implement optimal data pipeline architecture for scalable and reliable data processing.- Develop and maintain complex data pipelines to extract, transform, and load data from various sources, including Snowflake, utilizing SQL and Azure Big Data technologies (e.g., Data Factory, Databricks, Data Lake).- Collaborate with business...


  • Bangalore/Anywhere in India/Multiple Locations, IN Randstad India Full time

    Job Title : Azure Cosmos Data ArchitectureLocation : PAN IndiaExperience : 4-6years Job Description :Must have Skills : Azure Cosmos, Data Architecture, Azure Ecosystem, SQLGood to Have Skills : Apache Spark, Azure Databricks ,ADLS, Apache Kafka Technical Experience : Experience in Design/building solutions using cloud based architecture with scalable...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN TechFabric Full time

    Job Description :Candidate should have minimum 7Yrs working/hands-on experience in the below skills :- With proficiency in Azure services , ADF, Data bricks, Synapse Analytics and Azure Storage - Hands on experience in data modelling, batch and real time pipelines using Python Java or Java script and experience in Restful API - Experience in Devops and CI/CD...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...


  • Anywhere in India/Multiple Locations/Bangalore, IN Marktine Technology Solutions Full time

    Position : Azure Data Engineer. Experience : 6+ years. Location Remote. Skills: Snowflake, ADF, python and ETL, spark, scala, SQL.- An offshore Data Engineer to work with the Investment Analytics team.- This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and Python.- A strong candidate to work with the Data Science...

  • Azure Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Azure OPEN AI with Azure Security skills.Position : 1Location : RemoteExperience: 5+yrsPrimary Skills : Azure Open AI, Azure Security Responsibilities : Architect AI Solutions: Design end-to-end AI solutions that leverage Azure cloud services and OpenAI technologies to address complex business challenges and opportunities.Technical Leadership: Provide...


  • Anywhere in India/Multiple Locations, IN ASPIRE NXT PRIVATE LIMITED Full time

    Experience : 5 - 8 yrs Employment Type : Permanent with AspireNxtJob Title : Senior Azure Cloud Engineer The Cloud Engineer under moderate supervision is responsible for designing, developing, implementing, and supporting the recommended infrastructure. This involves analysing, configuring, testing, and implementing the infrastructure. This may also involve...