Azure Databricks Pyspark Developer

1 month ago


Bengaluru, India Tredence Inc. Full time

MUST HAVE

• Minimum of 4 to 8 years of Azure DE experience.

• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.

• Experience in collaborating with business stakeholders to identify and meet data requirements

• Experience in using Azure services and tools to ingest, egress, and transform data from multiple sources

• Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration and data management • Implemented batch & near real time data ingestion pipelines

• Experience in working on Event-driven cloud platform for cloud services and apps, Data integration for building and managing pipeline, Data warehouse running on serverless infrastructure, Workflow orchestration using Azure Cloud Data Engineering components Databricks, Synapse, etc.

• Excellent written and oral communication skills


GOOD TO HAVE

• Proven ability to work with large cross functional teams with good communication skills.

• Experience on Cloud migration methodologies and processes

• Azure Certified Data Engineer

• Exposure to Azure Dev ops and Github

• Ability to drive customer calls independently

• Ability to take ownership and work with team


  • ETL Data Engineer

    4 weeks ago


    Bengaluru, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...


  • Greater Bengaluru Area, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes"Location - BangaloreCTC - Upto 24 LPAExperience - 5+ YrsMandatory Skill - Azure, Databricks, PysparkGood to Have - Kubernetes

  • Data Engineer

    2 months ago


    Bengaluru, India Career Soft Solutions Full time

    Job Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...

  • Azure Databricks

    2 months ago


    Bengaluru, India CIEL HR Services Full time

    Work experience-Above 6 years Notice period-Immediate to 15 days Work Mode-Hybrid Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremonies Expertise in Azure Data Bricks, ADF,...

  • Data Engineer

    2 weeks ago


    Bengaluru, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer.Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage experience...

  • Azure Data Engineer

    1 week ago


    Bengaluru, India Manvision Technologies Full time

    PySpark Development experience, especially in Spark SQL and Complex TransformationsPython development experienceExperience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure DatabasesAzure SkillsMust have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL DatabasesAzure DevOpsAzure AD Integration, Service...


  • Bengaluru, India Tredence Inc. Full time

    MUST HAVE • Minimum of 4 to 8 years of Azure DE experience. • In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc. • Experience in collaborating with business stakeholders to identify and meet data requirements • Experience in using Azure services and tools to ingest, egress, and transform data...


  • Bengaluru, India Tredence Inc. Full time

    MUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...


  • Bengaluru, India Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...

  • Data Scientist

    4 weeks ago


    Bengaluru, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • Colan Infotech

    4 weeks ago


    Bengaluru, India Colan Infotech Pvt Ltd Full time

    Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL.Job Description :Roles And Responsibilities :- Must have cloud knowledge in Azure- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python,...


  • Bengaluru, India Cognizant Full time

    JD: - Experience level : 5+ years - Total relevant experience in Azure Databricks : 2+ Years - Must have skills: - Azure Databricks along with Scala/Pyspark. Preferably Scala. - Azure Data Factory - Experience working with streaming data, Structured Streaming API - Performance tuning - Secondary skills: Azure Cosmos, Azure Data Explorer, Azure Kuberentes,...


  • Bengaluru, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...


  • Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...


  • Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...


  • Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...


  • Bengaluru, India Infogain Full time

    Position: Lead - Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...


  • Bengaluru, India Infogain Full time

    Position: Lead - Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...


  • Bengaluru, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...