Azure Databricks engineer

2 weeks ago


Pune, India Persistent Systems Full time

About Position


Persistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.


Role: Azure Databricks engineer

Location: All PSL

Experience: 3- 6 years

Job Type: FTE


What You'll Do


  • Cloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory masking and encryption Governance activities Lineage Catalog classifications.
  • Infrastructure setup in Azure)Experienced with multiple data-ingestion methods for loading data to Databricks:
  • ADF python Copy Into for large volume of data as well as incremental data handlingData lake and Data Warehouse Design and optimizationETL Data Analysis CDCMust HaveTechnical understanding of digital customer experience layers Been Leading and built at least 1-2 Projects on Azure cloud with DatabricksExperience with CDC and metadata driven based processing.
  • Have build DWH modelsMust HaveAgile methodologyNice to understand Agile and devops methodology for cloud deployment.
  • Nice to HaveTeam SkillsWorking experience to work with Indian banking industryWork with cross functional teams including QA Platform Delivery and DevOpsNot afraid of refactoring existing system and guiding the team about same.Must HaveDelivery ManagementAble to plan and deliver project deliverable on time with quality.


Expertise You'll Bring


  • 3-6 years of demonstrable experience in enterprise level data platforms involving implementation of end-to-end data pipelines
  • Hands-on experience in using Databricks
  • Hands-on experience with at least one of the leading public cloud data platforms (Amazon Web Services, Azure or Google Cloud)
  • Experience with column-oriented database technologies (e.g., Big Query, Redshift, Vertica), NoSQL database technologies (e.g., DynamoDB, BigTable, Cosmos DB, etc.) and traditional database systems (e.g., SQL Server, Oracle, MySQL)
  • Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Google Cloud DataFlow, Azure Data Factory, Spark, Spark Streaming, etc.


Benefits


  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents


Our company fosters a values-driven and people-centric work environment that enables our employees to:


  • Accelerate growth, both professionally and personally
  • Impact the world in powerful, positive ways, using the latest technologies
  • Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
  • Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent


“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”



  • Pune, Maharashtra, India manogna it services private limited Full time

    Job Description :Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies. Expertise to Implementing Data warehousing Solutions.Experience as Data Engineer in Azure Data Bricks with design and solutioning. Strong Programming experience in Python, SQL Must have Strong technical experience in Azure...


  • Pune, Maharashtra, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up.Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type :FTEWhat You'll DoCloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory...


  • Pune, Maharashtra, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type: FTEWhat You'll DoCloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory...

  • Azure Databrick

    2 weeks ago


    Pune, Maharashtra, India Braincranx IT solutions Full time

    Job description Develop Azure Data Factory Objects ADF pipeline, configuration, parameters, variables, Integration services runtime Handson knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other servicesAzure Databricks: Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB...

  • Azure Databricks

    4 weeks ago


    Pune, India Nityo Infotech Full time

    17 hours ago **Job Code**: JD-19482 **JOB DESCRIPTION**: Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux **Experience Required**: 5 - 9 Years **Industry Type**: IT **Employment Type**: Permanent **Location**: India

  • Azure Databricks

    4 weeks ago


    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required5 - 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia

  • Azure Databricks

    2 weeks ago


    Pune, Maharashtra, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia


  • pune, India Persistent Systems Full time

    About Position Persistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models. Role: Azure Databricks engineer Location: All PSL Experience: 3- 6 years Job Type : FTE What You'll Do Cloud technologies (Azure data services Azure ADLS SHIR ADF Integration with...


  • Pune, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type: FTEWhat You'll DoCloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory...

  • Azure Databricks

    4 weeks ago


    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India


  • Pune, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services and products provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400...

  • Azure Databricks

    4 weeks ago


    pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Data Engineer

    4 weeks ago


    Pune/Hyderabad, India HuQuo Full time

    Must-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...


  • Pune, Maharashtra, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services and products provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400...


  • Pune, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type: FTEWhat You'll Do- Cloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active...

  • Azure Databricks

    2 weeks ago


    Pune, Maharashtra, India Nityo Infotech Full time

    17 hours agoJob Code:JD-19482JOB DESCRIPTION:Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required:9 YearsIndustry Type:ITEmployment Type:PermanentLocation:India


  • Pune, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.Role:Azure Databricks engineerLocation:All PSLExperience:3- 6 yearsJob Type : FTEWhat You'll DoCloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory...

  • Data Engineer

    3 weeks ago


    pune, India EDGESOFT Full time

    Job Description : The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Databricks Engineer

    4 weeks ago


    Pune/Hyderabad/Indore/Ahmedabad/Gurgaon/Gurugram, India Arting Digital Full time

    Job Title : Databricks Engineer Experience : 7+yrLocation : Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode : OnsiteQualification : B.TECH, M.tech, MCASkills : Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements :- Bachelor's degree in computer science or related field. - 7+ years of IT experience,...

  • Databricks Engineer

    4 weeks ago


    Pune/Hyderabad/Indore/Ahmedabad/Gurgaon/Gurugram, IN Arting Digital Full time

    Job Title : Databricks Engineer Experience : 7+yrLocation : Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode : OnsiteQualification : B.TECH, M.tech, MCASkills : Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements :- Bachelor's degree in computer science or related field. - 7+ years of IT experience,...