Azure Databricks Developer

4 weeks ago

Any LocationBangalore, IN KARYA CONSULTANTS PRIVATE LIMITED Full time

Responsibilities :

- Closely work with Architect and lead to design solutions to meet functional and non-functional- requirements.

- Participate to understand architecture and solution design- artifacts.

- Evangelize re-use through the implementation of shared- assets.

- Proactively implement engineering methodologies, standards, and leading practices.

- Provide insight and direction on roles and responsibilities required for solution- operations.

- Identify, communicate and mitigate Risks, Assumptions, Issues, and Decisions throughout the full- lifecycle.

- Considers the art of the possible, compares various solution options based on feasibility and impact, and proposes actionable- plans.

- Demonstrate- strong analytical and technical problem-solving- skills.

- Ability to analyze and operate at various levels of- abstraction.

- Ability to balance what is strategically right with what is practically- realistic.

Qualifications we seek in you-

Minimum qualifications :

- Excellent technical skills to enabling the creation of future-proof, complex global- solutions-

- Bachelor's Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work- experience.

- Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.

- Work with architect and leads for solutioning to meet functional and non-functional- requirements.

- Demonstrated knowledge of relevant industry trends and- standards.

- Demonstrate- strong analytical and technical problem-solving- skills.

- Must have excellent coding skills either Python or Scala, preferably Python.

- Must have at least 5+ years of experience in Data Engineering domain with total of 7+ years.

- Must have implemented at least 2 project end-to-end in Databricks.

- Must have at least 2+ years of experience on databricks which consists of various components as below

- Delta lake

- dbConnect

- db API 2.

- Databricks workflows orchestration

- Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.

- Must have strong understanding of Data warehousing and various governance and security standards around Databricks.

- Must have knowledge of cluster optimization and its integration with various cloud services.

- Must have good understanding to create complex data pipeline.

- Must have good knowledge of Data structure & algorithms.

- Must be strong in SQL and sprak-sql.

- Must have strong performance optimization skills to improve efficiency and reduce cost.

- Must have worked on both Batch and streaming data pipeline.

- Must have extensive knowledge of Spark and Hive data processing framework.

- Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.

- Must be strong in writing unit test case and integration test.

- Must have strong communication skills and have worked on the team of size 5 plus.

- Must have great attitude towards learning new skills and upskilling the existing skills.

- Good to have Rest API knowledge.

- Good to have understanding around cost distribution.

- Good to have knowledge of Databricks platform design.

- Good to have Unity catalog and basic governance knowledge.

- Good to have Databricks SQL Endpoint understanding.

- Good To have CI/CD experience to build the pipeline for Databricks jobs.

- Good to have if worked on migration project to build Unified data platform.

- Good to have knowledge of DBT.

- Good to have knowledge of docker and Kubernetes.

(ref:hirist.tech)

  • Azure Data Engineer

    1 month ago

    Any Location, IN Visionyle Full time

    Position Name: Azure Data EngineerPosition Mode: PermanentExperience: 6 YearsJoining Location: RemoteNotice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating o...

  • Azure Databricks Support Engineer

    1 month ago

    Any Location/Bangalore, IN INSIGHT GLOBAL SOLUTIONS Full time

    Required Skills and Experience - - 6+ years of hands-on experience in managing and administrating Azure PaaS environments. - 3+ years of hands-on experience setting up, solutioning, configuring, provisioning, and administering Azure Databricks platform -must be a SME. - Any experience in providing best practices around Azure Databricks for enterprise...

  • MLOps Developer

    2 weeks ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • ETL Developer

    10 hours ago

    Any Location, IN RS Consultants Full time

    ETL (Databricks) :Job Description :Responsibilities :- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.- Collaborate with Business Intelligence team and other stakeholders for data requirements- Collaborate with the Data Management team to provide quality data to stakeholders.- Build data...

  • Senior Data Engineer

    10 hours ago

    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Azure Synapse Developer

    10 hours ago

    Mumbai/Pune/Bangalore, IN RapidBraiins Full time

    Overview:- We are seeking a talented Azure Synapse Developer to join our dynamic team.- The ideal candidate will have a strong background in data engineering and analytics, with a focus on Microsoft Azure Synapse Analytics.- As an Azure Synapse Developer, you will play a critical role in designing, developing, and maintaining our data pipelines and analytics...

  • Database Administrator

    1 month ago

    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring database administrators for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India.Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business...

  • Azure Databricks Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations/Bangalore, IN Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...

  • Azure Data Engineer

    2 weeks ago

    Any Location/Anywhere in India/Multiple Locations, IN hiReign Innoways Full time

    We are seeking a highly motivated and skilled Data Engineer to join our growing team. In this role, you will play a critical role in designing, developing, and maintaining data pipelines using ADF and ADB to integrate, transform, and deliver data for analysis and Design and develop data pipelines using Azure Data Factory (ADF) to automate data movement and...

  • Azure Databricks Engineer

    2 weeks ago

    Pune/Bangalore/Hyderabad, IN Advitha Tech Solutions Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Azure Purview Architect

    10 hours ago

    Any Location, IN RapidBraiins Full time

    Job Description : As a Microsoft Azure Purview Consultant, you will leverage your expertise in data domains to lead client engagements designing and implementing various applications in the areas of data cataloging, data lineage, security, data quality and govern- You will work with diverse enterprises to design and deploy industry-leading solutions to...

  • Azure Databricks Engineer

    2 weeks ago

    Hyderabad/Pune/Bangalore, IN manogna it services private limited Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Azure Data Architect

    3 weeks ago

    Bangalore/Chennai/Hyderabad/Mumbai/Pune/Noida, IN ACZ Global Private Limited Full time

    Azure Data ArchitectMandatory Skills : Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description :We are seeking a highly skilled and experienced Azure Data Architect to join our team. As an Azure Data Architect, you will play a key role in designing and implementing data solutions on the Microsoft Azure platform. The ideal...

  • Data Engineering Lead

    2 weeks ago

    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, IN QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ yearsLocation : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Senior Data Engineer

    1 month ago

    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...

  • Data Engineer

    1 month ago

    Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full time

    Responsibilities:- Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake.- Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API configurations, and backend architecture.- Extract, transform, and load (ETL) data...

  • Databricks Engineer

    2 weeks ago

    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, IN Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company :We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and...

  • Azure Solution Architect

    1 month ago

    Any Location/Bangalore, IN Shework Full time

    Experience : Azure AI Search + Data Chuncking & Vectorization + Azure Open AI experience. Key Accountability ;- Performs implementation of high level design and specifications.- Develops low level design, class diagrams, flow charts.- Performs Unit testing of individually developed components and fix errors, if any.- Assist in preparation of design,...

  • Azure Cloud Architect

    1 month ago

    Bangalore/Any Location, IN 4S Advisory Full time

    Job Description : As an Azure Cloud architect, you will be joining a team responsible for building and maintaining an innovative mobile application in a cloud environment on Azure. Your role will be crucial in designing the development on the cloud platform within the Group. Your decisions will provide the framework for your fellow analysts and developers to...

  • ETL Developer

    1 month ago

    Bangalore/Any Location, IN Swift Strategic Staff Solutions INC Full time

    About the Role:- We are seeking a highly skilled and experienced ETL Developer to join our growing data engineering team.- With over 10 years of experience, you will play a critical role in designing, developing, implementing, and maintaining robust data pipelines to extract, transform, and load data into our data warehouse and data lake.- You will be...