Azure Databricks Engineer

2 weeks ago

bangalore, India Tredence Inc. Full time
Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect
Experience: 3-12 years
Location: Bangalore, Chennai, Delhi, Pune, Kolkata
About Tredence:
Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.
We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data’s full potential.
Primary Roles and Responsibilities:
● Developing Modern Data Warehouse solutions using Databricks and Azure Stack
● Ability to provide solutions that are forward-thinking in data engineering and analytics space
● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
● Triage issues to find gaps in existing pipelines and fix the issues
● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
● Help joiner team members to resolve issues and technical challenges.
● Drive technical discussion with client architect and team members
● Orchestrate the data pipelines in scheduler via Airflow Skills and Qualifications:
● Bachelor's and/or master’s degree in computer science or equivalent experience.
● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
● Deep understanding of Star and Snowflake dimensional modelling.
● Strong knowledge of Data Management principles
● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
● Should have hands-on experience in SQL, Python and Spark (PySpark)
● Candidate must have experience in Azure stack
● Desirable to have ETL with batch and streaming (Kinesis).
● Experience in building ETL / data warehouse transformation processes
● Experience with Apache Kafka for use with streaming data / event-based data
● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
● Experience working with structured and unstructured data including imaging & geospatial data. ● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
● Should have experience working in Agile methodology
● Strong verbal and written communication skills.
● Strong analytical and problem-solving skills with a high attention to detail.
Mandatory Skills: Python/ PySpark / Spark with Azure/ Databricks
NP: Only Immediate Joiner

  • Azure Databricks Engineer

    2 weeks ago

    Bangalore, India ResourceTree Global Services Full time

    Job Title : Senior Databricks Data EngineerSkillset : Databricks, Datalake Architecture, AzureExperience : 6 - 8 yearsLocation : ChennaiJob Summary : We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakehouse concepts, with architecture experience, and a sound knowledge of Azure and its services....

  • Lead Azure Databricks Engineer

    2 weeks ago

    Bangalore, India ResourceTree Global Services Full time

    Resource Tree Global Services Pvt Ltd is hiring Senior Databricks Data Engineer for one of its leading client in Content & Data Analytics. Below are the details .Job Title : Senior Databricks Data EngineerSkills Required : Azure, Databricks, Datalake, Python/Scala/Java, Data Migration Strategies, Data Warehiusing, Data Modelling, Strong knowledge on Data...

  • Data Engineer

    2 weeks ago

    Bangalore/Hyderabad/Chennai, India Mouri Tech (P) Ltd Full time

    Job Title : Azure Data EngineerWork Location : Hyderabad , Bangalore, ChennaiExperience : 5+ yearsRequired Skills : Azure, Python, Azure DatabricksResponsibilities : . 5+ years as a data engineer.- 2- 3 years' experience in python- 2 years of experience in Azure SQL- Experience in DataBricks- Familiarity with Azure DevOps & database CI/CD.- Knowledge of...

  • Azure Databricks Engineer

    3 weeks ago

    Bangalore, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...

  • Azure Databricks Engineer

    3 weeks ago

    Bangalore, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Career Soft Solutions Full time

    Job Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...

  • Data Engineer

    4 weeks ago

    Bangalore, India Career Soft Solutions Full time

    Job Description : - 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure...

  • Lead Azure Databricks Engineer

    2 weeks ago

    Bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ AzureStack.- Ability to provide solutions that are forward-thinking in data engineering and analytics space.- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...

  • Senior Azure Data Engineer

    3 weeks ago

    Mumbai/Bangalore, Maharashtra, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Senior Azure Data Engineer

    2 weeks ago

    Mumbai/Bangalore, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Data Scientist

    4 weeks ago

    bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...

  • Architect - Azure Databricks

    2 weeks ago

    bangalore, India Marlabs LLC Full time

    Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Work Location -...

  • Azure Databricks Support Engineer

    3 weeks ago

    Any Location/Bangalore, IN INSIGHT GLOBAL SOLUTIONS Full time

    Required Skills and Experience - - 6+ years of hands-on experience in managing and administrating Azure PaaS environments. - 3+ years of hands-on experience setting up, solutioning, configuring, provisioning, and administering Azure Databricks platform -must be a SME. - Any experience in providing best practices around Azure Databricks for enterprise...

  • Azure Databricks Support Engineer

    4 weeks ago

    Any Location,Bangalore, India INSIGHT GLOBAL SOLUTIONS Full time

    Required Skills and Experience - - 6+ years of hands-on experience in managing and administrating Azure PaaS environments. - 3+ years of hands-on experience setting up, solutioning, configuring, provisioning, and administering Azure Databricks platform -must be a SME. - Any experience in providing best practices around Azure Databricks for enterprise...

  • Data Scientist

    3 weeks ago

    Bangalore, Karnataka, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • Data Scientist

    2 weeks ago

    Bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • Vsquare Systems

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Vsquare Systems Pvt. Ltd. Full time

    Data Engineer (Azure Databricks)Job Title : Data Engineer (Azure Databricks). Location : Bangalore / Hybrid. Job Type : Full-time. Job Description : .- Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations,...