Azure Databricks

6 days ago

Bangalore, India Tredence Inc. Full time

Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect

Experience: 5-12 years

Location: Bangalore, Chennai, Delhi, Pune, Kolkata

About Tredence:

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data’s full potential.

Primary Roles and Responsibilities:

● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

● Ability to provide solutions that are forward-thinking in data engineering and analytics space

● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

● Triage issues to find gaps in existing pipelines and fix the issues

● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

● Help joiner team members to resolve issues and technical challenges.

● Drive technical discussion with client architect and team members

● Orchestrate the data pipelines in scheduler via Airflow Skills and Qualifications:

● Bachelor's and/or master’s degree in computer science or equivalent experience.

● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

● Deep understanding of Star and Snowflake dimensional modelling.

● Strong knowledge of Data Management principles

● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

● Should have hands-on experience in SQL, Python and Spark (PySpark)

● Candidate must have experience in AWS/ Azure stack

● Desirable to have ETL with batch and streaming (Kinesis).

● Experience in building ETL / data warehouse transformation processes

● Experience with Apache Kafka for use with streaming data / event-based data

● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

● Experience working with structured and unstructured data including imaging & geospatial data. ● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

● Should have experience working in Agile methodology

● Strong verbal and written communication skills.

● Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills: Python/ PySpark / Spark with Azure/ AWS Databricks

Tredence is an equal opportunity employer. We celebrate and support diversity and are committed to creating an inclusive environment for all employees. Visit our website for more details:

NP: Immediate to 30 Days

  • Azure Databricks Lead/Architect

    4 weeks ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure...

  • Azure databricks lead/architect

    2 months ago

    Bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure...

  • Azure Databricks Lead/Architect

    2 months ago

    Bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure Databricks ...

  • Azure Databricks

    2 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Azure Databricks Lead/Architect

    4 weeks ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...

  • Azure Databricks Lead/Architect

    1 month ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure...

  • Azure Databricks-7to10Yrs-Bangalore

    2 months ago

    bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-BangaloreJD-Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features.Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposureAbility to gather requirements...

  • Azure Architect

    1 month ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    Job Title : Azure ArchitectLocation : Bangalore/Bengaluru (Hybrid Mode)Experience : 8 to 12 YearsJob Summary : We are looking for a skilled Azure Architect with extensive experience in data engineering and a strong focus on Azure Databricks. The ideal candidate will have a deep understanding of Azure services, ETL processes, and data warehousing concepts,...

  • Azure Databricks-7to10Yrs-Bangalore

    2 months ago

    Bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-Bangalore JD- Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features. Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposure Ability to gather...

  • Azure databricks-7to10yrs-bangalore

    2 months ago

    Bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10 Yrs-Bangalore JD- Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure Paa S features. Azure Cloud , Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposure Ability to gather...

  • Azure Databricks Lead/Architect

    2 months ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...

  • Azure Databricks Lead/Architect

    4 weeks ago

    bangalore, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure Databricks...

  • Azure Databricks-7to10Yrs-Bangalore

    3 months ago

    bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-Bangalore JD- Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features. Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposure Ability to gather...

  • Azure Databricks-7to10Yrs-Bangalore

    3 months ago

    bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-BangaloreJD-Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features.Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposureAbility to gather requirements...

  • Azure Databricks Engineer

    2 weeks ago

    Bangalore, India krtrimaIQ Cognitive Solutions Full time

    Job Title: Azure Databricks Engineer Location: Bangalore Experience Level: 5+ years of relevant experience Employment Type: Full-Time About Us: Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights...

  • Azure Databricks Pyspark Developer

    6 months ago

    bangalore, India Tredence Inc. Full time

    MUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...

  • Senior Developer – Azure Databricks

    3 weeks ago

    bangalore, India Arthya Tech Solutions Full time

    Position Summary: At Arthya Tech we are building Global Competency center - GCC for our client - an US based producer of dairy products. As a Senior Developer, you will be responsible for technical leadership of Agile Team(s) with our Business Analytics & Insights (BAI) team. You will work closely with cross-functional teams to deliver high-quality...

  • Azure databricks with power bi lead

    1 month ago

    Bangalore, India GyanSys Inc. Full time

    Dear Candidate, Gyan Sys is looking for Lead/Architect - Azure Databricks for our overseas customers consulting Projects based in Americas/Europe/APAC region. Please apply for the job role or Share your CV directly to Responsibilities: Position: Lead/Architect - Azure Databricks Relevant experience: 7 to 13 Years Primary Skills: Azure Databricks,...

  • Senior Developer – Azure Databricks

    3 weeks ago

    bangalore, India Arthya Tech Solutions Full time

    Position Summary:At Arthya Tech we are building Global Competency center - GCC for our client - an US based producer of dairy products.As a Senior Developer, you will be responsible for technical leadership of Agile Team(s) with our Business Analytics & Insights (BAI) team. You will work closely with cross-functional teams to deliver high-quality solutions...

  • Azure Databricks with Power BI Lead

    1 month ago

    bangalore, India GyanSys Inc. Full time

    Dear Candidate,GyanSys is looking for Lead/Architect - Azure Databricks for our overseas customers consulting Projects based in Americas/Europe/APAC region. Please apply for the job role or Share your CV directly to Responsibilities:Position: Lead/Architect - Azure DatabricksRelevant experience: 7 to 13 YearsPrimary Skills: Azure Databricks, Hadoop, Hive,...