Lead Data Engineer_ Databricks

2 weeks ago

Bengaluru, Karnataka, India Tredence Full time ₹ 1,20,00,000 - ₹ 2,40,00,000 per year

Role Description:

Developing Modern Data Warehouse solutions using Databricks and Azure Stack

Ability to provide solutions that are forward-thinking in data engineering and analytics space

Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

Triage issues to find gaps in existing pipelines and fix the issues

Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

Drive technical discussion with client architect and team members

Orchestrate the data pipelines in scheduler via Airflow Skills and Qualifications:

Bachelor's and/or master's degree in computer science or equivalent experience.

Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

Should have hands-on experience in SQL, Python and Spark (PySpark)

Experience in building ETL / data warehouse transformation processes

Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

Should have experience working in Agile methodology

Strong verbal and written communication skills.

Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills

Azure Databricks, Pyspark, Azure Data Factory, Azure Data Lake.

Job Location - Bangalore, Chennai, Gurgaon, Pune, Kolkata

Experience Level - Lead Data Engineer ( 9 to 12 years ) , Senior Architect Years )

Expected Joining Time - Immediate - 30 days

Required Skills

Mandatory Skills

Azure Databricks, Pyspark, Azure Data Factory, Azure Data Lake.

  • Solutions Architect

    4 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ127R14As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Staff Software Engineer

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-375At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve...

  • Staff Software Engineer

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-375At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve...

  • Sr Incident Manager

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-1485At Databricks, we are passionate about empowering data teams to tackle the world's most challenging problems — from bringing the next mode of transportation to reality to accelerating the development of medical breakthroughs. We achieve this by building and operating the world's best data and AI infrastructure platform, enabling our customers to...

  • Sr Incident Manager

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 1,20,000 - ₹ 6,00,000 per year

    P-1485Incident ManagerAt Databricks, we are passionate about empowering data teams to tackle the world's most challenging problems — from bringing the next mode of transportation to reality to accelerating the development of medical breakthroughs. We achieve this by building and operating the world's best data and AI infrastructure platform, enabling our...

  • Incident Manager

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-1485At Databricks, we are passionate about empowering data teams to tackle the world's most challenging problems — from bringing the next mode of transportation to reality to accelerating the development of medical breakthroughs. We achieve this by building and operating the world's best data and AI infrastructure platform, enabling our customers to...

  • Field Engineering, Data Application Product Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    FEQ326R18As the Data Application Product Specialist, you will be defining our technical go to market strategy and driving our data application stack adoption in the Asia Pacific and Japan region. You will be directly working with customers to guide and influence their data application architecture and decisions. You will be expected to present, demo and...

  • Director of Engineering

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 60,00,000 per year

    (P-1491)About The TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...

  • Senior Software Engineer

    4 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    P-1405At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Field Engineering, Cloud Platform Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ326R18As the Cloud Platform Specialist, you will be defining and driving our technical go to market strategy in the Asia Pacific and Japan region.You will be directly working with customers to guide and influence their cloud data platform architecture and decisions. You will be acting as a trusted advisor for senior executives and your in-depth technical...