Data Engineer Databricks

1 week ago

Bengaluru, Karnataka, India Infiniti Research Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Role & responsibilities

Develop and maintain scalable ETL/ELT pipelines using Databricks (PySpark, Delta Lake).

Design and optimize data models in AWS Redshift for performance and scalability.

Manage Redshift clusters and EC2-based deployments, ensuring reliability and cost efficiency.

Integrate data from diverse sources (structured/unstructured) into centralized data platforms.

Implement data quality checks, monitoring, and logging across pipelines.

Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets.

Required Skills & Experience:

36 years of experience in data engineering.

Strong expertise in Databricks (Spark, Delta Lake, notebooks, job orchestration).

Hands-on experience with AWS Redshift (cluster management, performance tuning, workload optimization).

Proficiency with AWS EC2, S3, and related AWS services.

Strong SQL and Python skills.

Experience with CI/CD and version control (Git).

Preferred candidate profile

We are seeking a skilled Data Engineer with hands-on experience in Databricks and AWS Redshift (including EC2 deployments) to design, build, and optimize data pipelines that support analytics and business intelligence initiatives.

  • Engineering Manager

    20 hours ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    P-995At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Engineering Manager

    18 hours ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Engineering Manager - Backend P-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers...

  • Senior Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Description : P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...

  • Senior Engineering Manager

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-995At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Staff Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 1,20,000 - ₹ 2,60,000 per year

    Job Description P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...

  • Staff Software Engineer

    7 days ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Backline Engineer

    3 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Sr Backline Engineer (Apache Spark) Mission Databricks helps data teams solve the world's toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is...

  • Sr Backline Engineer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Description Mission Databricks helps data teams solve the worlds toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition. Databricks is venture-backed and...

  • Staff Software Engineer

    7 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 25,00,000 - ₹ 50,00,000 per year

    P-1348At Databricks, we are passionate about enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Our...