Databricks Engineer

4 days ago

Delhi Bengaluru Pune, India Impetus Technologies Full time
Job Description

- Databricks Engineers with 2-6 years of hand-on experience in Pyspark, Cloud Platform and SQL.
- Proven experience in implementing data solutions on the Databricks platform withhands on experience in setting up Databricks cluster, working in Databricks modules,data pipelines for ingestingand transforming data from various sources into Databricks.
- Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks.

Roles & Responsibilities

- Bachelors or Master's degree with 2-6 years of professional experience.
- Proven experience in implementing data solutions on the Databricks platform.
- Solid understanding of Databricks fundamentals and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).
- Configure, set up, and manage Databricks clusters, workspaces, and notebooks to ensure optimal performance, scalability, and resource allocation.
- Implement data pipelines for ingesting, cleansing, and transforming data from various sources into Databricks, ensuring data quality, consistency, and reliability. Develop ETL (Extract, Transform, Load) processes as needed.
- Develop, optimize, and maintain Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks.
- Knowledge of Performance Optimization, Monitoring and Automation would be a plus.
- Understanding of data governance, compliance, and security best practices.
- Strong Proficiency in Pyspark, Databricks Notebooks, SQL, Python, Scala, or Java.
- Proficiency in SQL for data querying and manipulation.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
- Certifications in Databricks would be beneficial.

Role:Data Engineer

Industry Type:IT Services & Consulting

Department:Engineering - Software & QA

Employment Type:Full Time, Permanent

Role Category:Software Development

Education

UG:B.Tech/B.E. in Any Specialization

- PG:M.Tech in Any Specialization, MCA in Any Specialization

  • Databricks Engineer

    3 days ago

    Delhi, Bengaluru, Pune, India Impetus Technologies Full time

    Job Description - Databricks Engineers with 2-6 years of hand-on experience in Pyspark, Cloud Platform and SQL. - Proven experience in implementing data solutions on the Databricks platform withhands on experience in setting up Databricks cluster, working in Databricks modules,data pipelines for ingestingand transforming data from various sources into...

  • Senior Engineering Manager

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-995At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Engineering Manager

    11 hours ago

    Bengaluru, India Databricks Full time

    P-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Software Engineer

    12 hours ago

    Bengaluru, India Databricks Full time

    P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Staff Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Staff Software Engineer

    12 hours ago

    Bengaluru, India Databricks Full time

    P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,20,000 - US$ 2,00,000 per year

    P-926At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Director of Engineering

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...

  • Director of Engineering

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    (P-1384)About The TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs.Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI...