Databricks Engineer

11 hours ago

Mumbai, Maharashtra, India AVE-Promagne Business Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Responsibilities :

- Design, develop, and implement data pipelines using Apache Spark and Databricks notebooks to process and transform large datasets.

- Optimize data pipelines for performance, scalability, and cost-effectiveness.

- Automate data pipelines and integrate them with our existing data infrastructure.

- Develop and maintain unit tests to ensure the quality and reliability of data pipelines.

- Collaborate with data scientists, analysts, and other engineers to understand data requirements and translate them into technical solutions.

- Configure and manage Databricks clusters for optimal performance and resource utilization.

- Implement security best practices for data access and authorization within the Databricks environment.

- Monitor and troubleshoot Databricks jobs and identify potential performance bottlenecks.

- Stay up-to-date with the latest advancements in Databricks features and functionalities.

- Work collaboratively with data warehouse/data lake engineers to ensure seamless data ingestion and transformation processes.

- Develop data quality checks and data validation procedures within data pipelines.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field (or equivalent experience).

years of experience in data engineering or a related field.

- Proven experience working with Apache Spark and the Databricks platform.

- Strong understanding of data processing concepts, ETL/ELT pipelines, and big data architectures.

- Experience with SQL and familiarity with relational databases (e.g, MySQL, PostgreSQL).

- Proficiency in Python programming with experience in data manipulation libraries (e.g, Pandas).

- Experience with cloud platforms (AWS, Azure, GCP) a plus.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills.

- Ability to work independently and as part of a team

  • Databricks Data Engineer

    10 hours ago

    Mumbai, Maharashtra, India Crisil Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Position Overview:The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems.Key...

  • Databricks Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Gretia Tech Services Private Limited Full time ₹ 80,00,000 - ₹ 2,00,00,000 per year

    Description :Key Skills & Experience : years of hands-on experience with Databricks, including job optimization and performance tuning. years in Data Engineering, with a solid foundation in data pipeline design, development, and implementation. - Expertise in PySpark for large-scale data processing and transformations. - Proven experience in ETL design...

  • Databricks Data Engineering Lead

    1 week ago

    Mumbai, Maharashtra, India Crisil Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Position Overview:TheDatabricks Data Engineering Leadrole is ideal a highly skilled Databricks Data Engineer who will architect and lead the implementation of scalable, high-performance data pipelines and platforms using the Databricks Lakehouse ecosystem. The role involves managing a team of data engineers, establishing best practices, and collaborating...

  • Data Engineer- databricks

    8 hours ago

    Mumbai, Maharashtra, India Qualintia Solutions Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Role- Data Engineer- DatabricksExp- 8+ years,Job Type- ContractualLocation- MumbaiWork Mode- WFO• Learning & Certification Opportunities: Enhance your professional growth.• Comprehensive Medical Coverage and Life Insurance: For your well-being.• Flexible Work Environment: Enjoy a 5-day work week.• Collaborative Culture: Be part of a fun, innovative...

  • Databricks Architect

    2 weeks ago

    Mumbai, Maharashtra, India Jio Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Title: Senior Databricks ArchitectLocation: Mumbai, Gurgaon, HyderabadAbout the RoleWe are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor...

  • Databricks Developer

    2 days ago

    Mumbai, Maharashtra, India Seaspan Corporation Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Seaspan teams are goal-driven and share a high-performance culture, focusing on building services offerings to become a leading asset manager. Seaspan provides many of the world's major shipping lines with alternatives to vessel ownership by offering long-term leases on large, modern containerships and pure car, truck carriers (PCTCs) combined with industry...

  • Senior Azure Databricks Engineer

    4 days ago

    Mumbai, Maharashtra, India MLAI Digital Private Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Data Engineer

    7 days ago

    Mumbai, Maharashtra, India, Maharashtra Nebula Tech Solutions Full time

    Data Engineer – Databricks Expert Remote (India-based) | Full-time | Immediate Joiners PreferredAre you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a seasoned Data Engineer to join our team and work on high-impact data products for a leading global...

  • Databricks Engineer

    1 week ago

    Mumbai, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Greetings from TCS!!Job Title: Databricks EngineerJob location: Hyderabad, Noida, Chennai, MumbaiExperience range: 5-10 yearsJob Description: Experience working on Azure Databricks using Scala, PySpark Experience on Azure Cloud platform Experience of full Software Development Life Cycle experience Knowledge about Azure DevOps and Terraform Experience with...

  • Senior Databricks Architect

    2 weeks ago

    Mumbai, Maharashtra, India Jio Platforms Limited (JPL) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Work Locations: Mumbai OR Hyderabad OR GurgaonAbout the Role:We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to...