Databricks / PySpark Developer

4 days ago

Bengaluru, India Teamware Solutions Full time

Job Description Teamware Solutions is seeking a skilled Databricks / PySpark Developer to build and optimize our big data processing and analytics solutions. This role is crucial for working with relevant technologies, ensuring smooth data operations, and contributing significantly to business objectives through expert analysis, development, implementation, and troubleshooting within the Databricks / PySpark domain. Roles and Responsibilities: - Big Data Solution Development: Design, develop, and implement scalable data processing pipelines and analytics solutions using PySpark within the Databricks platform. - Data Ingestion & Transformation: Write efficient PySpark code to extract, transform, and load (ETL/ELT) large volumes of data from various sources into Databricks. - Data Lake/Warehouse Management: Work with data lake and data warehouse concepts, ensuring data quality, consistency, and efficient storage within Databricks (e.g., Delta Lake). - Performance Optimization: Optimize PySpark jobs and Databricks notebooks for performance, cost-efficiency, and scalability, addressing bottlenecks in data processing. - Analysis & Insights: Perform complex data analysis using PySpark to uncover insights, build data models, and support business intelligence and machine learning initiatives. - Troubleshooting: Perform in-depth troubleshooting, debugging, and issue resolution for PySpark jobs, Databricks environments, and data pipeline failures. - Collaboration: Work closely with data engineers, data scientists, business analysts, and other stakeholders to understand data requirements and deliver robust solutions. - Code Quality & Best Practices: Write clean, modular, and well-documented PySpark code. Participate in code reviews and adhere to best practices for big data development. - Automation: Implement automation for data pipelines, job scheduling, and monitoring within the Databricks ecosystem. Preferred Candidate Profile: - PySpark Expertise: Strong hands-on development experience with PySpark for big data processing and analytics. - Databricks Platform: Proven experience working with the Databricks platform, including Databricks notebooks, clusters, Delta Lake, and related services. - SQL Proficiency: Excellent proficiency in SQL for data manipulation and querying. - Python Programming: Strong programming skills in Python for data engineering tasks. - Big Data Concepts: Solid understanding of big data concepts, distributed computing, and data warehousing principles. - Cloud Platforms (Plus): Familiarity with cloud services from AWS, Azure, or GCP, particularly those related to data storage and processing, is a plus. - Problem-Solving: Excellent analytical and problem-solving skills with a methodical approach to complex data challenges. - Communication: Strong verbal and written communication skills to articulate technical solutions and collaborate effectively within a team. - Education: Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related technical field.

  • Pyspark & Databricks Developer

    2 weeks ago

    Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    1.Total 3 to 6 years of experience as a Pyspark and Databricks Developer with a strong portfolio demonstrating your expertise 2. Good hands on knowledge with database technologies such as SQL and NoSQL 3. Familiarity with Snowflake is added advantage 4. Good in Troubleshooting debugging maintaining and improving existing software 5. Excellent problem-solving...

  • Data Engineer

    4 days ago

    Bengaluru, India Teamware Solutions Full time

    Job Description We are seeking a skilled Data Engineer with hands-on experience in Databricks and PySpark to design and implement scalable data pipelines and analytics solutions. The ideal candidate will work closely with data architects, analysts, and business stakeholders to transform large volumes of raw data into clean, usable datasets that drive...

  • Data Engineer – Databricks

    2 weeks ago

    Bengaluru, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySpark Location: Bangalore Experience: 6–9 years Choosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock...

  • Data Engineer – Databricks

    2 weeks ago

    Bengaluru, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySpark Location: Bangalore Experience: 6–9 years Choosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock...

  • Data Engineer – Databricks

    2 weeks ago

    Bengaluru, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySpark Location: Bangalore Experience: 6–9 years Choosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock...

  • Data Engineer – Databricks

    1 week ago

    Bengaluru, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySpark Location: Bangalore Experience: 6–9 years Choosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock...

  • Pyspark Developer

    7 days ago

    Bengaluru, Chennai, Pune, India Quess Corp Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    ROLE SUMMARYWe are seeking a highly skilled PySpark Developer with hands-on experience in Databricks IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data...

  • Data Engineer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - Data Engineer ( Azure DataBricks, Pyspark) Exp range – 4 yrs – 6 yrs Location- Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar Notice period – 30-60 Pls find the Job Description below. 5+ yrs. Development experience with Spark (PySpark), Python and SQL. Extensive...

  • Data Engineer – Databricks

    2 weeks ago

    Bengaluru, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...