Databricks + Pyspark + SQL

2 days ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year


Job description:

Role: Databricks + Pyspark + SQL

Year of Experience:4-8 Years

Responsibilities:

  1. Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions.
  2. Develop and maintain ETL processes using Databricks and PySpark for large-scale data processing.
  3. Optimize and tune existing data pipelines to ensure optimal performance and scalability.
  4. Create and implement data quality and validation processes to ensure the accuracy of data.
  5. Work with stakeholders to understand business needs and translate them into actionable data solutions.
  6. Collaborate with the data science team to support machine learning model deployment and integration into production systems.
  7. Troubleshoot and resolve data-related issues promptly.

Requirements:

  1. Bachelor's degree in Computer Science, Engineering, or a related field.
  2. Proven experience   working with Databricks, PySpark, and SQL in a professional setting.
  3. Strong proficiency in designing and optimizing ETL processes for large-scale data sets.
  4. Experience with data modeling, data warehousing, and database design principles.
  5. Familiarity with cloud platforms such as AWS, Azure, or GCP.

  • Data Engineer- 1

    2 days ago

    Bengaluru, Karnataka, India Databricks PySpark Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Position: Senior Data Engineer We are seeking an experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring the smooth flow of large datasets across systems. In this role, you will leverage your expertise in Databricks, Pyspark, and ETL design to build efficient data solutions. You will also contribute to...

  • Pyspark & Databricks Developer

    3 days ago

    Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    1.Total 3 to 6 years of experience as a Pyspark and Databricks Developer with a strong portfolio demonstrating your expertise 2. Good hands on knowledge with database technologies such as SQL and NoSQL 3. Familiarity with Snowflake is added advantage 4. Good in Troubleshooting debugging maintaining and improving existing software 5. Excellent problem-solving...

  • Data Engineer – Databricks

    4 weeks ago

    Bengaluru, Karnataka, India, Karnataka Capgemini Engineering Full time

    Data Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...

  • Databricks

    4 days ago

    Bengaluru, Karnataka, India Teamware Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About the Job:Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt LtdRole:DatabricksExperience:5-10 Yrs5days Office a week (Oniste) / BangaloreOpen Positions :5Shift pm ( cab facility will be provided)Notice Period:Immediate to 20 Days preferredConnect here for Faster Comm LinkedInResponsibilities:Assess and understand current-state...

  • DataBricks Developer

    2 days ago

    Bengaluru, Karnataka, India Growel Softech Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    DataBricks Developer-Key skills-Databricks, Pyspark, Python, SQLLocation : BangaloreExp : 5 to 8 yearsNP : Immediate

  • Pyspark Lead

    2 days ago

    Bengaluru, Karnataka, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled PySpark Lead with 5 to 8 years of experience, based in Bangalore. The ideal candidate will have expertise in PySpark, SQL, ETL/Data Engineering Pipeline, Cloud understanding, CI/CD, Data Modelling, Airflow, Kafka, EMR/Databricks, Snowflake, and Hive.Roles and ResponsibilityDesign and develop scalable data pipelines using PySpark...

  • Senior Engineer Azure Databricks

    2 days ago

    Bengaluru, Karnataka, India Ahvi Infotech Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Position: Senior Engineer Azure databricksOverall IT experience: 6 to 9 yearsPrimary Skills: Azure Databricks, PySpark, SQLSecondary Skills: ADF/Azure Data factoryWork Location: Bengaluru/HyderabadMode of work: Hybrid Notice Period: 0 to 30 Days Experience & Expertise:Total Experience: 6 to 9 years in Cloud Data Engineering.Azure Databricks & PySpark:...

  • Databricks Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from TCSWe are hiringDatabricks EngineerforPAN IndiaLocation.Skills: Azure Databricks, Pyspark, ADLS, ADFLocation: PAN INDIAExp: 4+ yrs.JOB DESCRIPTION:MUST HAVE:Azure Data Bricks (Python)Pyspark.ADLSComplex problem solving skill.GOOD TO HAVE:Azure Devops.Azure Data Factory.Azure Synpasis AnalyticsResponsibility of / Expectations from the...

  • Databricks Engineer

    2 days ago

    Bengaluru, Karnataka, India Teamware Solutions ( A division of Quantum Leap Co Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description : - Assess and understand current-state Informatica ETL jobs, mappings, workflows, and dependencies. - Redesign and implement equivalent data pipelines using Databricks (PySpark/Scala/SQL). - Optimize performance and scalability of the migrated workflows in the Databricks environment. - Collaborate with data architects, DevOps, QA, and...

  • Azure Databricks Sr Engineer

    3 days ago

    Bengaluru, Karnataka, India AVE-Promagne Business Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Notice Period: Immediate to 30 Days (Preferred)Job Summary:We are seeking a skilled Azure Data Engineer to join our growing data team. The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, PySpark, and SQL, and will contribute to designing and implementing scalable, secure, and high-performance data solutions on Microsoft...