Databricks + Pyspark + SQL

2 hours ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year


Job description:

Role: Databricks + Pyspark + SQL

Year of Experience:4-8 Years

Responsibilities:

  1. Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions.
  2. Develop and maintain ETL processes using Databricks and PySpark for large-scale data processing.
  3. Optimize and tune existing data pipelines to ensure optimal performance and scalability.
  4. Create and implement data quality and validation processes to ensure the accuracy of data.
  5. Work with stakeholders to understand business needs and translate them into actionable data solutions.
  6. Collaborate with the data science team to support machine learning model deployment and integration into production systems.
  7. Troubleshoot and resolve data-related issues promptly.

Requirements:

  1. Bachelor's degree in Computer Science, Engineering, or a related field.
  2. Proven experience   working with Databricks, PySpark, and SQL in a professional setting.
  3. Strong proficiency in designing and optimizing ETL processes for large-scale data sets.
  4. Experience with data modeling, data warehousing, and database design principles.
  5. Familiarity with cloud platforms such as AWS, Azure, or GCP.

  • Pyspark & Databricks Developer

    2 days ago

    Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    1.Total 3 to 6 years of experience as a Pyspark and Databricks Developer with a strong portfolio demonstrating your expertise 2. Good hands on knowledge with database technologies such as SQL and NoSQL 3. Familiarity with Snowflake is added advantage 4. Good in Troubleshooting debugging maintaining and improving existing software 5. Excellent problem-solving...

  • DataBricks Developer

    1 hour ago

    Bengaluru, Karnataka, India Growel Softech Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    DataBricks Developer-Key skills-Databricks, Pyspark, Python, SQLLocation : BangaloreExp : 5 to 8 yearsNP : Immediate

  • Azure Databricks Developer

    3 days ago

    Bengaluru, Karnataka, India 6d9439f4-30e6-4c3b-a55f-c97083047f58 Full time ₹ 10,000 - ₹ 60,000 per year

    Data Engineer Data QualityBuild automated data quality checks using Databricks (Delta Lake) and PySpark.Perform profiling, anomaly detection, and reconciliation across systems.Investigate data issues using SQL, Python, drive root cause fixes.Collaborate on governance, metadata, and data catalog integration.Automate validations via Airflow, ADF, or Databricks...

  • Databricks Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from TCSWe are hiringDatabricks EngineerforPAN IndiaLocation.Skills: Azure Databricks, Pyspark, ADLS, ADFLocation: PAN INDIAExp: 4+ yrs.JOB DESCRIPTION:MUST HAVE:Azure Data Bricks (Python)Pyspark.ADLSComplex problem solving skill.GOOD TO HAVE:Azure Devops.Azure Data Factory.Azure Synpasis AnalyticsResponsibility of / Expectations from the...

  • Databricks Engineer

    2 weeks ago

    Bengaluru, Karnataka, India 6d9439f4-30e6-4c3b-a55f-c97083047f58 Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Qualifications & ExperienceBachelors degree in Computer Science, Information Systems, Statistics, or related field.510 years of experience in data quality, data engineering, analytics operations.Strong command of SQL, Python, and PySpark for data validation and troubleshooting.Hands-on exposure to Databricks for building and running data pipelines.Working...

  • Senior Data Engineer- Databricks

    7 days ago

    Bengaluru, Karnataka, India Prowesstics It Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Responsibilities:Collaborate with cross-functional teams on project delivery.Design, develop & maintain large-scale data pipelines using Azure Databricks, AWS, PySpark & SQL.

  • Azure Databricks Developer

    3 hours ago

    Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Role**Databricks DeveloperRequired Technical Skill Set**Azure Databricks,PysparkDesigning and building Databricks data pipelines is requiredExperience in transforming the data using Azure Databricks & Delta lakeHands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta LakesSQL experience, specifically to write complex,...

  • Azure Databricks Data Engineer|3 to 5 Years| Gyansys

    2 hours ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description: Data Engineer (Azure Databricks & PySpark)Position: Data EngineerExperience: 3 to 12 yearsPrimary Skills: Azure Databricks, PySpark, SQLSecondary Skills: ADF (Azure Data Factory)Location: Bengaluru/HyderabadMode of Work: HybridNotice Period: 0 to 30 DaysKey Responsibilities:ETL Development & Data Processing:Design, develop, and maintain ETL...

  • Senior Data Engineer- Databricks

    1 week ago

    Bengaluru, Karnataka, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Summary: Design and manage high-performance data pipelines on Databricks Lakehouse, ensuring scalable and optimized data solutions. Key Responsibilities: · Develop and optimize Delta Lake datasets with effective partitioning and indexing. · Build reusable data ingestion and transformation frameworks using Databricks Notebooks, Jobs, and Workflows. ·...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    P-1405At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...