Databricks + Pyspark + SQL | 4 to 8 Years | IST Time | Bangalore | Onsite

1 month ago


Bengaluru, India PradeepIT Consulting Services Pvt Ltd Full time

Job description:

Role: Databricks + Pyspark + SQL

Year of Experience:4-8 Years

Responsibilities:

  1. Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions.
  2. Develop and maintain ETL processes using Databricks and PySpark for large-scale data processing.
  3. Optimize and tune existing data pipelines to ensure optimal performance and scalability.
  4. Create and implement data quality and validation processes to ensure the accuracy of data.
  5. Work with stakeholders to understand business needs and translate them into actionable data solutions.
  6. Collaborate with the data science team to support machine learning model deployment and integration into production systems.
  7. Troubleshoot and resolve data-related issues promptly.

Requirements:

  1. Bachelor's degree in Computer Science, Engineering, or a related field.
  2. Proven experience   working with Databricks, PySpark, and SQL in a professional setting.
  3. Strong proficiency in designing and optimizing ETL processes for large-scale data sets.
  4. Experience with data modeling, data warehousing, and database design principles.
  5. Familiarity with cloud platforms such as AWS, Azure, or GCP.


  • Bengaluru, India RARR Technologies Pvt Ltd Full time

    For LTIMINDTREE - 5 - 8 Years- Full Time- BANGALORE/BENGALURU**Job Skills**: SQL ADB PYSPARK AZURE DATABRICKS SYNAPSE ANALYTICS **Responsibilities**: - Design, develop, and implement end-to-end data pipelines and workflows using Azure Data Factory (ADF). - Write efficient and optimized PySpark code to process and transform large datasets. - Develop and...

  • Databricks

    4 weeks ago


    Bengaluru, India Hexaware Technologies Full time

    Looking for 5+ Yrs of experience Exp Range: 5 to 9 Yrs (Not less than 5 Yrs)Work Location: Bangalore Weekend drive at 20th Apr'24 for 5+ Yrs of expMandatory Skill: Azure, Databricks with Py spark Primary Tech skills – AZURE ,Databricks ,Pyspark, SQLSecondary Tech skills – ADF, SynapseResponsibilities: •Experience in Pyspark, SQL, Cloud data warehouse...

  • Databricks

    4 weeks ago


    Bengaluru, India Hexaware Technologies Full time

    Looking for 5+ Yrs of experience Exp Range: 5 to 9 Yrs (Not less than 5 Yrs)Work Location: Bangalore Weekend drive at 20th Apr'24 for 5+ Yrs of expMandatory Skill: Azure, Databricks with Py spark Primary Tech skills – AZURE ,Databricks ,Pyspark, SQLSecondary Tech skills – ADF, SynapseResponsibilities: •Experience in Pyspark, SQL, Cloud data warehouse...

  • Azure Data Engineer

    4 weeks ago


    Bengaluru, India Rocket Consulting Full time

    Total Experience : 6+ yrsWork Location : BangaloreRole : Lead ConsultantShift: UK ShiftJob Description :- Relevant experience in Azure data engineering: 4 + years.- Relevant experience in SQL : 4 years.- Mandatory Skills : Databricks, PySpark/Scala/SparkSQL ,Azure Synapse, Data Factory, Azure Data Lake Storage, Azure SQL databases,Azure analysis services-...

  • Databricks Lead

    3 weeks ago


    Bengaluru, India Hexaware Technologies Full time

    Description:Primary Skills: Databricks with Pyspark, PythonSecondaryskills; ADF7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.4+ years of work experience in Databricks, Pyspark and Python project development workExpertise in Bigdata Eco systems like HDFS and SparkStrong...

  • Tableau Developer

    4 weeks ago


    Bengaluru, India Sam manpower services & Career LLP Full time

    Tableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability, considering...


  • Bengaluru/ Bangalore, India timesjobs Full time

    Hiring For Data Bricks with Python/PysparkData Bricks with Python/PysparkDesired ProfileSkills : Azure: Azure Data Factory, Azure Data Lake Storage, Databricks,Stream Analytics, Azure Functions, Serverless Architecture, ARM Templates,SQL, NoSQL, scripting languages, big data tools: Hadoop, Spark, KafkaExperience : 8 years of experience in a Data Engineer...

  • Data Architect

    7 days ago


    Bengaluru, India emids Full time

    This is us, your new colleagues! Our organization is based on people and great teamwork. We work at the intersection of design, engineering and domain expertise, our passionate team of problem solvers work closely with customers to blaze new trails that will positively impact the future of health. We are a truly global company, we rely on diversity and...


  • Bengaluru, India Huquo Full time

    Job Description :- 7+ years of Data engineering experience with 3+ years hands on Databricks (DB) experience.- Should have thorough knowledge in creation of jobs using Pyspark. Should be extremely good with SQL and possess good exposure to Python.- Should be able to create New Clusters , Cluster Pools and attach existing clusters to pool in DB.- Should have...

  • Databricks Lead

    4 weeks ago


    Bengaluru, India Hexaware Technologies Full time

    Description : Primary Skills: Databricks with Pyspark, Python Secondaryskills; ADF 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools. 4+ years of work experience in Databricks, Pyspark and Python project development work Expertise in Bigdata Eco systems like HDFS and...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job Python Testing | 5-10 Years Exp | IST Time | Onsite Bangalore**: **EXP: - 5-10 years** **Mandatory: - Python, selenium, good at basics** **Notice Period: - 15 Days** **Location: - Bangalore (Sarjapura)** **About the Role**: - You will be responsible for development, test automation, and testing as part of a scrum team (Agile). The...

  • Databricks Developer

    2 weeks ago


    Bengaluru, India VSquare Systems Pvt. Ltd. Full time

    Job Description - DatabricksRequired Skills:· 5+ years' experience in PySpark and Python development.-6· 4+ years of experience in SQL and able to write structured and efficient queries on large data sets -· 3+ years of experience in Databricks· 3+ year's design and/or implementation of data pipelines· Must have professional experience in Hadoop.- basic...

  • ETL Data Engineer

    2 weeks ago


    Bengaluru, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...


  • Bengaluru, India Infogain Full time

    Position: Lead - Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...


  • Bengaluru, India Infogain Full time

    Position: Lead - Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...

  • Databricks Developer

    3 weeks ago


    Bengaluru, India VSquare Systems Pvt. Ltd. Full time

    Job Description - Databricks Required Skills:· 5+ years' experience in PySpark and Python development.-6 · 4+ years of experience in SQL and able to write structured and efficient queries on large data sets - · 3+ years of experience in Databricks · 3+ year's design and/or implementation of data pipelines · Must have professional experience in Hadoop.-...


  • Bengaluru, India Tredence Inc. Full time

    MUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...


  • Bengaluru, India Tredence Inc. Full time

    MUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...

  • Data Engineer

    4 weeks ago


    Bengaluru, India Career Soft Solutions Full time

    Job Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...