Databricks + Pyspark + SQL | 4 to 8 Years | IST Time | Bangalore | Onsite
1 month ago
Job description:
Role: Databricks + Pyspark + SQL
Year of Experience:4-8 Years
Responsibilities:
- Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions.
- Develop and maintain ETL processes using Databricks and PySpark for large-scale data processing.
- Optimize and tune existing data pipelines to ensure optimal performance and scalability.
- Create and implement data quality and validation processes to ensure the accuracy of data.
- Work with stakeholders to understand business needs and translate them into actionable data solutions.
- Collaborate with the data science team to support machine learning model deployment and integration into production systems.
- Troubleshoot and resolve data-related issues promptly.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience working with Databricks, PySpark, and SQL in a professional setting.
- Strong proficiency in designing and optimizing ETL processes for large-scale data sets.
- Experience with data modeling, data warehousing, and database design principles.
- Familiarity with cloud platforms such as AWS, Azure, or GCP.
-
Adb + Pyspark + SQL(Rarr Job 3323)
4 weeks ago
Bengaluru, India RARR Technologies Pvt Ltd Full timeFor LTIMINDTREE - 5 - 8 Years- Full Time- BANGALORE/BENGALURU**Job Skills**: SQL ADB PYSPARK AZURE DATABRICKS SYNAPSE ANALYTICS **Responsibilities**: - Design, develop, and implement end-to-end data pipelines and workflows using Azure Data Factory (ADF). - Write efficient and optimized PySpark code to process and transform large datasets. - Develop and...
-
Databricks
4 weeks ago
Bengaluru, India Hexaware Technologies Full timeLooking for 5+ Yrs of experience Exp Range: 5 to 9 Yrs (Not less than 5 Yrs)Work Location: Bangalore Weekend drive at 20th Apr'24 for 5+ Yrs of expMandatory Skill: Azure, Databricks with Py spark Primary Tech skills – AZURE ,Databricks ,Pyspark, SQLSecondary Tech skills – ADF, SynapseResponsibilities: •Experience in Pyspark, SQL, Cloud data warehouse...
-
Databricks
4 weeks ago
Bengaluru, India Hexaware Technologies Full timeLooking for 5+ Yrs of experience Exp Range: 5 to 9 Yrs (Not less than 5 Yrs)Work Location: Bangalore Weekend drive at 20th Apr'24 for 5+ Yrs of expMandatory Skill: Azure, Databricks with Py spark Primary Tech skills – AZURE ,Databricks ,Pyspark, SQLSecondary Tech skills – ADF, SynapseResponsibilities: •Experience in Pyspark, SQL, Cloud data warehouse...
-
Azure Data Engineer
4 weeks ago
Bengaluru, India Rocket Consulting Full timeTotal Experience : 6+ yrsWork Location : BangaloreRole : Lead ConsultantShift: UK ShiftJob Description :- Relevant experience in Azure data engineering: 4 + years.- Relevant experience in SQL : 4 years.- Mandatory Skills : Databricks, PySpark/Scala/SparkSQL ,Azure Synapse, Data Factory, Azure Data Lake Storage, Azure SQL databases,Azure analysis services-...
-
Databricks Lead
3 weeks ago
Bengaluru, India Hexaware Technologies Full timeDescription:Primary Skills: Databricks with Pyspark, PythonSecondaryskills; ADF7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.4+ years of work experience in Databricks, Pyspark and Python project development workExpertise in Bigdata Eco systems like HDFS and SparkStrong...
-
Tableau Developer
4 weeks ago
Bengaluru, India Sam manpower services & Career LLP Full timeTableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability, considering...
-
Hiring For Data Bricks with Python/Pyspark
1 week ago
Bengaluru/ Bangalore, India timesjobs Full timeHiring For Data Bricks with Python/PysparkData Bricks with Python/PysparkDesired ProfileSkills : Azure: Azure Data Factory, Azure Data Lake Storage, Databricks,Stream Analytics, Azure Functions, Serverless Architecture, ARM Templates,SQL, NoSQL, scripting languages, big data tools: Hadoop, Spark, KafkaExperience : 8 years of experience in a Data Engineer...
-
Data Architect
7 days ago
Bengaluru, India emids Full timeThis is us, your new colleagues! Our organization is based on people and great teamwork. We work at the intersection of design, engineering and domain expertise, our passionate team of problem solvers work closely with customers to blaze new trails that will positively impact the future of health. We are a truly global company, we rely on diversity and...
-
Databricks Solutions Architect
4 weeks ago
Bengaluru, India Huquo Full timeJob Description :- 7+ years of Data engineering experience with 3+ years hands on Databricks (DB) experience.- Should have thorough knowledge in creation of jobs using Pyspark. Should be extremely good with SQL and possess good exposure to Python.- Should be able to create New Clusters , Cluster Pools and attach existing clusters to pool in DB.- Should have...
-
Databricks Lead
4 weeks ago
Bengaluru, India Hexaware Technologies Full timeDescription : Primary Skills: Databricks with Pyspark, Python Secondaryskills; ADF 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools. 4+ years of work experience in Databricks, Pyspark and Python project development work Expertise in Bigdata Eco systems like HDFS and...
-
Senior Data Engineer
2 weeks ago
Bengaluru, India Growel Softech Pvt. Ltd. Full timeJob Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...
-
Python Testing 5-10 Years Exp Ist Time Onsite
4 weeks ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time**About the job Python Testing | 5-10 Years Exp | IST Time | Onsite Bangalore**: **EXP: - 5-10 years** **Mandatory: - Python, selenium, good at basics** **Notice Period: - 15 Days** **Location: - Bangalore (Sarjapura)** **About the Role**: - You will be responsible for development, test automation, and testing as part of a scrum team (Agile). The...
-
Databricks Developer
2 weeks ago
Bengaluru, India VSquare Systems Pvt. Ltd. Full timeJob Description - DatabricksRequired Skills:· 5+ years' experience in PySpark and Python development.-6· 4+ years of experience in SQL and able to write structured and efficient queries on large data sets -· 3+ years of experience in Databricks· 3+ year's design and/or implementation of data pipelines· Must have professional experience in Hadoop.- basic...
-
ETL Data Engineer
2 weeks ago
Bengaluru, India Codersbrain technology pvt ltd Full timeJob Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...
-
Lead - Azure Databricks, Pyspark, SQL
6 days ago
Bengaluru, India Infogain Full timePosition: Lead - Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...
-
Lead - Azure Databricks, Pyspark, SQL
6 days ago
Bengaluru, India Infogain Full timePosition: Lead - Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential...
-
Databricks Developer
3 weeks ago
Bengaluru, India VSquare Systems Pvt. Ltd. Full timeJob Description - Databricks Required Skills:· 5+ years' experience in PySpark and Python development.-6 · 4+ years of experience in SQL and able to write structured and efficient queries on large data sets - · 3+ years of experience in Databricks · 3+ year's design and/or implementation of data pipelines · Must have professional experience in Hadoop.-...
-
Azure Databricks Pyspark Developer
3 weeks ago
Bengaluru, India Tredence Inc. Full timeMUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...
-
Azure Databricks Pyspark Developer
3 weeks ago
Bengaluru, India Tredence Inc. Full timeMUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...
-
Data Engineer
4 weeks ago
Bengaluru, India Career Soft Solutions Full timeJob Description :- 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure Data...