SSE-AWS Databricks and Pyspark
4 weeks ago
The Role:SSE – AWS Databricks and Pyspark
Key Responsibilities:Develop and maintain data pipelines using AWS Databricks and Big Data technologies.Perform development tasks using Python/Scala, Spark SQL, and DataFrames.Work with Databricks, Data Lake, and SQL to manage and analyze large datasets.Optimize performance, troubleshoot, and debug Spark applications.Utilize AWS services such as S3, Redshift, EC2, and Lambda for data processing and storage.Use DevOps tools like Kubernetes for deployment and scaling.Implement SQL development with a focus on optimization and tuning in Redshift.Develop notebooks (e.g., Jupyter, Databricks, Zeppelin) for data science and analysis.Write scripts in Python and other programming languages for data-related tasks.Collaborate within an Agile Scrum environment to deliver projects.
Skills Required:Strong knowledge and hands-on experience with AWS Databricks.Proficiency in Python/Scala programming, particularly for data processing tasks.Expertise in Spark SQL, DataFrames, and Spark application development.Experience with Big Data pipeline development and deployment.Familiarity with AWS services, including S3, Redshift, EC2, and Lambda.Knowledge of DevOps practices, with experience in Kubernetes for container orchestration.Proficiency in SQL development, including optimization and tuning techniques in Redshift.Hands-on experience with notebooks like Jupyter, Databricks, or Zeppelin.Experience with PySpark for large-scale data processing.Proficiency in scripting languages, including Python and potentially others.
Qualifications & Experience:5+ years of experience in AWS DatabricksBachelor of Engineering (Computer background preferred)
-
SSE-AWS Databricks and Pyspark
4 weeks ago
Bengaluru, India ARA Resources Pvt. Ltd. Full timeAbout The Company: Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...
-
SSE-AWS Databricks and Pyspark
4 weeks ago
Bengaluru, India ARA Resources Pvt. Ltd. Full timeAbout The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...
-
SSE-AWS Databricks and Pyspark
4 weeks ago
Bengaluru, India ARA Resources Pvt. Ltd. Full timeAbout The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...
-
Sse-aws databricks and pyspark
4 weeks ago
Bengaluru, India ARA Resources Pvt. Ltd. Full timeAbout The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...
-
AWS Databricks Pyspark
3 weeks ago
Bengaluru / Bangalore, India Softpath Tech Solutions Private Limited Full timeDescriptionWe are looking for a highly skilled AWS Databricks Pyspark Developer with 5-8 years of experience to join our team in Bangalore ,India. The ideal candidate will have a strong background in developing and maintaining large-scale data processing systems using AWS Databricks and Pyspark.ResponsibilitiesDesign and develop data processing pipelines...
-
AWS Data Engineer
2 months ago
Bengaluru, India AppSierra Solutions Pvt Ltd Full timeDescription :We are seeking a skilled AWS Data Engineer with expertise in Databricks and Pyspark to join our dynamic team. In this crucial role, you will be responsible for designing and implementing big data processing pipelines that efficiently handle and analyze large volumes of data. You will work closely with cross-functional teams to gather...
-
Data Engineer
1 week ago
Bengaluru, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full timeJob Description :We are seeking a highly skilled Data Engineer with a strong focus on hands-on coding to join our growing team. The ideal candidate will have expertise in Databricks, Cloud (Azure or AWS), Pyspark, and Advanced SQL. You will play a key role in developing and optimizing data pipelines, working on large-scale data processing, and ensuring data...
-
Azure Data Engineer
1 month ago
Bengaluru, India Juniper Consultancy Services Full timeWho are we looking for :We are looking for an experienced AWS Data Engineer with expertise in PySpark and Python to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure,leveraging the power of AWS services and big data technologies.Technical Skills : - 8+ years of experience in...
-
Databricks Architect
1 month ago
Bengaluru, India ACL Digital Full time• 5+ years of relevant experience in Databricks / ML Ops• Strong experience with Databricks on AWS and training ML models.• Proficiency in automating workflows using Databricks notebooks and pipelines.• Experience with data extraction and processing using Google BigQuery.• Knowledge of Python, PySpark, and ML libraries (e.g., TensorFlow,...
-
Databricks Architect
1 month ago
Bengaluru, India ACL Digital Full time• 5+ years of relevant experience in Databricks / ML Ops • Strong experience with Databricks on AWS and training ML models. • Proficiency in automating workflows using Databricks notebooks and pipelines. • Experience with data extraction and processing using Google BigQuery. • Knowledge of Python, PySpark, and ML libraries (e.g., TensorFlow,...
-
Databricks Architect
1 month ago
Bengaluru, India ACL Digital Full time• 5+ years of relevant experience in Databricks / ML Ops• Strong experience with Databricks on AWS and training ML models.• Proficiency in automating workflows using Databricks notebooks and pipelines.• Experience with data extraction and processing using Google BigQuery.• Knowledge of Python, PySpark, and ML libraries (e.g., TensorFlow,...
-
Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India Careerhaat Full timeWe are seeking a highly skilled Data Engineering Specialist to join our team at Careerhaat, based in Bengaluru. This is a permanent position with company payroll, offering a competitive salary.Job Description:In this role, you will be instrumental in designing, developing, and maintaining ETL processes using Databricks PySpark to extract, transform, and load...
-
Databricks, Aws
2 months ago
Bengaluru, Karnataka, India Cognizant Full time**Exp: 4 to 13 years** **Skill: Databricks, AWS** **Location : Bangalore/Hyderabad/Kolkota/Pune/Chennai** **Technical Skills**: Apache Spark on Z ,Databricks ,AWS **Roles & Responsibilities **:
-
Azure Databricks, Python/Pyspark, Lambda
1 month ago
Bengaluru, India NR Consulting - India Full timeJob Title: Data EngineerExperience: 5+ yearsLocation: BangaloreSkills: Azure Databricks, Python/Pyspark, Lambda
-
Databricks Developer
2 months ago
Bengaluru, India AppSierra Solutions Pvt Ltd Full timeWe are looking for a data bricks engineer (developer), having strong software development experience of 5 to 7 years on AWS DataBricksTechnical Skills : - Strong knowledge & hands-on experience in AWS Data Bricks - Experience in Devops Kubernetes. - Experience in AWS S3, Redshift, EC2 and Lambda services - Extensive experience in developing and deploying...
-
Data Engineer
2 weeks ago
Bengaluru, India Gainwell Technologies LLC Full timeSummaryWe’re looking for a high-performing and self-motivated Data Engineer with strong Healthcare software solution expertize to join our product development team and drive critical initiatives at Gainwell technologies. This role requires close collaboration with engineering, infrastructure and product teams, and involves ongoing interaction with a...
-
Big Data Architect
6 months ago
Bengaluru, India Databricks Full timeAs a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...
-
Python,pyspark with Aws
6 months ago
Bengaluru, India Natobotics Technologies Private Limited Full time**INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...
-
Databricks Lead Engineer
1 month ago
Bengaluru, India Ara Resources Pvt Ltd Full timeAbout the Company :ARA's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology know how, domain, and process expertise. The accolades that the company has been garnering can be attributed to its undeterred focus on delivering quality...
-
Senior Data Engineer
1 week ago
Bengaluru, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full timeKey Message :We are seeking a dedicated professional with strong hands-on coding skills, a passion for crafting efficient and secure data solutions, and a proven track record in designing scalable data platforms.Primary Responsibilities :- Develop and maintain data solutions on Databricks and cloud platforms (Azure or AWS).- Build and optimize large-scale...