SSE-AWS Databricks and Pyspark

4 weeks ago


Bengaluru, India ARA Resources Pvt. Ltd. Full time

About The Company:

Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across verticals that meet the challenging requirements of their esteemed customers has been recently felicitated by the Economic Times as the most distinguished digital company 2015. They have also been ranked 29 of 100 largest financial technology vendors by American Banker and BAI in the FinTech Forward Top 100 rankings.


The Role:

SSE – AWS Databricks and Pyspark


Key Responsibilities:

  • Develop and maintain data pipelines using AWS Databricks and Big Data technologies.
  • Perform development tasks using Python/Scala, Spark SQL, and DataFrames.
  • Work with Databricks, Data Lake, and SQL to manage and analyze large datasets.
  • Optimize performance, troubleshoot, and debug Spark applications.
  • Utilize AWS services such as S3, Redshift, EC2, and Lambda for data processing and storage.
  • Use DevOps tools like Kubernetes for deployment and scaling.
  • Implement SQL development with a focus on optimization and tuning in Redshift.
  • Develop notebooks (e.g., Jupyter, Databricks, Zeppelin) for data science and analysis.
  • Write scripts in Python and other programming languages for data-related tasks.
  • Collaborate within an Agile Scrum environment to deliver projects.


Skills Required:

  • Strong knowledge and hands-on experience with AWS Databricks.
  • Proficiency in Python/Scala programming, particularly for data processing tasks.
  • Expertise in Spark SQL, DataFrames, and Spark application development.
  • Experience with Big Data pipeline development and deployment.
  • Familiarity with AWS services, including S3, Redshift, EC2, and Lambda.
  • Knowledge of DevOps practices, with experience in Kubernetes for container orchestration.
  • Proficiency in SQL development, including optimization and tuning techniques in Redshift.
  • Hands-on experience with notebooks like Jupyter, Databricks, or Zeppelin.
  • Experience with PySpark for large-scale data processing.
  • Proficiency in scripting languages, including Python and potentially others.


Qualifications & Experience:

  • 5+ years of experience in AWS Databricks
  • Bachelor of Engineering (Computer background preferred)



  • Bengaluru, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...


  • Bengaluru, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...


  • Bengaluru, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...


  • Bengaluru, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...


  • Bengaluru, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...


  • Bengaluru / Bangalore, India Softpath Tech Solutions Private Limited Full time

    DescriptionWe are looking for a highly skilled AWS Databricks Pyspark Developer with 5-8 years of experience to join our team in Bangalore ,India. The ideal candidate will have a strong background in developing and maintaining large-scale data processing systems using AWS Databricks and Pyspark.ResponsibilitiesDesign and develop data processing pipelines...

  • AWS Data Engineer

    2 months ago


    Bengaluru, India AppSierra Solutions Pvt Ltd Full time

    Description :We are seeking a skilled AWS Data Engineer with expertise in Databricks and Pyspark to join our dynamic team. In this crucial role, you will be responsible for designing and implementing big data processing pipelines that efficiently handle and analyze large volumes of data. You will work closely with cross-functional teams to gather...

  • Data Engineer

    1 week ago


    Bengaluru, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Job Description :We are seeking a highly skilled Data Engineer with a strong focus on hands-on coding to join our growing team. The ideal candidate will have expertise in Databricks, Cloud (Azure or AWS), Pyspark, and Advanced SQL. You will play a key role in developing and optimizing data pipelines, working on large-scale data processing, and ensuring data...

  • Azure Data Engineer

    1 month ago


    Bengaluru, India Juniper Consultancy Services Full time

    Who are we looking for :We are looking for an experienced AWS Data Engineer with expertise in PySpark and Python to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure,leveraging the power of AWS services and big data technologies.Technical Skills : - 8+ years of experience in...

  • Databricks Architect

    1 month ago


    Bengaluru, India ACL Digital Full time

    • 5+ years of relevant experience in Databricks / ML Ops• Strong experience with Databricks on AWS and training ML models.• Proficiency in automating workflows using Databricks notebooks and pipelines.• Experience with data extraction and processing using Google BigQuery.• Knowledge of Python, PySpark, and ML libraries (e.g., TensorFlow,...

  • Databricks Architect

    1 month ago


    Bengaluru, India ACL Digital Full time

    • 5+ years of relevant experience in Databricks / ML Ops• Strong experience with Databricks on AWS and training ML models.• Proficiency in automating workflows using Databricks notebooks and pipelines.• Experience with data extraction and processing using Google BigQuery.• Knowledge of Python, PySpark, and ML libraries (e.g., TensorFlow,...

  • Databricks Architect

    1 month ago


    Bengaluru, India ACL Digital Full time

    • 5+ years of relevant experience in Databricks / ML Ops • Strong experience with Databricks on AWS and training ML models. • Proficiency in automating workflows using Databricks notebooks and pipelines. • Experience with data extraction and processing using Google BigQuery. • Knowledge of Python, PySpark, and ML libraries (e.g., TensorFlow,...


  • Bengaluru, Karnataka, India Careerhaat Full time

    We are seeking a highly skilled Data Engineering Specialist to join our team at Careerhaat, based in Bengaluru. This is a permanent position with company payroll, offering a competitive salary.Job Description:In this role, you will be instrumental in designing, developing, and maintaining ETL processes using Databricks PySpark to extract, transform, and load...

  • Databricks, Aws

    2 months ago


    Bengaluru, Karnataka, India Cognizant Full time

    **Exp: 4 to 13 years** **Skill: Databricks, AWS** **Location : Bangalore/Hyderabad/Kolkota/Pune/Chennai** **Technical Skills**: Apache Spark on Z ,Databricks ,AWS **Roles & Responsibilities **:


  • Bengaluru, India NR Consulting - India Full time

    Job Title: Data EngineerExperience: 5+ yearsLocation: BangaloreSkills: Azure Databricks, Python/Pyspark, Lambda

  • Databricks Developer

    2 months ago


    Bengaluru, India AppSierra Solutions Pvt Ltd Full time

    We are looking for a data bricks engineer (developer), having strong software development experience of 5 to 7 years on AWS DataBricksTechnical Skills : - Strong knowledge & hands-on experience in AWS Data Bricks - Experience in Devops Kubernetes. - Experience in AWS S3, Redshift, EC2 and Lambda services - Extensive experience in developing and deploying...

  • Data Engineer

    2 weeks ago


    Bengaluru, India Gainwell Technologies LLC Full time

    SummaryWe’re looking for a high-performing and self-motivated Data Engineer with strong Healthcare software solution expertize to join our product development team and drive critical initiatives at Gainwell technologies. This role requires close collaboration with engineering, infrastructure and product teams, and involves ongoing interaction with a...

  • Big Data Architect

    6 months ago


    Bengaluru, India Databricks Full time

    As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...


  • Bengaluru, India Ara Resources Pvt Ltd Full time

    About the Company :ARA's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology know how, domain, and process expertise. The accolades that the company has been garnering can be attributed to its undeterred focus on delivering quality...


  • Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...