SSE-AWS Databricks and Pyspark

3 weeks ago


bangalore, India ARA Resources Pvt. Ltd. Full time

About The Company:

Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across verticals that meet the challenging requirements of their esteemed customers has been recently felicitated by the Economic Times as the most distinguished digital company 2015. They have also been ranked 29 of 100 largest financial technology vendors by American Banker and BAI in the FinTech Forward Top 100 rankings.

The Role:

SSE – AWS Databricks and Pyspark

Key Responsibilities:

- Develop and maintain data pipelines using AWS Databricks and Big Data technologies.
- Perform development tasks using Python/Scala, Spark SQL, and DataFrames.
- Work with Databricks, Data Lake, and SQL to manage and analyze large datasets.
- Optimize performance, troubleshoot, and debug Spark applications.
- Utilize AWS services such as S3, Redshift, EC2, and Lambda for data processing and storage.
- Use DevOps tools like Kubernetes for deployment and scaling.
- Implement SQL development with a focus on optimization and tuning in Redshift.
- Develop notebooks (e.g., Jupyter, Databricks, Zeppelin) for data science and analysis.
- Write scripts in Python and other programming languages for data-related tasks.
- Collaborate within an Agile Scrum environment to deliver projects.

Skills Required:

- Strong knowledge and hands-on experience with AWS Databricks.
- Proficiency in Python/Scala programming, particularly for data processing tasks.
- Expertise in Spark SQL, DataFrames, and Spark application development.
- Experience with Big Data pipeline development and deployment.
- Familiarity with AWS services, including S3, Redshift, EC2, and Lambda.
- Knowledge of DevOps practices, with experience in Kubernetes for container orchestration.
- Proficiency in SQL development, including optimization and tuning techniques in Redshift.
- Hands-on experience with notebooks like Jupyter, Databricks, or Zeppelin.
- Experience with PySpark for large-scale data processing.
- Proficiency in scripting languages, including Python and potentially others.

Qualifications & Experience:

- 5+ years of experience in AWS Databricks
- Bachelor of Engineering (Computer background preferred)



  • bangalore, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...


  • Bangalore, India ARA Resources Pvt. Ltd. Full time

    About The Company: Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions...


  • Bangalore, India ARA Resources Pvt. Ltd. Full time

    About The Company: Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions...


  • Bangalore, India ARA Resources Pvt. Ltd. Full time

    About The Company: Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions...


  • bangalore, India ARA Resources Pvt. Ltd. Full time

    About The Company: Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...


  • bangalore, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...


  • Bengaluru / Bangalore, India Softpath Tech Solutions Private Limited Full time

    DescriptionWe are looking for a highly skilled AWS Databricks Pyspark Developer with 5-8 years of experience to join our team in Bangalore ,India. The ideal candidate will have a strong background in developing and maintaining large-scale data processing systems using AWS Databricks and Pyspark.ResponsibilitiesDesign and develop data processing pipelines...

  • AWS Data Engineer

    1 month ago


    Bangalore/Hyderabad, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    Description :We are seeking a skilled AWS Data Engineer with expertise in Databricks and Pyspark to join our dynamic team. In this crucial role, you will be responsible for designing and implementing big data processing pipelines that efficiently handle and analyze large volumes of data. You will work closely with cross-functional teams to gather...

  • Databricks Architect

    4 weeks ago


    bangalore, India ACL Digital Full time

    • 5+ years of relevant experience in Databricks / ML Ops • Strong experience with Databricks on AWS and training ML models. • Proficiency in automating workflows using Databricks notebooks and pipelines. • Experience with data extraction and processing using Google BigQuery. • Knowledge of Python, PySpark, and ML libraries (e.g., TensorFlow,...

  • Databricks Architect

    4 weeks ago


    bangalore, India ACL Digital Full time

    • 5+ years of relevant experience in Databricks / ML Ops• Strong experience with Databricks on AWS and training ML models.• Proficiency in automating workflows using Databricks notebooks and pipelines.• Experience with data extraction and processing using Google BigQuery.• Knowledge of Python, PySpark, and ML libraries (e.g., TensorFlow,...

  • Databricks Developer

    1 month ago


    Bangalore, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    We are looking for a data bricks engineer (developer), having strong software development experience of 5 to 7 years on AWS DataBricksTechnical Skills : - Strong knowledge & hands-on experience in AWS Data Bricks - Experience in Devops Kubernetes. - Experience in AWS S3, Redshift, EC2 and Lambda services - Extensive experience in developing and deploying...

  • Pyspark Developer

    3 weeks ago


    bangalore, India SourceBae Full time

    Job Title:Senior Pyspark DeveloperJob Description:5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine.We are seeking a skilled PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using PySpark. Additionally,...

  • Databricks

    3 weeks ago


    bangalore, India Deloitte Full time

    Location: Bangalore, Pune and MumbaiNeed to be available for F2F in above locations for interviewsEvery day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance.As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to succeed...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, India Mouri Tech (P) Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, : - Minimum of 6-9 Experience with the core AWS Services and setting...

  • Databricks

    3 weeks ago


    bangalore, India Deloitte Full time

    Location: Bangalore, Pune and Mumbai Need to be available for F2F in above locations for interviews Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to...

  • Pyspark developer

    2 weeks ago


    Bangalore, India SourceBae Full time

    Job Title: Senior Pyspark Developer Job Description: 5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine. We are seeking a skilled Py Spark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using Py Spark....

  • AWS Engineer

    2 months ago


    Bangalore, Karnataka, India One Degree North HR Services Full time

    Requirements : - Minimum 5 years of experience with AWS development. - Hands-on experience in Technical skills especially AWS Glue, Pyspark programming, and Postgres SQL. - Strong exposure to Relational Databases, i. e. MS SQL and Postgres SQL. - Good in SQL, PL/SQL, DDL, and DML Commands. - Hands-on experience in AWS services i. e. AWS Glue, SCT, DMS,...


  • bangalore, India SourceBae Full time

    Job Title: Senior Pyspark Developer Job Description: 5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine. We are seeking a skilled PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using PySpark. Additionally,...


  • Bangalore, India AppSierra Solutions Pvt Ltd Full time

    Data Engineer Opportunities at AppSierra Solutions Pvt LtdWe are seeking a skilled Data Engineer with experience in AWS DataBricks to join our team. The ideal candidate will have strong software development skills, with a focus on developing and deploying Big Data pipelines using AWS DataBricks.Key Skills:Strong knowledge and hands-on experience in AWS Data...