Pyspark Developer

2 weeks ago


Hyderabad, Telangana, India Tata Consultancy Services Full time
Job Title: Pyspark Developer

Greetings from Tata Consultancy Services

Job Summary:

We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong expertise in data architecture, data integration, and data management processes, with the ability to develop transformation logic in Spark-SQL based on dataframes.

Key Responsibilities:

  • Design and develop scalable data pipelines using Pyspark
  • Develop and maintain complex data transformations using Spark-SQL
  • Collaborate with cross-functional teams to integrate data into business applications
  • Optimize data processing and storage using AWS Glue and EMR

Requirements:

  • 4-7 years of experience in data and analytics concepts, including Big Data, Hadoop, Hive, Impala, Sqoop, and oozie
  • Strong understanding of data architecture, data integration, and data management processes
  • Proficiency in Pyspark, Scala, and Cloud concepts
  • Experience with DevOps tools, such as Ansible, Consul, and Puppet

Preferred Qualifications:

  • Experience with AWS-based services, such as SageMaker
  • Knowledge of software development methodologies and the software delivery lifecycle

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India Techno Wise Full time

    Job Title: PySpark DeveloperJob Description:We are seeking a skilled PySpark developer to join our team at Techno Wise. As a PySpark developer, you will be responsible for designing, building, and deploying scalable data processing solutions using PySpark.Key Responsibilities:Design and develop efficient data processing pipelines using PySparkDevelop and...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India Synechron Full time

    Job Title: PySpark DeveloperWe are seeking a highly skilled PySpark Developer to join our team at Synechron. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark and GCP.Key Responsibilities:Design and develop scalable data processing systems using PySpark and GCPDevelop...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperDATAECONOMY is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. With 4-6 years of experience in IT, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperWe are seeking a highly skilled PySpark developer to join our dynamic team at DataEconomy in Hyderabad or Pune.Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data solutions.Work closely with business stakeholders to...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperWe are seeking a highly skilled PySpark developer to join our dynamic team at DataEconomy. As a key member of our team, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work...

  • Pyspark Developer

    2 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Pyspark DeveloperGreetings from Tata Consultancy ServicesJob Summary:We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong knowledge of data architecture, data integration, and data management processes, as well as experience with Spark-SQL and dataframes.Key Responsibilities:Develop...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India DATAECONOMY Full time

    Unlock Your Potential as a Data Ecosystem ArchitectAt DataEconomy, we're on a mission to revolutionize the way we harness data-driven insights. We're seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune.Key Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark, ensuring...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: Data Ingestion SpecialistWe are seeking a highly skilled Data Ingestion Specialist to join our team at DataEconomy in Hyderabad or Pune. As a key member of our dynamic team, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Design and implement data ingestion...


  • Hyderabad, Telangana, India Chiselon Technologies Pvt Ltd Full time

    We are seeking a highly skilled Senior PySpark Developer to join our team at Chiselon Technologies Pvt Ltd.As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing applications using PySpark and Big data technologies.The ideal candidate will have a strong understanding of...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...

  • Pyspark SQL Developer

    2 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Pyspark SQL DeveloperWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.Key Responsibilities:Design and...


  • Hyderabad, Telangana, India Risk Resources LLP Full time

    About the RoleWe are seeking a highly skilled Pyspark Databricks developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop efficient data processing pipelines...

  • Pyspark+SQL Developer

    2 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Pyspark+SQL DeveloperWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines. This role involves working on...

  • Pyspark+SQL Developer

    2 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job SummaryWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development to join our team at Alignity Solutions. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.Key...


  • Hyderabad, Telangana, India HTC Global Services Full time

    Job Opportunity: PySpark with DataBricksWe are seeking a highly skilled PySpark developer with experience in Databricks to join our team at HTC Global Services.Key Responsibilities:Design and develop data pipelines using PySpark and DatabricksEnsure data quality and manage data life cyclesDevelop ETL processes using PySpark and DatabricksCollaborate with...


  • Hyderabad, Telangana, India HTC Global Services Full time

    Job Title: PySpark with Azure DatabricksWe are seeking a highly skilled PySpark developer with experience in Azure Databricks to join our team at HTC Global Services.About the Role:We are looking for a talented individual who can design and develop data pipelines using PySpark and Databricks. The ideal candidate will have a strong understanding of data...

  • PySpark Engineer

    2 weeks ago


    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperAbout the Role:DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Collaborate with technical teams to develop innovative data solutions...

  • Pyspark+SQL Developer

    2 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    About the RoleWe are seeking an experienced professional with a strong background in distributed systems, data engineering, and software development to join our team at Alignity Solutions. The ideal candidate will possess hands-on expertise in working with Hadoop, Spark, SQL, and PySpark, along with experience in designing optimized data pipelines.Key...


  • Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Pyspark Databricks EngineerJob Summary:We are seeking a highly skilled Pyspark Databricks Engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark and Databricks, optimizing and tuning the performance of Spark jobs and clusters, and...


  • Hyderabad, Telangana, India Risk Resources LLP Full time

    Job SummaryWe are seeking a highly skilled Pyspark Databricks engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and...