Current jobs related to Pyspark Developer - Hyderabad, Telangana - Tata Consultancy Services

  • Senior PySpark Developer

    4 weeks ago

    Hyderabad, Telangana, India Chiselon Technologies Pvt Ltd Full time

    We are seeking a highly skilled Senior PySpark Developer to join our team at Chiselon Technologies Pvt Ltd.As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing applications using PySpark and Big data technologies.The ideal candidate will have a strong understanding of...

  • Senior PySpark Developer

    1 month ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...

  • Senior PySpark Developer

    3 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    DataEconomy is seeking a highly skilled PySpark Developer to join our dynamic team.About the Role:Design and implement robust metadata-driven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data solutions.Work closely with business stakeholders to understand and translate requirements into technical...

  • Big Data PySpark Developer

    3 weeks ago

    Hyderabad, Telangana, India Techno Wise Full time

    We are seeking a Data Engineering Specialist to join our team at Techno Wise, specializing in designing and building scalable data solutions using PySpark.Roles and ResponsibilitiesDesign, build, and unit test applications in Spark/PysparkIn-depth knowledge of Hadoop, Spark, and similar frameworksAbility to understand existing ETL logic to convert into...

  • Lead PySpark Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Lead PySpark Data EngineerJob Summary:We are seeking a highly skilled Lead PySpark Data Engineer to join our team at Virtusa. The successful candidate will be responsible for developing, enhancing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design, develop, and deploy PySpark applications to process...

  • Data Scientist with PySpark Expertise

    1 month ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. The ideal candidate will have 4-6 years of experience in IT, with a minimum of 3 years of hands-on experience in Python and PySpark. Responsibilities include designing and implementing robust metadata-driven data ingestion pipelines using...

  • Data Scientist

    4 weeks ago

    Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: Remote or Specify LocationJob Summary:Overture Rede Private Limited is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using PySpark. The ideal candidate will have hands-on experience in writing PySpark scripts and managing Spark clusters. Additionally, they should have expertise...

  • {"text": "Big Data Developer with Python Pyspark Expertise","value": "Big Data Developer with Python Pyspark Expertise"}

    4 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    {"text": "Overview:Tata Consultancy Services is seeking a skilled Big Data Developer with expertise in Python Pyspark to join our team. The ideal candidate will have a strong background in data processing, manipulation, and transformation using Spark transformations and actions.Key Responsibilities:Design and develop scalable data processing pipelines using...

  • Data Engineering Expert

    4 weeks ago

    Hyderabad, Telangana, India Risk Resources LLP Full time

    About the RoleWe are seeking a highly skilled Data Engineering Expert to join our team at Risk Resources LLP. As a Pyspark Databricks Developer, you will play a critical role in developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and Develop Data Pipelines: Utilize Pyspark and Databricks...

  • Data Scientist with PySpark Expertise

    1 month ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperAbout the Role:DataEconomy is seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune. As a key member of our team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work...

  • Senior PySpark Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Data Ingestion PipelinesWe're seeking a highly skilled Senior PySpark Data Engineer to design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work closely with business stakeholders to understand and translate requirements into technical...

  • Data Engineer Azure Pyspark

    1 month ago

    Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Work with Delta Lake to ensure data reliability, consistency, and scalability.Utilize Azure Synapse for integrated analytics querying and big data processing.Develop and deploy data solutions on Azure, including data lakes,...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    DataEconomy is seeking a highly skilled Senior Data Engineer - PySpark to join our dynamic team in Hyderabad or Pune. As a key member of our data-driven solutions team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Design and implement data ingestion pipelines using PySpark, collaborating with...

  • PySpark Developer

    2 months ago

    Hyderabad, Telangana, India Incube Consulting Full time

    Salary : 10 - 22 LPAJob Highlights :Role : Pyspark GCP DeveloperJob Type : ContractLocation : HyderabadWork Mode : Hybrid.Please find the JD below :- Your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction.- You will understand requirements, create and review designs, validate...

  • Senior Data Engineer

    1 month ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    DataEconomy is seeking a highly skilled PySpark Developer to join our dynamic team in Hyderabad or Pune. As a key member of our data-driven solutions team, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Collaborate with technical teams to develop innovative data solutions that meet business...

  • Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Data Engineer - Pyspark Databricks SpecialistAbout the RoleRisk Resources LLP is seeking a skilled Data Engineer to join our team. As a Data Engineer - Pyspark Databricks Specialist, you will be responsible for developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and Develop Data...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Risk Resources LLP Full time

    About the RoleWe are seeking a highly skilled Pyspark and Databricks developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will play a crucial role in designing and developing data processing pipelines using Pyspark and Databricks.Key ResponsibilitiesData Pipeline DevelopmentCreate efficient and scalable data...

  • Data Engineer with Expertise in PySpark

    4 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    {"Responsibilities": {"ul": [{"li": "Design and implement robust metadata-driven data ingestion pipelines using PySpark."},{"li": "Collaborate with technical teams to develop innovative data solutions."},{"li": "Work closely with business stakeholders to understand and translate requirements into technical specifications."},{"li": "Conduct unit testing,...

  • Senior Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesJob Title: Digital PysparkLocation: Hyderabad(Face 2 Face interview)Experience Range: 6-10 YearsMinimum Qualification:15 years of full-time educationJob DescriptionMust-HaveAWS Glue/CLI/EMR, Pyspark, Presto, Unix Shell ScriptingGood-to-HaveSAS Base CodeResponsibility of / Expectations from the RoleKnowledge of the key...

  • Senior Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Job SummaryWe are seeking a highly skilled PySpark Developer to join our dynamic team at DataEconomy. The ideal candidate will have a solid understanding of data warehousing concepts and ETL processes, as well as experience in designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key ResponsibilitiesDesign, implement, and...

Pyspark Developer

1 month ago

Hyderabad, Telangana, India Tata Consultancy Services Full time
Job Title: Pyspark Developer

Greetings from Tata Consultancy Services

Job Summary:

We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong knowledge of data architecture, data integration, and data management processes, as well as experience with Spark-SQL and dataframes.

Key Responsibilities:

  • Develop transformation logic in Spark-SQL based on dataframes
  • Design and implement data pipelines using Pyspark
  • Collaborate with cross-functional teams to ensure data quality and integrity
  • Stay up-to-date with the latest advancements in big data and analytics

Requirements:

  • 4-7 years of experience in data and analytics concepts
  • Strong understanding of data architecture, data integration, and data management processes
  • Experience with Spark-SQL and dataframes
  • Knowledge of AWS based services like SageMaker
  • Exposure to DevOps tools like Ansible, Consul, and Puppet

What We Offer:

  • Opportunity to work with a leading consulting firm
  • Collaborative and dynamic work environment
  • Professional growth and development opportunities