PySpark Developers

5 months ago

Hyderabad, India Techno Wise Full time

We are looking for a PySpark developer ( with ETL background ) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems.

Roles and Responsibilities

Ability to design, build and unit test the application in Spark/Pyspark In-depth knowledge of Hadoop, Spark, and similar frameworks Ability to understand existing ETL logic to convert into Spark/PySpark Good implementation experience of oops concepts Knowledge of Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources Experience in working with Bitbucket and CI-CD process Have knowledge of the agile methodology for delivering the projects Good communication skills

Skills

Minimum 2 years of extensive experience in design, build and deployment of PySpark-based applications Expertise in handling complex large-scale Big Data environments Minimum 2 years of experience in the following: HIVE, YARN, HDFS Experience in working in ETL products e.g. Ab Initio, Informatica, Data Stage etc. Hands-on experience writing complex SQL queries, exporting, and importing large amounts of data using utilities

Experience: 6  to 10 Years  (EARLY JOINERS ONLY)

Location: Pune OR Chennai OR Hyderabad

Note: We can even consider someone with good hands-on experience in Spark and Scala.

  • PySpark Developer

    4 weeks ago

    Hyderabad, Telangana, India Techno Wise Full time

    Job Title: PySpark DeveloperJob Description:We are seeking a skilled PySpark developer to join our team at Techno Wise. As a PySpark developer, you will be responsible for designing, building, and deploying scalable data processing solutions using PySpark.Key Responsibilities:Design and develop efficient data processing pipelines using PySparkDevelop and...

  • PySpark Developer

    4 weeks ago

    Hyderabad, Telangana, India Synechron Full time

    Job Title: PySpark DeveloperWe are seeking a highly skilled PySpark Developer to join our team at Synechron. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark and GCP.Key Responsibilities:Design and develop scalable data processing systems using PySpark and GCPDevelop...

  • PySpark Developer

    4 weeks ago

    hyderabad, India DATAECONOMY Full time

    Join DataEconomy and be part of a dynamic team driving datadriven solutions. Were seeking highly skilled PySpark developers with 46 years of experience to join our team in Hyderabad or Pune.Responsibilities:Design and implement robust metadatadriven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data...

  • PySpark Developer

    1 month ago

    Hyderabad, India DATAECONOMY Full time

    Join DataEconomy and be part of a dynamic team driving datadriven solutions. Were seeking highly skilled PySpark developers with 46 years of experience to join our team in Hyderabad or Pune.Responsibilities:Design and implement robust metadatadriven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data...

  • PySpark Developer

    3 weeks ago

    hyderabad, India DATAECONOMY Full time

    Join DataEconomy and be part of a dynamic team driving datadriven solutions. Were seeking highly skilled PySpark developers with 46 years of experience to join our team in Hyderabad or Pune.Responsibilities: Design and implement robust metadatadriven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data...

  • PySpark Developer

    1 month ago

    Hyderabad, India DATAECONOMY Full time

    Job DescriptionJoin DataEconomy and be part of a dynamic team driving data-driven solutions. We're seeking highly skilled PySpark developers with 4-6 years of experience to join our team in Hyderabad or Pune.Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark.Collaborate with technical teams to develop...

  • PySpark Developer

    4 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperWe are seeking a highly skilled PySpark developer to join our dynamic team at DataEconomy in Hyderabad or Pune.Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data solutions.Work closely with business stakeholders to...

  • PySpark Developer

    4 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperDATAECONOMY is seeking a highly skilled PySpark developer to join our dynamic team driving data-driven solutions. With 4-6 years of experience in IT, you will design and implement robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data...

  • Pyspark Developer

    4 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Pyspark DeveloperGreetings from Tata Consultancy ServicesJob Summary:We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong expertise in data architecture, data integration, and data management processes, with the ability to develop transformation logic in Spark-SQL based on dataframes.Key...

  • PySpark Developer

    3 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark DeveloperWe are seeking a highly skilled PySpark developer to join our dynamic team at DataEconomy. As a key member of our team, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Responsibilities:Collaborate with technical teams to develop innovative data solutions.Work...

  • PySpark Developer

    3 weeks ago

    Hyderabad, India Incube Consulting Full time

    Job HighlightsRole: Pyspark GCP DeveloperJob Type: ContractLocation: HyderabadWork Mode: HybridAs a Pyspark GCP Developer at Incube Consulting, you will be responsible for interfacing with clients to ensure high customer satisfaction, understanding requirements, creating and reviewing designs, validating architecture, and providing high levels of service...

  • PySpark Developer

    4 weeks ago

    Hyderabad, India Incube Consulting Full time

    Job SummaryWe are seeking a highly skilled PySpark Developer to join our team at Incube Consulting. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark.Key ResponsibilitiesInterface with clients to ensure high-quality deliverables and excellent...

  • Pyspark Developer

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Pyspark DeveloperGreetings from Tata Consultancy ServicesJob Summary:We are seeking a highly skilled Pyspark Developer to join our team. The ideal candidate will have strong knowledge of data architecture, data integration, and data management processes, as well as experience with Spark-SQL and dataframes.Key Responsibilities:Develop...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark and Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using Azure...

  • PySpark Developer

    1 month ago

    Hyderabad, India DATAECONOMY Full time

    Join DataEconomy and be part of a dynamic team driving data-driven solutions. We're seeking highly skilled PySpark developers with 4-6 years of experience to join our team in Hyderabad or Pune.Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark.Collaborate with technical teams to develop innovative data...

  • PySpark Developer

    3 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Unlock Your Potential as a Data Ecosystem ArchitectAt DataEconomy, we're on a mission to revolutionize the way we harness data-driven insights. We're seeking a highly skilled PySpark developer to join our dynamic team in Hyderabad or Pune.Key Responsibilities:Design and implement robust metadata-driven data ingestion pipelines using PySpark, ensuring...

  • PySpark Developer

    3 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a key member of our Agile team, you will be responsible for designing, developing, and maintaining large-scale PySpark-based data pipelines using Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using...

  • PySpark Developer

    4 weeks ago

    Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Title: PySpark DeveloperAbout the Role:We are seeking a highly skilled PySpark Developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for our Data warehousing...

  • PySpark Developer

    3 months ago

    Hyderabad, India Chiselon Technologies Pvt Ltd Full time

    #Hiring Alert#We are looking for our client!Job Title: PySpark Developer Location: Remote Job Type: Full-Time Experience: 5 7 yearsNotice Period: Immediate Joiner, Currently Serving Notice period Qualifications and SkillsProficiency in Python (Mandatory skill) with a strong understanding of its libraries and frameworks.Experience with PySpark (Mandatory...

  • PySpark Developer

    3 weeks ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: Data Ingestion SpecialistWe are seeking a highly skilled Data Ingestion Specialist to join our team at DataEconomy in Hyderabad or Pune. As a key member of our dynamic team, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Design and implement data ingestion...