Apache Pyspark

3 days ago


chennai, India Maneva Consulting Pvt. Ltd Full time

GreetingsFromManeva

JobDescription

JobTitle ApachePyspark

LocationChennai

Experience4 10Years

Notice15 30Days

JobRequirements:

Mandatory:Primary skill:Pyspark

Education: B.Tech/M.Tech/MCA

46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data warehousingproject.

Must haveexcellent knowledge in Apache Spark and Python programmingexperience

Deep experiencein developing data processing tasks using PySpark such as readingdata from external sources merging data performing data enrichmentand loading into target datadestinations.

Experience indeployment and operationalizing the code knowledge of schedulingtools

Workingexperience on Cloud technology architecture like AWS ecosystemGoogle Cloud BigQuery etc. is an addedadvantage

Understanding ofUnix/Linux ShellScripting

Good knowledgeof Hadoop Hive and Cloudera/ Hortonworks DataPlatform

Experiencehandling CDC operations for huge volumes ofdata

Shouldunderstand and have operating experience with Agile deliverymethodologies

Should havehandson experience in the following: data validation writing unittestcases

Should haveexperience in integrating PySpark with downstream and upstreamapplications through a batch/realtimeinterface

Should haveexperience in finetuning process and troubleshooting performanceissues

If you are excited tograb this opportunity please apply directly or share your CV at and

Pyspark


  • Apache Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManevaJobDescriptionJobTitleApachePysparkLocationChennaiExperience4 10YearsNotice15 30DaysJobRequirements:Mandatory:Primary skill:PysparkEducation: B.Tech/M.Tech/MCA46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...


  • Chennai, India timesjobs Full time

    **** **Hiring For Apache Spark with Pyspark****** Apache Spark with Pyspark**Desired Profile****Skills :** Pyspark, Big Data, Apache Spark and Python programming, Cloud technology architecture like AWS**Experience:** 4-6 years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration...

  • Apache Pyspark

    3 days ago


    Chennai, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManeva!JobDescriptionJobTitle ApachePyspark LocationChennaiExperience4 10YearsNotice15 30Days JobRequirements: Mandatory:Primary skill:Pyspark Education: B.Tech/M.Tech/MCA 46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...


  • Chennai, Tamil Nadu, India timesjobs Full time

    Hiring For Apache Spark with Pyspark Apache Spark with PysparkDesired ProfileSkills : Pyspark, Big Data, Apache Spark and Python programming, Cloud technology architecture like AWSExperience: 4-6 years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data...


  • Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...


  • Chennai, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign, develop, and deploy scalable data processing applications using Python and PySpark.Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data...

  • Data Streaming

    3 weeks ago


    Chennai, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    3 weeks ago


    Chennai, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...


  • Chennai, India Corporate Resources Full time

    Job DescriptionWork on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream and process datasets at low latencies Show efficiency in...


  • Chennai, Tamil Nadu, India Corporate Resources Full time

    Job Description Work on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream and process datasets at low latencies Show efficiency...


  • chennai, India Corporate Resources Full time

    Job Description Work on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream...

  • Big Data Engineer

    4 weeks ago


    Chennai, India Sysvine Technologies Full time

    Experience: 5 - 8 yearsKey Skills: Hadoop, Pyspark, Python, SQL, HiveLocation: ChennaiNotice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice periodWhat are we looking for?We are looking for experienced Big Data Hadoop Developer expertise with Hadoop, Big Data Ecosystems, Hive,...

  • Senior Data Engineer

    2 months ago


    Chennai, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...


  • Chennai, India Citi Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...

  • Big Data Engineer

    4 weeks ago


    Chennai, India Sysvine Technologies Full time

    Experience: 5 - 8 years Key Skills: Hadoop, Pyspark, Python, SQL, Hive Location: Chennai Notice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice period What are we looking for? We are looking for experienced Big Data Hadoop Developer expertise with Hadoop, Big Data Ecosystems,...

  • Senior Data Engineer

    4 weeks ago


    Mumbai/Chennai, IN Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • Senior Data Engineer

    2 months ago


    Mumbai/Chennai, IN Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...