python,pyspark

1 week ago


Hyderabad, India Fusion Plus Solutions Full time

Job Description - Develop and optimize data processing jobs using PySpark for complex transformations and aggregations - Design and implement robust data pipelines on AWS, ensuring scalability and performance - Utilize AWS services like EC2 and S3 for data processing and storage solutions - Manage SQL database schema design, query optimization, and performance tuning - Design and maintain scalable data warehouses using best practices in data modeling and ETL - Leverage modern data platforms for collaborative data science across varied sources - Maintain Databricks clusters and Spark jobs for optimal performance and data quality - Implement security, backup procedures, and disaster recovery plans using AWS best practices - Manage source code and automate deployment via GitHub with CI/CD pipelines - Troubleshoot and optimize PySpark scripts, Databricks notebooks, SQL queries, and Airflow DAGs - Stay current with advancements in cloud data technologies and recommend useful tools - Use Apache Airflow for orchestrating and automating data workflows reliably - Collaborate with data scientists and analysts to build models and pipelines for analytics and ML projects


  • Python pyspark

    4 weeks ago


    Hyderabad, India Virtusa Full time

    Python pyspark - CREQ Description Design and develop on Hadoop applications. Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALA. Experience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance concepts. Experience on source code management with Git repositories. Secondary skills...

  • python,pyspark,aws

    1 week ago


    Hyderabad, India Fusion Plus Solutions Full time

    Job Description Total Yrs. of Experience5+ Relevant Yrs. of experience5 Detailed JD *(Roles and Responsibilities) Strong candidate having Development experience on AWS Glue, Pyspark, S3 bucket, Lambdas, Dynamo, Python and well-versed in AWS Cloud Ecosystem. Troubleshoot expertise in AWS eco system. Glue Job failure troubleshooting and Troubleshooting using...


  • Hyderabad, India DATAMAXIS Full time

    Python Developer with PysparkHyderabadRole - FulltimeAvailability to Join - ImmediateYears of experience - 5+Required skills and qualifications 5+ years of experience as a Python Developer with a strong portfolio of projects. Experience working in Pyspark is must Bachelor's degree in Computer Science, Software Engineering or a related field. ...


  • Hyderabad, India DATAMAXIS Full time

    Python Developer with PysparkHyderabadRole - FulltimeAvailability to Join - ImmediateYears of experience - 5+Required skills and qualifications 5+ years of experience as a Python Developer with a strong portfolio of projects. Experience working in Pyspark is must Bachelor's degree in Computer Science, Software Engineering or a related field....


  • Hyderabad, Telangana, India NTT DATA Full time

    **Req ID**: 327063 We are currently seeking a python,pySpark,ApacheSpark to join our team in Hyderabad, Telangana (IN-TG), India (IN). "At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market presence and our ability to help our...


  • Hyderabad, Telangana, India Nisum Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company DescriptionNisum is a global consulting partner specializing in digital commerce and evolution, offering AI-powered platforms and tailor-made solutions to unlock growth, optimize operations, and create long-term value. With over 25 years of proven experience, Nisum has a consistent track record of delivering complex digital transformations for...


  • Hyderabad, India Fusion Plus Solutions Full time

    Job Description Roles and Responsibilities - 5+ years of experience on IT industry in Data Engineering & Data Analyst role. - 5 years of development experience using tool Databricks and PySpark, Python, SQL - Proficient in writing SQL queries including writing of windows functions - Good communication skills with analytical abilities in doing problem solving...


  • Hyderabad, India Xpetize Full time

    **Years of Experience : 3+** Years** **Joining Time frame **:immediate to 1 Week** **Positions: 4** **Mandatory skills**: **Mandatory skills**: - Experience in Python/Pyspark/Scala - SQL - GCP/AWS/Azure - Hadoop / HDFS/Other Databases - Airflow/Other Automation tools - Linux/ Bash scripting - Kafka/Flume/Kinesis/Data Streaming **Job Type : Full...


  • Hyderabad, India Fusion Plus Solutions Full time

    Job Description We are seeking an experienced and motivated Senior Data Engineer with strong expertise in Python, PySpark, Azure Databricks, and Azure Data Factory (ADF). The ideal candidate will design and implement scalable data pipelines and play a key role in enabling data-driven decision-making by integrating data across various sources. Key...


  • Hyderabad, Telangana, India MatchPoint Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Type: PermanentLocation: Hyderabad (5 Days Onsite)Experience RequiredJob Description:We are seeking a skilledData Engineerwith strong expertise inPySpark Quries, Python programming, and Data Structures & Algorithms (DSA). The ideal candidate will design and optimize large-scale data pipelines, write efficient and scalable code, and solve complex data...