Pyspark Developer

2 days ago


All India Infosys Full time ₹ 2,00,000 - ₹ 6,00,000 per year

As an experienced professional with over 5 years of experience, your role will primarily involve working with Pyspark, Spark, and proficient in SQL. You will be responsible for creating, deploying, maintaining, and debugging data pipelines using Spark and Hadoop Ecosystems to handle large amounts of big data. Your key responsibilities will include: - Handling data pipeline creation, deployment, maintenance, and debugging using Pyspark and Spark with Hadoop distributed frameworks - Scheduling and monitoring jobs while creating tools for automation - Utilizing Scala and Python for at least 4 years to support data processing tasks - Demonstrating proficient knowledge of SQL with any RDBMS - Communicating effectively (verbally and in writing) across teams, both internally and externally, at all levels - Working within deadlines, effectively prioritizing tasks, and executing them in a timely manner Preferred qualifications for this role include: - At least 1 year of AWS development experience - Experience in driving automations - DevOps knowledge is an added advantage This summary provides an overview of the key responsibilities and qualifications required for the position.,


  • Pyspark Developer

    22 hours ago


    india Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring forPyspark DeveloperRequired Skill Set:Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range:4 to 10 Years Job Location:Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have: Data Engineer, Python developer with specialty in Pandas...


  • India DigiHelic Solutions Pvt. Ltd. Full time

    Job Role: Snowflake Developer Experience: 6-10 Years Location: Trivandrum/Kochi/Bangalore/Chennai/Pune/Noida/Hyderabad Work Model: Hybrid Mandatory Skills: Snowflake, PySpark, ETL, SQL Must Have Skills Data Warehouse: · Design, implement, and optimize data warehouses on the Snowflake platform. · Ensure effective utilization of Snowflake features for...

  • Pyspark Developer

    2 days ago


    Bengaluru - BCIT, India Synechron Technologies Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Lead Pyspark Developer Overall Responsibilities:Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy. Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs,...


  • India CIGNEX Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for an experienced AWS Glue PySpark Developer to design, develop, and optimize ETL pipelines and data processing solutions on AWS. The ideal candidate will have deep expertise in PySpark, AWS Glue, and data engineering best practices, along with hands-on experience in building scalable, high-performance data solutions in the cloud.Key...


  • All India Trigent Software Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role Overview: You will be responsible for collaborating with business and other teams to understand business requirements and contribute to project deliverables as a Python and AWS Developer. Your role will also involve playing a key part in project transitions, enhancements, modifications, and providing post-transition support when necessary. Key...


  • India Matrix International Financial Services Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    India · Full-time · IntermediateAbout The PositionJob Summary:We are seeking a highly skilled ETL Developer with strong expertise in SQL and Python or PySpark to join our data engineering team within a leading financial institution. The ideal candidate will have at least 5 years of experience in the banking sector, with a solid understanding of Anti-Money...


  • Bengaluru, India GeekSoft Consulting Full time

    Job Description Python Developer 5-8Yrs (Relevant Experience) Bengaluru Full Time NOTE: Python Developers with Python Scripting+ PySpark+ MLOps+ Fast API are only to Apply. No Juniors. We are not looking for candidates below 5+Yrs relevant experience Job Details: - We are seeking a skilled Python Developer with expertise in Python scripting, PySpark...


  • Chennai, India Prowesstics Full time

    Job Description We are looking for a skilled Data Engineer with hands-on experience in PySpark and Databricks to design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams. Key...

  • Data Engineer

    1 week ago


    Ambala, India Shiv Kanti Infosystems Full time

    Job Description Senior Data Engineer Azure, Airflow & PySpark We're hiring a Senior Data Engineer (69 years of experience) to lead the modernization of our data ecosystem from legacy platforms (Azure Synapse, SQL Server) to a next-gen Microsoft Fabric lakehouse. If you bring deep Azure expertise, strong Airflow orchestration skills, and at least 4 years of...

  • Data Engineer

    20 hours ago


    Pune, India Barclays Full time

    Job Description Join us as a Data Engineer - Pyspark,SQL at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack,...