Pyspark Developer
2 days ago
As an experienced professional with over 5 years of experience, your role will primarily involve working with Pyspark, Spark, and proficient in SQL. You will be responsible for creating, deploying, maintaining, and debugging data pipelines using Spark and Hadoop Ecosystems to handle large amounts of big data. Your key responsibilities will include: - Handling data pipeline creation, deployment, maintenance, and debugging using Pyspark and Spark with Hadoop distributed frameworks - Scheduling and monitoring jobs while creating tools for automation - Utilizing Scala and Python for at least 4 years to support data processing tasks - Demonstrating proficient knowledge of SQL with any RDBMS - Communicating effectively (verbally and in writing) across teams, both internally and externally, at all levels - Working within deadlines, effectively prioritizing tasks, and executing them in a timely manner Preferred qualifications for this role include: - At least 1 year of AWS development experience - Experience in driving automations - DevOps knowledge is an added advantage This summary provides an overview of the key responsibilities and qualifications required for the position.,
-
Pyspark Developer
22 hours ago
india Tata Consultancy Services Full timeGreetings from TCS!!TCS is hiring forPyspark DeveloperRequired Skill Set:Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range:4 to 10 Years Job Location:Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have: Data Engineer, Python developer with specialty in Pandas...
-
Snowflake Developer With PySpark
18 hours ago
India DigiHelic Solutions Pvt. Ltd. Full timeJob Role: Snowflake Developer Experience: 6-10 Years Location: Trivandrum/Kochi/Bangalore/Chennai/Pune/Noida/Hyderabad Work Model: Hybrid Mandatory Skills: Snowflake, PySpark, ETL, SQL Must Have Skills Data Warehouse: · Design, implement, and optimize data warehouses on the Snowflake platform. · Ensure effective utilization of Snowflake features for...
-
Pyspark Developer
2 days ago
Bengaluru - BCIT, India Synechron Technologies Full time ₹ 10,00,000 - ₹ 25,00,000 per yearLead Pyspark Developer Overall Responsibilities:Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy. Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs,...
-
AWS Glue PySpark Developer
7 days ago
India CIGNEX Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for an experienced AWS Glue PySpark Developer to design, develop, and optimize ETL pipelines and data processing solutions on AWS. The ideal candidate will have deep expertise in PySpark, AWS Glue, and data engineering best practices, along with hands-on experience in building scalable, high-performance data solutions in the cloud.Key...
-
Python, AWS Developer
7 days ago
All India Trigent Software Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per yearRole Overview: You will be responsible for collaborating with business and other teams to understand business requirements and contribute to project deliverables as a Python and AWS Developer. Your role will also involve playing a key part in project transitions, enhancements, modifications, and providing post-transition support when necessary. Key...
-
ETL Developer – SQL, Python/PySpark
1 hour ago
India Matrix International Financial Services Full time ₹ 40,00,000 - ₹ 1,20,00,000 per yearIndia · Full-time · IntermediateAbout The PositionJob Summary:We are seeking a highly skilled ETL Developer with strong expertise in SQL and Python or PySpark to join our data engineering team within a leading financial institution. The ideal candidate will have at least 5 years of experience in the banking sector, with a solid understanding of Anti-Money...
-
▷ Only 24h Left: Python Developer
2 weeks ago
Bengaluru, India GeekSoft Consulting Full timeJob Description Python Developer 5-8Yrs (Relevant Experience) Bengaluru Full Time NOTE: Python Developers with Python Scripting+ PySpark+ MLOps+ Fast API are only to Apply. No Juniors. We are not looking for candidates below 5+Yrs relevant experience Job Details: - We are seeking a skilled Python Developer with expertise in Python scripting, PySpark...
-
Pyspark Data Engineer
4 days ago
Chennai, India Prowesstics Full timeJob Description We are looking for a skilled Data Engineer with hands-on experience in PySpark and Databricks to design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams. Key...
-
Data Engineer
1 week ago
Ambala, India Shiv Kanti Infosystems Full timeJob Description Senior Data Engineer Azure, Airflow & PySpark We're hiring a Senior Data Engineer (69 years of experience) to lead the modernization of our data ecosystem from legacy platforms (Azure Synapse, SQL Server) to a next-gen Microsoft Fabric lakehouse. If you bring deep Azure expertise, strong Airflow orchestration skills, and at least 4 years of...
-
Data Engineer
20 hours ago
Pune, India Barclays Full timeJob Description Join us as a Data Engineer - Pyspark,SQL at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack,...