Python with Pyspark

4 days ago

Mumbai, India INFOBEANS TECHNOLOGIES Full time

Bangalore/Chennai/Hyderabad/Pune/Mumbai/Noida/Indore 4+ years

Role: Python with Pyspark Location: Bangalore, Chennai, Hyderabad, Pune, Mumbai, Noida, Indore Experience: 4+ years Key Skills:. Python, Pyspark, AWS Job Category: Python Development What will your role look like Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Interact with clients to understand and gather requirements. Responsible for technical design, development, and system/integration testing using oracle methodologies. Implement Data Pipelines using Delta lake framework Why you will love this role Besides a competitive package, an open workspace full of smart and pragmatic team members, with ever-growing opportunities for professional and personal growth Be a part of a learning culture where teamwork and collaboration are encouraged, diversity is valued and excellence, compassion, openness and ownership is rewarded We would like you to bring along Experience in Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Experience preferably on OCI (ODI/OCI-DI/ OCI Data Flow), Oracle Database basics with ANSI SQL. Experience in Python Programming Language, PySpark, Linux Shell Scripting, Data Integration experience preferably on OCI (ODI/OCI-DI/ OCI Data Flow), Oracle Database basics with ANSI SQL. Oracle Cloud Infrastructure Experience or Certification will be a plus Healthcare Industry experience or standard certifications will be a plus Hadoop, Hive, Hue, Kafka, Kubernetes, Ansible, Terraform, BitBucket experience, Apache Airflow experience would be a plus Creativity, Personal Drive, Influencing and Negotiating, Problem Solving Building Effective Relationships, Customer Focus, Effective Communication Experienced in Python Programming Language and PySpark with exposure to PySpark SQL ,PySpark Streaming based data ingestion patterns. Knowledge of SQL for data analysis Knowledge of Shell Scripting for creating code wrappers Configuration and Scheduling of Spark Pipelines using Apache Airflow and Cron jobs Develop Spark APIs for Data Services from Data lake Understanding of DataLakehouse architecture and ability to create and design as per DataLakehouse Design Standards Knowledge and understanding of Data lake formats to efficiently design Data lake data stores Experience in developing event driven data pipelines Ability to develop reusable code components Source code management using Git Data Integration experience using platforms like ODI/OCI-DI/ OCI Data Flow on Oracle Cloud Infrastructure (OCI) Ready to travel as and when required by project.

  • ETL Data Engineer

    3 weeks ago

    Mumbai, India Information Technology Full time

    Key Responsibilities :- Design, develop, and maintain robust data pipelines and ETL/ELT workflows using PySpark, Python, and SQL.- Build and manage data ingestion and transformation processes from various sources including Hive, Kafka, and cloud-native services.- Orchestrate workflows using Apache Airflow and ensure timely and reliable data delivery.- Work...

  • PySpark ETL Developer

    2 days ago

    Mumbai, Maharashtra, India BNP Paribas Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position Purpose The Senior Developer will be a part of the ISPL Mumbai IHC ETL projects team. The developer position will primarily work on Apache Spark(python), Spark SQL, ETL tools, Unix, Autosys and DBResponsibilitiesDirect Responsibilities Expertise on PySpark, database migration, transformation, and integration solutions for any Data warehousing...

  • Pyspark Developer

    4 weeks ago

    Mumbai, India Artech Full time

    Role & responsibilities You will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also be...

  • Pyspark Developer

    7 days ago

    Mumbai, Maharashtra, India Artech Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesYou will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also be...

  • Senior Python

    4 weeks ago

    Ahmedabad, Mumbai, India Best infosystems Ltd. Full time

    Job Description Job Title: Senior Python & Spark Developer Job Type: Full-Time Experience Required: 5+ years Location: Ahmedabad preferred, but open for Mumbai JOB DESCRIPTION: We are looking for an experienced Senior Python & pySpark Developer with strong expertise in Python (Django, Flask) and PySpark for large-scale data processing. The ideal...

  • python developer

    1 day ago

    Mumbai, Maharashtra, India Capgemini Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Your Role  Python Developer As a Python developer you must have 2+ years in Python / Pyspark.- Strong programming experience, Python, Pyspark, Scala is preferred.- Experience in designing and implementing CI/CD, Build Management, and Development strategy.- Experience with SQL and SQL Analytical functions, experience participating in key business,...

  • Senior Python Developer

    4 weeks ago

    Mumbai, India Kyara Consulting Full time

    Role Overview :We are looking for an experienced Senior Python & Spark Developer with strong expertise in Python (Django, Flask) and PySpark for large-scale data processing. The ideal candidate will be a self-starter who can independently own and deliver end-to-end tasks, while also guiding junior team members.Key Responsibilities :- Design, develop, and...

  • python developer

    4 weeks ago

    mumbai, India Randstad Full time

    Must-Have Skills:- Experience: 3+ years.- Strong proficiency in Python programming language and Django.- Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.Nice to Have Qualifications:- Experience with Pandas and PySpark.- Product and customer-centric mindset.- Great Object-Oriented skills, including design patterns.-...

  • Senior Python developer

    2 weeks ago

    Mumbai, India SS&C Technologies Holdings Full time

    Job Description 5–7 years of experience as a PySpark developer in a data engineering or ETL development role. ·                 Strong proficiency in PySpark and the Apache Spark ecosystem. ·                 Strong hands on experience in Python Programming . ·                 Solid...

  • Senior Python developer

    2 weeks ago

    Mumbai, India SS&C Technologies Holdings Full time

    Job Description 5–7 years of experience as a PySpark developer in a data engineering or ETL development role. ·                 Strong proficiency in PySpark and the Apache Spark ecosystem. ·                 Strong hands on experience in Python Programming . ·                 Solid...