Python with Pyspark

1 week ago

Mumbai, Maharashtra, India INFOBEANS TECHNOLOGIES Full time
Bangalore/Chennai/Hyderabad/Pune/Mumbai/Noida/Indore 4+ years

Role:
Python with

Pyspark Location:
Bangalore, Chennai, Hyderabad, Pune, Mumbai, Noida,
Indore Experience: 4+ years

Key Skills:
Python, Pyspark, AWS

Job Category:

Python Development What will your role look like Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Interact with clients to understand and gather requirements.

Responsible for technical design, development, and system/integration testing using oracle methodologies.

Implement Data Pipelines using Delta lake framework Why you will love this role Besides a competitive package, an open workspace full of smart and pragmatic team members, with ever-growing opportunities for professional and personal growth Be a part of a learning culture where teamwork and collaboration are encouraged, diversity is valued and excellence, compassion, openness and ownership is rewarded We would like you to bring along Experience in Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Experience preferably on OCI (ODI/OCI-DI/ OCI Data Flow), Oracle Database basics with ANSI SQL.

Experience in Python Programming Language, PySpark, Linux Shell Scripting, Data Integration experience preferably on OCI (ODI/OCI-DI/ OCI Data Flow), Oracle Database basics with ANSI SQL.

Oracle Cloud Infrastructure Experience or Certification will be a plus Healthcare Industry experience or standard certifications will be a plus Hadoop, Hive, Hue, Kafka, Kubernetes, Ansible, Terraform, BitBucket experience, Apache Airflow experience would be a plus Creativity, Personal Drive, Influencing and Negotiating, Problem Solving Building Effective Relationships, Customer Focus, Effective Communication Experienced in Python Programming Language and PySpark with exposure to PySpark SQL ,PySpark Streaming based data ingestion patterns.

Knowledge of SQL for data analysis Knowledge of Shell Scripting for creating code wrappers Configuration and Scheduling of Spark Pipelines using Apache Airflow and Cron jobs Develop Spark APIs for Data Services from Data lake Understanding of DataLakehouse architecture and ability to create and design as per DataLakehouse Design Standards Knowledge and understanding of Data lake formats to efficiently design Data lake data stores Experience in developing event driven data pipelines Ability to develop reusable code components Source code management using Git Data Integration experience using platforms like ODI/OCI-DI/ OCI Data Flow on Oracle Cloud Infrastructure (OCI) Ready to travel as and when required by project.

  • Data Engineer/Senior Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Data Engineer/Senior Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Python Developer

    1 week ago

    Mumbai, Maharashtra, India programming Full time

    Python DeveloperLocation: BangaloreExperience: 2+ YearsMandatory Skills: Django, Python, FlaskBuild backend features in Python, including profiling and integrating large datasetsSupport the design and implementation of functional requirementsImplement best practices API designs including securityImplement software enhancements and suggest...

  • Python Developer

    4 weeks ago

    Mumbai, Maharashtra, India Programming.com Full time

    Python Developer Location - Bangalore Experience : 2 + YearsMandatory skills - Django, Python, Flask, :- Build back-end features in Python, including profiling and integrating large datasets- Support the design and implementation of functional requirements- Implement best practices API designs including security- Implement software enhancements and suggest...

  • Python Developer

    3 weeks ago

    Mumbai, Maharashtra, India Programming.com Full time

    Python Developer Location - Bangalore Experience : 2 + YearsMandatory skills - Django, Python, Flask, :- Build back-end features in Python, including profiling and integrating large datasets- Support the design and implementation of functional requirements- Implement best practices API designs including security- Implement software enhancements and suggest...

  • Azure Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India ADS247365 Full time

    Location : Mumbai, Maharashtra Duration : Full TimeJob Description :Roles & Responsibilities :- Must have 4 years of Experience on Python.- Must have 4 years' relevant experience on Apache Spark OR pyspark. - Must have 4 years of experience in SQL [Must be proficient in writing Advanced complex queries]. - Must have 4 years' relevant experience on...

  • Azure Data Engineer

    2 months ago

    Mumbai, Maharashtra, India ADS247365 Full time

    Location : Mumbai, Maharashtra Duration : Full TimeJob Description :Roles & Responsibilities :- Must have 4 years of Experience on Python.- Must have 4 years' relevant experience on Apache Spark OR pyspark. - Must have 4 years of experience in SQL [Must be proficient in writing Advanced complex queries]. - Must have 4 years' relevant experience on...

  • Python Software Engineer

    1 week ago

    Mumbai, Maharashtra, India Procter & Gamble Full time

    Are you a Software Engineer with strong Python/PySpark skills, deep understanding of Azure cloud-based AI environments and experience with CI/CD? Procter & Gamble is looking for an AI Engineer to partner closely with our Data Scientists on exciting business use cases in the retail, marketing, and supply chain areas. In this role you would be working closely...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India XL Advisors Full time

    Job Description : Qualification :- Bachelors in Engineering (CS/IT) and above with a bent towards analytics. Cloud certifications (AWS/Azure) will be a plusSkills/ Experience :- Ability to engage with stakeholders to understand business requirements and convert the same into technical problems for solution development Knowledge of creating notebooks using...

  • Python Software Engineer

    1 week ago

    Mumbai, Maharashtra, India Procter & Gamble Full time

    Description Are you a Software Engineer with strong Python/PySpark skills, deep understanding of Azure cloud-based AI environments and experience with CI/CD? Procter & Gamble is looking for an AI Engineer to partner closely with our Data Scientists on exciting business use cases in the retail, marketing, and supply chain areas. In this role you would be...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role : This role is more focused on Pyspark with Cloud developer.About the Responsibilities : This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of crossfunctional software products under a microservices styled...

  • Data Engineer-Azure

    1 week ago

    Mumbai, Maharashtra, India C5i Full time

    C5i is seeking a talented #azuredataengineer for positions in Gurugram, Bengaluru, Mumbai, and Coimbatore. Preferred : Immediate joinerThe ideal candidate should have relevant 4 years of experience in #Python, #azuredatafactory, #databricks, #PySpark, #azuredatalake, #sql, #azuresynapse, and #AzureDataLakeStorage. Join our team and be part of an exciting...

  • Sr Azure Data Engineer

    1 week ago

    Mumbai, Maharashtra, India White Force Full time

    Job Description: Key Responsibilities:1. Design, develop, and deploy scalable data pipelines on the Azure cloud platform using AzureData Factory (ADF).2. Architect end-to-end data solutions to support business requirements and analyticalinsights, with a focus on Databricks (PySpark) for data processing.3. Implement and optimize data processing workflows...

  • Data Engineer/Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India consultant Full time

    Openings for the role of Data Engineer/Senior Data EngineerRequirements:Over 5 years of experience as a Data EngineerProficiency in Python, PySpark, and SQL databasesFamiliarity with Azure, Databricks, and Google Cloud Platform (GCP)Expertise in software development lifecycle and best practicesExperience with ETL processes, data pipelines, and data...

  • Big Data Databricks

    3 weeks ago

    Mumbai, Maharashtra, India timesjobs Full time

    Experience: 5 YearsLocation: Bangalore, Mumbai, Pune, and HyderabadThe primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying complex integrated business...

  • Big Data Databricks

    1 week ago

    Mumbai, Maharashtra, India timesjobs Full time

    Experience: 5 YearsLocation: Bangalore, Mumbai, Pune, and HyderabadThe primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying complex integrated business...

  • Big Data Databricks

    3 weeks ago

    Mumbai, Maharashtra, India timesjobs Full time

    Experience: 5 YearsLocation: Bangalore, Mumbai, Pune, and HyderabadThe primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying complex integrated business...

  • Data Scientist

    1 week ago

    Mumbai, Maharashtra, India Celebal Technologies Full time

    Designation – Machine Learning Engineer Location - MUMBAI / JAIPUR Experience – 3 +years We are seeking a skilled and enthusiastic Classical Machine Learning Engineer with a minimum of 3 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python programming, classical machine learning algorithms, and a solid...

  • Senior Data Scientist

    1 week ago

    Mumbai, Maharashtra, India Celebal Technologies Full time

    Designation – Machine Learning EngineerLocation - Pune, Noida, Jaipur, Hyderabad, Remote*Experience – 7 +yearsWe are seeking a skilled and enthusiastic Classical Machine Learning Engineer with a minimum of 3 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python programming, classical machine learning...

  • Statusneo-Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Nexthire Full time

    Job Title: Data EngineerExperience Level: 3-5 YearsLocation: Mumba (Airoli)Job Type: Full-TimeJob Description:We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have 3-5 years of experience in data engineering with a strong background in PySpark, Python, Spark, and SQL. The Data Engineer will be...