Python with Pyspark

2 days ago

Mumbai, India INFOBEANS TECHNOLOGIES Full time

Bangalore/Chennai/Hyderabad/Pune/Mumbai/Noida/Indore 4+ years

Role: Python with Pyspark Location: Bangalore, Chennai, Hyderabad, Pune, Mumbai, Noida, Indore Experience: 4+ years Key Skills:. Python, Pyspark, AWS Job Category: Python Development What will your role look like Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Interact with clients to understand and gather requirements. Responsible for technical design, development, and system/integration testing using oracle methodologies. Implement Data Pipelines using Delta lake framework Why you will love this role Besides a competitive package, an open workspace full of smart and pragmatic team members, with ever-growing opportunities for professional and personal growth Be a part of a learning culture where teamwork and collaboration are encouraged, diversity is valued and excellence, compassion, openness and ownership is rewarded We would like you to bring along Experience in Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Experience preferably on OCI (ODI/OCI-DI/ OCI Data Flow), Oracle Database basics with ANSI SQL. Experience in Python Programming Language, PySpark, Linux Shell Scripting, Data Integration experience preferably on OCI (ODI/OCI-DI/ OCI Data Flow), Oracle Database basics with ANSI SQL. Oracle Cloud Infrastructure Experience or Certification will be a plus Healthcare Industry experience or standard certifications will be a plus Hadoop, Hive, Hue, Kafka, Kubernetes, Ansible, Terraform, BitBucket experience, Apache Airflow experience would be a plus Creativity, Personal Drive, Influencing and Negotiating, Problem Solving Building Effective Relationships, Customer Focus, Effective Communication Experienced in Python Programming Language and PySpark with exposure to PySpark SQL ,PySpark Streaming based data ingestion patterns. Knowledge of SQL for data analysis Knowledge of Shell Scripting for creating code wrappers Configuration and Scheduling of Spark Pipelines using Apache Airflow and Cron jobs Develop Spark APIs for Data Services from Data lake Understanding of DataLakehouse architecture and ability to create and design as per DataLakehouse Design Standards Knowledge and understanding of Data lake formats to efficiently design Data lake data stores Experience in developing event driven data pipelines Ability to develop reusable code components Source code management using Git Data Integration experience using platforms like ODI/OCI-DI/ OCI Data Flow on Oracle Cloud Infrastructure (OCI) Ready to travel as and when required by project.

  • ETL Data Engineer

    7 days ago

    Mumbai, India Information Technology Full time

    Key Responsibilities :- Design, develop, and maintain robust data pipelines and ETL/ELT workflows using PySpark, Python, and SQL.- Build and manage data ingestion and transformation processes from various sources including Hive, Kafka, and cloud-native services.- Orchestrate workflows using Apache Airflow and ensure timely and reliable data delivery.- Work...

  • PySpark (Apply Now)

    3 weeks ago

    Mumbai, India Teamware Solutions Full time

    Job Description - Key Responsibilities: - PySpark Development: - Design, implement, and optimize PySpark solutions for large-scale data processing and analysis. - Develop data pipelines using Spark to handle data transformations, aggregations, and other complex operations efficiently. - Write and optimize Spark SQL queries for big data analytics and...

  • PySpark ETL Developer

    6 days ago

    Mumbai, Maharashtra, India BNP Paribas Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position Purpose The Senior Developer will be a part of the ISPL Mumbai IHC ETL projects team. The developer position will primarily work on Apache Spark(python), Spark SQL, ETL tools, Unix, Autosys and DBResponsibilitiesDirect Responsibilities Expertise on PySpark, database migration, transformation, and integration solutions for any Data warehousing...

  • Pyspark Developer

    2 weeks ago

    Mumbai, Maharashtra, India Artech Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesYou will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also be...

  • Data Engineer

    3 weeks ago

    Mumbai, India NEXTHIRE LLP Full time

    Description :Job Title : Data Engineer (Python, PySpark, BigQuery)Location : Mumbai (Onsite)Experience : 7+ YearsEmployment Type : Full-TimeJob Summary :We are looking for a highly experienced Data Engineer with deep expertise in Python, PySpark, and BigQuery to join our data engineering team in Mumbai. The ideal candidate will be responsible for building...

  • Python Backend Engineer

    1 week ago

    Mumbai, Maharashtra, India Green Hindustan Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Python, PySpark, Apache Airflow & RestAPISpark is mediatory requirement.

  • Python developer_Jessica

    4 days ago

    Mumbai, Maharashtra, India Coders Brain Technology Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Python Developer Coordinating with development teams to determine application requirements Writing scalable code using Python programming language Expertise in at least one popular Python framework(like Django or Flask) The developer must have sound knowledge in Apache Spark and Python programming Experience in developing data processing/data pipelines tasks...

  • python developer

    6 days ago

    Mumbai, Maharashtra, India Capgemini Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Your Role  Python Developer As a Python developer you must have 2+ years in Python / Pyspark.- Strong programming experience, Python, Pyspark, Scala is preferred.- Experience in designing and implementing CI/CD, Build Management, and Development strategy.- Experience with SQL and SQL Analytical functions, experience participating in key business,...

  • Pyspark Developer Lead

    4 days ago

    Mumbai, Maharashtra, India Hybrowlabs Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Company DescriptionHybrowlabs Technologies is dedicated to building software better, and faster. We explore every tool that hits the market to find the best stack of tools for software development. Our magical formula and stack of tools will accelerate your software development process. Contact us to learn more.Role DescriptionDesign and architect scalable,...

  • Data Engineer

    4 weeks ago

    Mumbai, India Tekgence Inc Full time

    Job Description:Must Have:- Must have 6+Years of experience- Programming Language: Python- AWS Services: IAM, Networking, Lake Formation, EMR, MWAA, Athena, Glue ETL, Glue Catalog, S3, Lambda, API Gateway, Event Bridge, SQS, SNS, Kinesis, DMS- Automation: Terraform (IaC), GitHub Actions- UI Tech (for a few resources): Angular- Architecture: Data Mesh, Micro...