Python with Pyspark

2 months ago

Mumbai, India INFOBEANS TECHNOLOGIES Full time

Bangalore/Chennai/Hyderabad/Pune/Mumbai/Noida/Indore 4+ years

Role: Python with Pyspark Location: Bangalore, Chennai, Hyderabad, Pune, Mumbai, Noida, Indore Experience: 4+ years Key Skills:. Python, Pyspark, AWS Job Category: Python Development What will your role look like Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Interact with clients to understand and gather requirements. Responsible for technical design, development, and system/integration testing using oracle methodologies. Implement Data Pipelines using Delta lake framework Why you will love this role Besides a competitive package, an open workspace full of smart and pragmatic team members, with ever-growing opportunities for professional and personal growth Be a part of a learning culture where teamwork and collaboration are encouraged, diversity is valued and excellence, compassion, openness and ownership is rewarded We would like you to bring along Experience in Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Experience preferably on OCI (ODI/OCI-DI/ OCI Data Flow), Oracle Database basics with ANSI SQL. Experience in Python Programming Language, PySpark, Linux Shell Scripting, Data Integration experience preferably on OCI (ODI/OCI-DI/ OCI Data Flow), Oracle Database basics with ANSI SQL. Oracle Cloud Infrastructure Experience or Certification will be a plus Healthcare Industry experience or standard certifications will be a plus Hadoop, Hive, Hue, Kafka, Kubernetes, Ansible, Terraform, BitBucket experience, Apache Airflow experience would be a plus Creativity, Personal Drive, Influencing and Negotiating, Problem Solving Building Effective Relationships, Customer Focus, Effective Communication Experienced in Python Programming Language and PySpark with exposure to PySpark SQL ,PySpark Streaming based data ingestion patterns. Knowledge of SQL for data analysis Knowledge of Shell Scripting for creating code wrappers Configuration and Scheduling of Spark Pipelines using Apache Airflow and Cron jobs Develop Spark APIs for Data Services from Data lake Understanding of DataLakehouse architecture and ability to create and design as per DataLakehouse Design Standards Knowledge and understanding of Data lake formats to efficiently design Data lake data stores Experience in developing event driven data pipelines Ability to develop reusable code components Source code management using Git Data Integration experience using platforms like ODI/OCI-DI/ OCI Data Flow on Oracle Cloud Infrastructure (OCI) Ready to travel as and when required by project.

  • Python with Pyspark

    5 days ago

    Mumbai, Maharashtra, India INFOBEANS TECHNOLOGIES Full time

    Bangalore/Chennai/Hyderabad/Pune/Mumbai/Noida/Indore 4+ yearsRole: Python with Pyspark Location: Bangalore, Chennai, Hyderabad, Pune, Mumbai, Noida, Indore Experience: 4+ years Key Skills: Python, Pyspark, AWS Job Category: Python Development What will your role look like Python Programming Language, PySpark, Linux Shell Scripting, Data Integration Interact...

  • AWS Data Engineer

    3 weeks ago

    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    2 months ago

    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • Valiance Solutions

    2 months ago

    Mumbai, India Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • Data Engineer/Senior Data Engineer

    4 weeks ago

    Mumbai, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Data Engineer/Senior Data Engineer

    3 weeks ago

    Mumbai, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Data Engineer/Senior Data Engineer

    4 weeks ago

    mumbai, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Data Engineer/Senior Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Data Engineer/Senior Data Engineer

    4 weeks ago

    Mumbai, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Data Engineer/Senior Data Engineer

    2 days ago

    mumbai, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Data Engineer/Senior Data Engineer

    3 weeks ago

    Mumbai, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Data Engineer/Senior Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Big Data Engineer

    1 week ago

    mumbai, India Techno Wise Full time

    Job Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play...

  • Senior Data Engineer

    3 weeks ago

    Mumbai, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • Senior Data Engineer

    3 weeks ago

    Mumbai/Chennai, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role : - This role is more focused on Pyspark with Cloud developer.About the Responsibilities : - This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • Senior Data Engineer

    2 months ago

    Mumbai,Chennai, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role : - This role is more focused on Pyspark with Cloud developer.About the Responsibilities : - This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • Senior Data Engineer

    3 weeks ago

    Mumbai/Chennai, IN Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • Senior Data Engineer

    2 months ago

    Mumbai/Chennai, IN Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • Big Data Engineer

    2 weeks ago

    Mumbai/Bangalore/Pune, India Techno Wise Full time

    Job Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play...

  • Big Data Engineer

    5 days ago

    Mumbai/Bangalore/Pune, IN Techno Wise Full time

    Job Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...